Skip to content
Merged

Dev #5028

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
121 commits
Select commit Hold shift + click to select a range
5641d20
remove hail from backed specific call
hanars Aug 21, 2025
7506781
remove hail only command
hanars Aug 21, 2025
e4e0ea5
clean up check samples job
hanars Aug 21, 2025
388f5be
clean up backend specific calls
hanars Aug 21, 2025
09a81b5
remove unused dag triggers
hanars Aug 21, 2025
afbf669
todos
hanars Aug 21, 2025
ae6572b
Merge branch 'backend-specific-deactivate-project' of https://github.…
hanars Aug 21, 2025
0baa719
remve airflow from deactivate project
hanars Aug 21, 2025
46152b7
Merge branch 'backend-specific-deactivate-project' of https://github.…
hanars Aug 21, 2025
723254d
remove dag trigger from transfer families
hanars Aug 21, 2025
61fbf4a
remove generic airflow dag triggering
hanars Aug 21, 2025
05e31b4
placeholder delete family function
hanars Aug 21, 2025
ae00275
Merge branch 'dev' of https://github.com/broadinstitute/seqr into rem…
hanars Aug 22, 2025
69fd91b
Merge branch 'backend-specific-deactivate-project' of https://github.…
hanars Aug 22, 2025
dc5ca1d
remove hail search utils;
hanars Aug 22, 2025
294df7b
settings cleanup
hanars Aug 22, 2025
0e9539c
fix unit tests
hanars Aug 22, 2025
6b3df2c
Merge branch 'dev' of https://github.com/broadinstitute/seqr into rem…
hanars Aug 22, 2025
7f7662d
clean up github workflows
hanars Aug 22, 2025
c382fb2
remove vlm hail backend
hanars Aug 22, 2025
bd6fe23
fix local check samples test
hanars Aug 25, 2025
230ffd0
Merge branch 'dev' of https://github.com/broadinstitute/seqr into rem…
hanars Sep 8, 2025
694df3b
remove vlm hail backend
hanars Aug 22, 2025
20afb6a
clean up
hanars Sep 9, 2025
b84a7aa
clean up check samples job
hanars Aug 21, 2025
9ecf3b8
fix local check samples test
hanars Aug 25, 2025
8bcb0ed
remove unsuable reload command
hanars Sep 10, 2025
b11efde
clean up
hanars Sep 10, 2025
c36dc5e
Merge branch 'vlm-hail-support-deprecation' of https://github.com/bro…
hanars Sep 10, 2025
3d57625
Merge branch 'check-samples-job-hail-backend-cleanup' of https://gith…
hanars Sep 10, 2025
693c077
update manage tests
hanars Sep 10, 2025
866b2d2
fix trigger dag
hanars Sep 10, 2025
d5c099f
helper function for vcf iter
hanars Sep 10, 2025
1e38a3c
handle invalid utf8 encoding in vcf
hanars Sep 10, 2025
e7c4228
clean up github workflows
hanars Aug 22, 2025
f1a694f
remove java from unit test seqtup
hanars Sep 10, 2025
55ea461
remove hail docker build file
hanars Sep 10, 2025
c6e75ff
deterministic order for errors to remove flapping test
hanars Sep 10, 2025
84848a6
update docs for dataproc + clickhouse
bpblanken Sep 10, 2025
72861b8
Merge branch 'dev' of github.com:broadinstitute/seqr into dev
bpblanken Sep 10, 2025
b2329d1
remove hail search code
hanars Sep 10, 2025
095a5f4
Revert "update docs for dataproc + clickhouse"
bpblanken Sep 10, 2025
5401e60
clean up docker ignore
hanars Sep 10, 2025
c58fc6e
Merge pull request #5010 from broadinstitute/flappy-es-test-fix
hanars Sep 10, 2025
c3b480f
Merge pull request #5007 from broadinstitute/handle-file-encoding-error
hanars Sep 10, 2025
15c3fb8
better labels for intenral vs internal vlm results
hanars Sep 10, 2025
c0f0e21
add linting command
hanars Sep 10, 2025
4ae80f5
remove unused files
hanars Sep 10, 2025
b96412c
Merge pull request #5013 from broadinstitute/lookup-internal-external…
hanars Sep 10, 2025
933dce0
remov eunused test file
hanars Sep 10, 2025
80db11c
Merge pull request #5014 from broadinstitute/ui-lint-pr
hanars Sep 11, 2025
f256436
allow project, family, and matchmaker page loading when clickhouse is…
hanars Sep 11, 2025
702ef2b
test project page loads without clickhouse
hanars Sep 11, 2025
8e90faf
assert valid alerting
hanars Sep 11, 2025
3d80c31
get minimal set of transcript fields
hanars Sep 11, 2025
c99c2dc
update test
hanars Sep 11, 2025
b0ee56b
fix test
hanars Sep 11, 2025
32907af
test omim options when no lickhouse
hanars Sep 11, 2025
ff986d9
actually check connection is live in status check
hanars Sep 11, 2025
e9c8dbe
Merge pull request #5002 from broadinstitute/vlm-hail-support-depreca…
hanars Sep 11, 2025
b22f301
minimal response for mathcmaker saved variants
hanars Sep 11, 2025
66fd793
undo helper changes
hanars Sep 11, 2025
445757c
udatetes
hanars Sep 11, 2025
8a79f7f
Merge branch 'master' of https://github.com/broadinstitute/seqr into dev
hanars Sep 11, 2025
967acc7
Merge branch 'dev' of https://github.com/broadinstitute/seqr into sho…
hanars Sep 11, 2025
2879f9e
codacy fix
hanars Sep 11, 2025
22049bb
fix status tests
hanars Sep 11, 2025
5871eec
Merge branch 'dev' of https://github.com/broadinstitute/seqr into che…
hanars Sep 12, 2025
5cf2d43
Merge branch 'check-samples-job-hail-backend-cleanup' of https://gith…
hanars Sep 12, 2025
79558b9
clean up
hanars Sep 12, 2025
6d06ac6
Merge branch 'remove-hail-backend' of https://github.com/broadinstitu…
hanars Sep 12, 2025
cc7c1f9
remove hail docker build file
hanars Sep 10, 2025
820ccf6
clean up docker ignore
hanars Sep 10, 2025
219571e
Merge branch 'remove-hail-backend' of https://github.com/broadinstitu…
hanars Sep 12, 2025
5a62193
Merge pull request #5017 from broadinstitute/show-families-during-cli…
hanars Sep 12, 2025
516f61a
Merge branch 'dev' of https://github.com/broadinstitute/seqr into che…
hanars Sep 12, 2025
353a455
Merge branch 'check-samples-job-hail-backend-cleanup' of https://gith…
hanars Sep 12, 2025
2013e14
resolve merge
hanars Sep 12, 2025
6d052b0
move saved variant json reload to es specific module
hanars Sep 12, 2025
dba183c
remove backend agnostic get variants by id
hanars Sep 12, 2025
261f0d0
remove unused exception
hanars Sep 12, 2025
671329a
fix circular import
hanars Sep 12, 2025
0fca23e
Merge pull request #5005 from broadinstitute/check-samples-job-hail-b…
hanars Sep 12, 2025
b90742e
Merge pull request #5020 from broadinstitute/remove-hail-backend-app
hanars Sep 12, 2025
c227293
Merge pull request #5019 from broadinstitute/remove-hail-backend
hanars Sep 12, 2025
cc00438
Merge branch 'dev' of https://github.com/broadinstitute/seqr into bac…
hanars Sep 12, 2025
eafc23a
fix search
hanars Sep 12, 2025
c3c7218
restrict es only routes
hanars Sep 12, 2025
f13205c
restrict clickhouse only routes
hanars Sep 12, 2025
3fd0c38
restrict update saved variants to es
hanars Sep 12, 2025
2bf5350
fix test
hanars Sep 12, 2025
f867b82
fix test
hanars Sep 12, 2025
c147e10
first pass move lookup to clickhosue
hanars Sep 12, 2025
5a9aabb
Revert "first pass move lookup to clickhosue"
hanars Sep 15, 2025
6537778
remove family data from sv lookup and streamlibne calls
hanars Sep 15, 2025
951b6e2
clean up
hanars Sep 15, 2025
4378922
remove generic padded interval handling
hanars Sep 15, 2025
2507956
fix clickhouse tests
hanars Sep 15, 2025
8e86598
fix lookup test
hanars Sep 15, 2025
5ce7c0b
fix sv lookup test
hanars Sep 15, 2025
fedd6a8
test dataset type validation
hanars Sep 15, 2025
2574392
test sv lookup with no access
hanars Sep 15, 2025
5ec24af
test sv lookup with no access
hanars Sep 15, 2025
70ad47f
tets sv looklup with access
hanars Sep 15, 2025
c683461
Merge branch 'sv-lookup-cleanup' of https://github.com/broadinstitute…
hanars Sep 16, 2025
0ab659b
clickhouse only variant lookup
hanars Sep 16, 2025
ce543ef
add dataset es only
hanars Sep 16, 2025
5f42c58
todos
hanars Sep 16, 2025
bf14c6a
remove unnecessary parsed locus processing
hanars Sep 16, 2025
d0bce14
fix clickhouse errors
hanars Sep 16, 2025
772ce1f
fix test
hanars Sep 16, 2025
18fa557
fix utils tests
hanars Sep 16, 2025
e88b1e1
fix passed dataset type
hanars Sep 16, 2025
637c335
clean up query caching
hanars Sep 16, 2025
1bf016a
clean up unneccessary helper func
hanars Sep 16, 2025
1bd71e3
fix test
hanars Sep 16, 2025
029e6f4
Merge pull request #5022 from broadinstitute/sv-lookup-cleanup
hanars Sep 17, 2025
8d4ff61
Merge pull request #5021 from broadinstitute/backend-specific-cleanup
hanars Sep 17, 2025
6c882f9
Merge pull request #5025 from broadinstitute/cache-cleanup
hanars Sep 17, 2025
5c2750f
Merge pull request #5024 from broadinstitute/parsed-locus-cleanup
hanars Sep 17, 2025
465aa46
bump changelog
hanars Sep 18, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
11 changes: 0 additions & 11 deletions .cloudbuild/seqr-hail-search-docker.cloudbuild.yaml

This file was deleted.

2 changes: 0 additions & 2 deletions .dockerignore
Original file line number Diff line number Diff line change
Expand Up @@ -5,9 +5,7 @@ static/*
!static/images/*
deploy/*
!deploy/docker/seqr/*
!deploy/docker/hail_search/*
!deploy/docker/vlm/*
hail_search/fixtures/*
.git
.vscode
.idea
64 changes: 0 additions & 64 deletions .github/workflows/dev-hail-search-release.yaml

This file was deleted.

5 changes: 0 additions & 5 deletions .github/workflows/docker-lint.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,6 @@ on:
- master
paths:
- deploy/docker/seqr/Dockerfile
- hail_search/deploy/Dockerfile
- vlm/deploy/Dockerfile
- .hadolint.yaml
- .docker-compose.yaml
Expand All @@ -21,7 +20,6 @@ on:
- master
paths:
- deploy/docker/seqr/Dockerfile
- hail_search/deploy/Dockerfile
- vlm/deploy/Dockerfile
- .hadolint.yaml
- .docker-compose.yaml
Expand All @@ -37,9 +35,6 @@ jobs:
- uses: hadolint/hadolint-action@v1.5.0
with:
dockerfile: deploy/docker/seqr/Dockerfile
- uses: hadolint/hadolint-action@v1.5.0
with:
dockerfile: hail_search/deploy/Dockerfile
- uses: hadolint/hadolint-action@v1.5.0
with:
dockerfile: vlm/deploy/Dockerfile
38 changes: 0 additions & 38 deletions .github/workflows/hail-search-unit-tests.yaml

This file was deleted.

79 changes: 0 additions & 79 deletions .github/workflows/prod-hail-search-release.yaml

This file was deleted.

11 changes: 2 additions & 9 deletions .github/workflows/unit-tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -8,16 +8,12 @@ on:
- master
- dev
paths-ignore:
- 'hail_search/**'
- 'vlm/**'
- '.github/workflows/*hail-search*.yaml'
- '.github/workflows/*vlm*.yaml'
pull_request:
types: [opened, synchronize, reopened]
paths-ignore:
- 'hail_search/**'
- 'vlm/**'
- '.github/workflows/*hail-search*.yaml'
- '.github/workflows/*vlm*.yaml'

jobs:
Expand Down Expand Up @@ -73,11 +69,6 @@ jobs:
uses: actions/setup-python@v2
with:
python-version: ${{ matrix.python-version }}
- uses: actions/setup-java@v1
with:
java-version: "8" # The JDK version needed by hail
java-package: jdk # (jre, jdk, or jdk+fx) - defaults to jdk
architecture: x64 # (x64 or x86) - defaults to x64
- name: Use pip cache
uses: actions/cache@v4
with:
Expand Down Expand Up @@ -118,5 +109,7 @@ jobs:
- run: npm install -g npm@7.24.2
- run: npm ci
working-directory: ./ui
- run: npm run lint
working-directory: ./ui
- run: npm test
working-directory: ./ui
24 changes: 1 addition & 23 deletions .github/workflows/vlm-unit-tests.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -12,35 +12,13 @@ on:
paths:
- 'vlm/**'
- '.github/workflows/*vlm*.yaml'
- 'hail_search/fixtures/*'
pull_request:
types: [opened, synchronize, reopened]
paths:
- 'vlm/**'
- '.github/workflows/*vlm*.yaml'
- 'hail_search/fixtures/*'

jobs:
vlm_hail_backend:
runs-on: ubuntu-latest
container: hailgenetics/hail:0.2.128

steps:
- uses: actions/checkout@v2
- name: Install dependencies
run: |
python3 -m pip install --upgrade pip wheel
pip install -r vlm/requirements-test.txt
- name: Run coverage tests
run: |
export VLM_DATA_DIR=./hail_search/fixtures
export SEQR_BASE_URL=https://test-seqr.org/
export NODE_ID=TestVLM
export MACHINE_MEM=24
export JAVA_OPTS_XSS=16M
coverage run --source="./vlm" --omit="./vlm/__main__.py","./vlm/setup_clickhouse_test_data.py","./vlm/clickhouse_utils.py" -m pytest vlm/
coverage report --fail-under=95

vlm_clickhouse:
runs-on: ubuntu-latest
container: hailgenetics/hail:0.2.128
Expand Down Expand Up @@ -78,6 +56,6 @@ jobs:
export CLICKHOUSE_VLM_USERNAME=vlm_test_user
export CLICKHOUSE_VLM_PASSWORD=vlm_test_password
export CLICKHOUSE_DATABASE=test_seqr
coverage run --source="./vlm" --omit="./vlm/__main__.py","./vlm/setup_clickhouse_test_data.py","./vlm/hail_backend_utils.py" -m pytest vlm/
coverage run --source="./vlm" --omit="./vlm/__main__.py","./vlm/setup_clickhouse_test_data.py" -m pytest vlm/
coverage report --fail-under=95

3 changes: 3 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,9 @@

## dev

## 9/18/25
# Deprecate hail backend support

## 8/7/25
* Deprecate support for lifting existing projects from GRCH37 to GRCh38

Expand Down
Loading
Loading