A structural variation discovery pipeline for Illumina short-read whole-genome sequencing (WGS) data.
- Requirements
- Citation
- Acknowledgements
- Quickstart
- Pipeline Overview
- Module Descriptions
- GatherSampleEvidence - Raw callers and evidence collection
- EvidenceQC - Batch QC
- TrainGCNV - gCNV model creation
- GatherBatchEvidence - Batch evidence merging, BAF generation, and depth callers
- ClusterBatch - Site clustering
- GenerateBatchMetrics - Site metrics
- FilterBatch - Filtering
- MergeBatchSites - Cross-batch site merging
- GenotypeBatch - Genotyping
- RegenotypeCNVs - Genotype refinement (optional)
- MakeCohortVcf - Cross-batch integration, complex event resolution, and VCF cleanup
- Module 07 - Downstream Filtering
- AnnotateVcf - Annotation
- Module 09 - QC and Visualization
- Additional modules - Mosaic and de novo
- CI/CD
- Troubleshooting
- A Google Cloud account.
- A workflow execution system supporting the Workflow Description Language (WDL), either:
- Recommended: MELT. Due to licensing restrictions, we cannot provide a public docker image or reference panel VCFs for this algorithm.
- Recommended: cromshell for interacting with a dedicated Cromwell server.
- Recommended: WOMtool for validating WDL/json files.
Because GATK-SV has been tested only on the Google Cloud Platform (GCP), we are unable to provide specific guidance or support for other execution platforms including HPC clusters and AWS. Contributions from the community to improve portability between backends will be considered on a case-by-case-basis. We ask contributors to please adhere to the following guidelines when submitting issues and pull requests:
- Code changes must be functionally equivalent on GCP backends, i.e. not result in changed output
- Increases to cost and runtime on GCP backends should be minimal
- Avoid adding new inputs and tasks to workflows. Simpler changes are more likely to be approved, e.g. small in-line changes to scripts or WDL task command sections
- Avoid introducing new code paths, e.g. conditional statements
- Additional backend-specific scripts, workflows, tests, and Dockerfiles will not be approved
- Changes to Dockerfiles may require extensive testing before approval
We still encourage members of the community to adapt GATK-SV for non-GCP backends and share code on forked repositories. Here are a some considerations:
- Refer to Cromwell's documentation for configuration instructions.
- The handling and ordering of
globcommands may differ between platforms. - Shell commands that are potentially destructive to input files (e.g.
rm,mv,tabix) can cause unexpected behavior on shared filesystems. Enabling copy localization may help to more closely replicate the behavior on GCP. - For clusters that do not support Docker, Singularity is an alternative. See Cromwell documentation on Singularity.
- The GATK-SV pipeline takes advantage of the massive parallelization possible in the cloud. Local backends may not have the resources to execute all of the workflows. Workflows that use fewer resources or that are less parallelized may be more successful. For instance, some users have been able to run GatherSampleEvidence on a SLURM cluster.
- Illumina short-read whole-genome CRAMs or BAMs, aligned to hg38 with bwa-mem. BAMs must also be indexed.
- Family structure definitions file in PED format.
The PED file format is described here. Note that GATK-SV imposes additional requirements:
- The file must be tab-delimited.
- The sex column must only contain 0, 1, or 2: 1=Male, 2=Female, 0=Other/Unknown. Sex chromosome aneuploidies (detected in EvidenceQC) should be entered as sex = 0.
- All family, individual, and parental IDs must conform to the sample ID requirements.
- Missing parental IDs should be entered as 0.
- Header lines are allowed if they begin with a # character.
To validate the PED file, you may use
src/sv-pipeline/scripts/validate_ped.py -p pedigree.ped -s samples.list.
We recommend filtering out samples with a high percentage of improperly paired reads (>10% or an outlier for your data) as technical outliers prior to running GatherSampleEvidence. A high percentage of improperly paired reads may indicate issues with library prep, degradation, or contamination. Artifactual improperly paired reads could cause incorrect SV calls, and these samples have been observed to have longer runtimes and higher compute costs for GatherSampleEvidence.
Sample IDs must:
- Be unique within the cohort
- Contain only alphanumeric characters and underscores (no dashes, whitespace, or special characters)
Sample IDs should not:
- Contain only numeric characters
- Be a substring of another sample ID in the same cohort
- Contain any of the following substrings:
chr,name,DEL,DUP,CPX,CHROM
The same requirements apply to family IDs in the PED file, as well as batch IDs and the cohort ID provided as workflow inputs.
Sample IDs are provided to GatherSampleEvidence directly and need not match sample names from the BAM/CRAM headers. GetSampleID.wdl can be used to fetch BAM sample IDs and also generates a set of alternate IDs that are considered safe for this pipeline; alternatively, this script transforms a list of sample IDs to fit these requirements. Currently, sample IDs can be replaced again in GatherBatchEvidence.
The following inputs will need to be updated with the transformed sample IDs:
- Sample ID list for GatherSampleEvidence or GatherBatchEvidence
- PED file
Please cite the following publication: Collins, Brand, et al. 2020. "A structural variation reference for medical and population genetics." Nature 581, 444-451.
Additional references: Werling et al. 2018. "An analytical framework for whole-genome sequence association studies and its implications for autism spectrum disorder." Nature genetics 50.5, 727-736.
The following resources were produced using data from the All of Us Research Program and have been approved by the Program for public dissemination:
- Genotype filtering model: "aou_recalibrate_gq_model_file" in "inputs/values/resources_hg38.json"
The All of Us Research Program is supported by the National Institutes of Health, Office of the Director: Regional Medical Centers: 1 OT2 OD026549; 1 OT2 OD026554; 1 OT2 OD026557; 1 OT2 OD026556; 1 OT2 OD026550; 1 OT2 OD 026552; 1 OT2 OD026553; 1 OT2 OD026548; 1 OT2 OD026551; 1 OT2 OD026555; IAA #: AOD 16037; Federally Qualified Health Centers: HHSN 263201600085U; Data and Research Center: 5 U2C OD023196; Biobank: 1 U24 OD023121; The Participant Center: U24 OD023176; Participant Technology Systems Center: 1 U24 OD023163; Communications and Engagement: 3 OT2 OD023205; 3 OT2 OD023206; and Community Partners: 1 OT2 OD025277; 3 OT2 OD025315; 1 OT2 OD025337; 1 OT2 OD025276. In addition, the All of Us Research Program would not be possible without the partnership of its participants.
There are two scripts for running the full pipeline:
wdl/GATKSVPipelineBatch.wdl: Runs GATK-SV on a batch of samples.wdl/GATKSVPipelineSingleSample.wdl: Runs GATK-SV on a single sample, given a reference panel
Example workflow inputs can be found in /inputs. Build using scripts/inputs/build_default_inputs.sh, which
generates input jsons in /inputs/build. Except the MELT docker image, all required resources are available in public
Google buckets.
Some workflows require a Google Cloud Project ID to be defined in a cloud environment parameter group. Workspace builds
require a Terra billing project ID as well. An example is provided at /inputs/values/google_cloud.json but should
not be used, as modifying this file will cause tracked changes in the repository. Instead, create a copy in the same
directory with the format google_cloud.my_project.json and modify as necessary.
Note that these inputs are required only when certain data are located in requester pays buckets. If this does not apply, users may use placeholder values for the cloud configuration and simply delete the inputs manually.
Important: The example input files contain MELT inputs that are NOT public (see Requirements). These include:
GATKSVPipelineSingleSample.melt_dockerandGATKSVPipelineBatch.melt_docker- MELT docker URI (see Docker readme)GATKSVPipelineSingleSample.ref_std_melt_vcfs- Standardized MELT VCFs (GatherBatchEvidence)
The input values are provided only as an example and are not publicly accessible. In order to include MELT, these values must be provided by the user. MELT can be disabled by deleting these inputs and setting GATKSVPipelineBatch.use_melt to false.
We recommend running the pipeline on a dedicated Cromwell server with a cromshell client. A batch run can be started with the following commands:
> mkdir gatksv_run && cd gatksv_run
> mkdir wdl && cd wdl
> cp $GATK_SV_ROOT/wdl/*.wdl .
> zip dep.zip *.wdl
> cd ..
> echo '{ "google_project_id": "my-google-project-id", "terra_billing_project_id": "my-terra-billing-project" }' > inputs/values/google_cloud.my_project.json
> bash scripts/inputs/build_default_inputs.sh -d $GATK_SV_ROOT -c google_cloud.my_project
> cp $GATK_SV_ROOT/inputs/build/ref_panel_1kg/test/GATKSVPipelineBatch/GATKSVPipelineBatch.json GATKSVPipelineBatch.my_run.json
> cromshell submit wdl/GATKSVPipelineBatch.wdl GATKSVPipelineBatch.my_run.json cromwell_config.json wdl/dep.zip
where cromwell_config.json is a Cromwell workflow options file. Note users will need to re-populate batch/sample-specific parameters (e.g. BAMs and sample IDs).
The pipeline consists of a series of modules that perform the following:
- GatherSampleEvidence: SV evidence collection, including calls from a configurable set of algorithms (Manta, MELT, and Wham), read depth (RD), split read positions (SR), and discordant pair positions (PE).
- EvidenceQC: Dosage bias scoring and ploidy estimation
- GatherBatchEvidence: Copy number variant calling using cn.MOPS and GATK gCNV; B-allele frequency (BAF) generation; call and evidence aggregation
- ClusterBatch: Variant clustering
- GenerateBatchMetrics: Variant filtering metric generation
- FilterBatch: Variant filtering; outlier exclusion
- GenotypeBatch: Genotyping
- MakeCohortVcf: Cross-batch integration; complex variant resolution and re-genotyping; vcf cleanup
- Module 07: Downstream filtering, including minGQ, batch effect check, outlier samples removal and final recalibration;
- AnnotateVcf: Annotations, including functional annotation, allele frequency (AF) annotation and AF annotation with external population callsets;
- Module 09: Visualization, including scripts that generates IGV screenshots and rd plots.
- Additional modules to be added: de novo and mosaic scripts
Repository structure:
/dockerfiles: Resources for building pipeline docker images/inputs: files for generating workflow inputs/templates: Input json file templates/values: Input values used to populate templates
/wdl: WDLs running the pipeline. There is a master WDL for running each module, e.g.ClusterBatch.wdl./scripts: scripts for running tests, building dockers, and analyzing cromwell metadata files/src: main pipeline scripts/RdTest: scripts for depth testing/sv-pipeline: various scripts and packages used throughout the pipeline/svqc: Python module for checking that pipeline metrics fall within acceptable limits/svtest: Python module for generating various summary metrics from module outputs/svtk: Python module of tools for SV-related datafile parsing and analysis/WGD: whole-genome dosage scoring scripts
A minimum cohort size of 100 is required, and a roughly equal number of males and females is recommended. For modest cohorts (~100-500 samples), the pipeline can be run as a single batch using GATKSVPipelineBatch.wdl.
For larger cohorts, samples should be split up into batches of about 100-500 samples. Refer to the Batching section for further guidance on creating batches.
The pipeline should be executed as follows:
- Modules GatherSampleEvidence and EvidenceQC can be run on arbitrary cohort partitions
- Modules GatherBatchEvidence, ClusterBatch, GenerateBatchMetrics, and FilterBatch are run separately per batch
- GenotypeBatch is run separately per batch, using filtered variants (FilterBatch output) combined across all batches
- MakeCohortVcf and beyond are run on all batches together
Note: GatherBatchEvidence requires a trained gCNV model.
For larger cohorts, samples should be split up into batches of about 100-500 samples with similar characteristics. We recommend batching based on overall coverage and dosage score (WGD), which can be generated in EvidenceQC. An example batching process is outlined below:
- Divide the cohort into PCR+ and PCR- samples
- Partition the samples by median coverage from EvidenceQC, grouping samples with similar median coverage together. The end goal is to divide the cohort into roughly equal-sized batches of about 100-500 samples; if your partitions based on coverage are larger or uneven, you can partition the cohort further in the next step to obtain the final batches.
- Optionally, divide the samples further by dosage score (WGD) from EvidenceQC, grouping samples with similar WGD score together, to obtain roughly equal-sized batches of about 100-500 samples
- Maintain a roughly equal sex balance within each batch, based on sex assignments from EvidenceQC
GATKSVPipelineSingleSample.wdl runs the pipeline on a single sample using a fixed reference panel. An example run with reference panel containing 156 samples from the NYGC 1000G Terra workspace can be found in inputs/build/NA12878/test after building inputs).
Both the cohort and single-sample modes use the GATK-gCNV depth calling pipeline, which requires a trained model as input. The samples used for training should be technically homogeneous and similar to the samples to be processed (i.e. same sample type, library prep protocol, sequencer, sequencing center, etc.). The samples to be processed may comprise all or a subset of the training set. For small, relatively homogenous cohorts, a single gCNV model is usually sufficient. If a cohort contains multiple data sources, we recommend training a separate model for each batch or group of batches with similar dosage score (WGD). The model may be trained on all or a subset of the samples to which it will be applied; a reasonable default is 100 randomly-selected samples from the batch (the random selection can be done as part of the workflow by specifying a number of samples to the n_samples_subsample input parameter in /wdl/TrainGCNV.wdl).
New reference panels can be generated easily from a single run of the GATKSVPipelineBatch workflow. If using a Cromwell server, we recommend copying the outputs to a permanent location by adding the following option to the workflow configuration file:
"final_workflow_outputs_dir" : "gs://my-outputs-bucket",
"use_relative_output_paths": false,
Here is an example of how to generate workflow input jsons from GATKSVPipelineBatch workflow metadata:
> cromshell -t60 metadata 38c65ca4-2a07-4805-86b6-214696075fef > metadata.json
> python scripts/inputs/create_test_batch.py \
--execution-bucket gs://my-exec-bucket \
--final-workflow-outputs-dir gs://my-outputs-bucket \
metadata.json \
> inputs/values/my_ref_panel.json
> # Define your google project id (for Cromwell inputs) and Terra billing project (for workspace inputs)
> echo '{ "google_project_id": "my-google-project-id", "terra_billing_project_id": "my-terra-billing-project" }' > inputs/values/google_cloud.my_project.json
> # Build test files for batched workflows (google cloud project id required)
> python scripts/inputs/build_inputs.py \
inputs/values \
inputs/templates/test \
inputs/build/my_ref_panel/test \
-a '{ "test_batch" : "ref_panel_1kg", "cloud_env": "google_cloud.my_project" }'
> # Build test files for the single-sample workflow
> python scripts/inputs/build_inputs.py \
inputs/values \
inputs/templates/test/GATKSVPipelineSingleSample \
inputs/build/NA19240/test_my_ref_panel \
-a '{ "single_sample" : "test_single_sample_NA19240", "ref_panel" : "my_ref_panel" }'
> # Build files for a Terra workspace
> python scripts/inputs/build_inputs.py \
inputs/values \
inputs/templates/terra_workspaces/single_sample \
inputs/build/NA12878/terra_my_ref_panel \
-a '{ "single_sample" : "test_single_sample_NA12878", "ref_panel" : "my_ref_panel" }'
Note that the inputs to GATKSVPipelineBatch may be used as resources for the reference panel and therefore should also be in a permanent location.
The following sections briefly describe each module and highlights inter-dependent input/output files. Note that input/output mappings can also be gleaned from GATKSVPipelineBatch.wdl, and example input templates for each module can be found in /inputs/templates/test.
Formerly Module00a
Runs raw evidence collection on each sample with the following SV callers: Manta, Wham, and/or MELT. For guidance on pre-filtering prior to GatherSampleEvidence, refer to the Sample Exclusion section.
Note: a list of sample IDs must be provided. Refer to the sample ID requirements for specifications of allowable sample IDs. IDs that do not meet these requirements may cause errors.
- Per-sample BAM or CRAM files aligned to hg38. Index files (
.bai) must be provided if using BAMs.
- Caller VCFs (Manta, MELT, and/or Wham)
- Binned read counts file
- Split reads (SR) file
- Discordant read pairs (PE) file
Formerly Module00b
Runs ploidy estimation, dosage scoring, and optionally VCF QC. The results from this module can be used for QC and batching.
For large cohorts, this workflow can be run on arbitrary cohort partitions of up to about 500 samples. Afterwards, we recommend using the results to divide samples into smaller batches (~100-500 samples) with ~1:1 male:female ratio. Refer to the Batching section for further guidance on creating batches.
We also recommend using sex assignments generated from the ploidy estimates and incorporating them into the PED file, with sex = 0 for sex aneuploidies.
- Read count files (GatherSampleEvidence)
- (Optional) SV call VCFs (GatherSampleEvidence)
- Per-sample dosage scores with plots
- Median coverage per sample
- Ploidy estimates, sex assignments, with plots
- (Optional) Outlier samples detected by call counts
The purpose of sample filtering at this stage after EvidenceQC is to prevent very poor quality samples from interfering with the results for the rest of the callset. In general, samples that are borderline are okay to leave in, but you should choose filtering thresholds to suit the needs of your cohort and study. There will be future opportunities (as part of FilterBatch) for filtering before the joint genotyping stage if necessary. Here are a few of the basic QC checks that we recommend:
- Look at the X and Y ploidy plots, and check that sex assignments match your expectations. If there are discrepancies, check for sample swaps and update your PED file before proceeding.
- Look at the dosage score (WGD) distribution and check that it is centered around 0 (the distribution of WGD for PCR- samples is expected to be slightly lower than 0, and the distribution of WGD for PCR+ samples is expected to be slightly greater than 0. Refer to the gnomAD-SV paper for more information on WGD score). Optionally filter outliers.
- Look at the low outliers for each SV caller (samples with much lower than typical numbers of SV calls per contig for each caller). An empty low outlier file means there were no outliers below the median and no filtering is necessary. Check that no samples had zero calls.
- Look at the high outliers for each SV caller and optionally filter outliers; samples with many more SV calls than average may be poor quality.
- Remove samples with autosomal aneuploidies based on the per-batch binned coverage plots of each chromosome.
Trains a gCNV model for use in GatherBatchEvidence. The WDL can be found at /wdl/TrainGCNV.wdl. See the gCNV training overview for more information.
- GatherSampleEvidence
- (Recommended) EvidenceQC
- Read count files (GatherSampleEvidence)
- Contig ploidy model tarball
- gCNV model tarballs
Formerly Module00c
Runs CNV callers (cn.MOPS, GATK-gCNV) and combines single-sample raw evidence into a batch. See above for more information on batching.
- GatherSampleEvidence
- (Recommended) EvidenceQC
- gCNV training
- PED file (updated with EvidenceQC sex assignments, including sex = 0 for sex aneuploidies. Calls will not be made on sex chromosomes when sex = 0 in order to avoid generating many confusing calls or upsetting normalized copy numbers for the batch.)
- Read count, BAF, PE, SD, and SR files (GatherSampleEvidence)
- Caller VCFs (GatherSampleEvidence)
- Contig ploidy model and gCNV model files (gCNV training)
- Combined read count matrix, SR, PE, and BAF files
- Standardized call VCFs
- Depth-only (DEL/DUP) calls
- Per-sample median coverage estimates
- (Optional) Evidence QC plots
Formerly Module01
Clusters SV calls across a batch.
- Standardized call VCFs (GatherBatchEvidence)
- Depth-only (DEL/DUP) calls (GatherBatchEvidence)
- Clustered SV VCFs
- Clustered depth-only call VCF
Formerly Module02
Generates variant metrics for filtering.
- Combined read count matrix, SR, PE, and BAF files (GatherBatchEvidence)
- Per-sample median coverage estimates (GatherBatchEvidence)
- Clustered SV VCFs (ClusterBatch)
- Clustered depth-only call VCF (ClusterBatch)
- Metrics file
Formerly Module03
Filters poor quality variants and filters outlier samples. This workflow can be run all at once with the WDL at wdl/FilterBatch.wdl, or it can be run in two steps to enable tuning of outlier filtration cutoffs. The two subworkflows are:
- FilterBatchSites: Per-batch variant filtration. Visualize SV counts per sample per type to help choose an IQR cutoff for outlier filtering, and preview outlier samples for a given cutoff
- FilterBatchSamples: Per-batch outlier sample filtration; provide an appropriate
outlier_cutoff_nIQRbased on the SV count plots and outlier previews from step 1. Note that not removing high outliers can result in increased compute cost and a higher false positive rate in later steps.
- Batch PED file
- Metrics file (GenerateBatchMetrics)
- Clustered SV and depth-only call VCFs (ClusterBatch)
- Filtered SV (non-depth-only a.k.a. "PESR") VCF with outlier samples excluded
- Filtered depth-only call VCF with outlier samples excluded
- Random forest cutoffs file
- PED file with outlier samples excluded
Formerly MergeCohortVcfs
Combines filtered variants across batches. The WDL can be found at: /wdl/MergeBatchSites.wdl.
- List of filtered PESR VCFs (FilterBatch)
- List of filtered depth VCFs (FilterBatch)
- Combined cohort PESR and depth VCFs
Formerly Module04
Genotypes a batch of samples across unfiltered variants combined across all batches.
- Batch PESR and depth VCFs (FilterBatch)
- Cohort PESR and depth VCFs (MergeBatchSites)
- Batch read count, PE, and SR files (GatherBatchEvidence)
- Filtered SV (non-depth-only a.k.a. "PESR") VCF with outlier samples excluded
- Filtered depth-only call VCF with outlier samples excluded
- PED file with outlier samples excluded
- List of SR pass variants
- List of SR fail variants
- (Optional) Depth re-genotyping intervals list
Formerly Module04b
Re-genotypes probable mosaic variants across multiple batches.
- Per-sample median coverage estimates (GatherBatchEvidence)
- Pre-genotyping depth VCFs (FilterBatch)
- Batch PED files (FilterBatch)
- Cohort depth VCF (MergeBatchSites)
- Genotyped depth VCFs (GenotypeBatch)
- Genotyped depth RD cutoffs file (GenotypeBatch)
- Re-genotyped depth VCFs
Formerly Module0506
Combines variants across multiple batches, resolves complex variants, re-genotypes, and performs final VCF clean-up.
- GenotypeBatch
- (Optional) RegenotypeCNVs
- RD, PE and SR file URIs (GatherBatchEvidence)
- Batch filtered PED file URIs (FilterBatch)
- Genotyped PESR VCF URIs (GenotypeBatch)
- Genotyped depth VCF URIs (GenotypeBatch or RegenotypeCNVs)
- SR pass variant file URIs (GenotypeBatch)
- SR fail variant file URIs (GenotypeBatch)
- Genotyping cutoff file URIs (GenotypeBatch)
- Batch IDs
- Sample ID list URIs
- Finalized "cleaned" VCF and QC plots
Module 07 (in development)
Apply downstream filtering steps to the cleaned VCF to further control the false discovery rate; all steps are optional and users should decide based on the specific purpose of their projects.
Filtering methods include:
- minGQ - remove variants based on the genotype quality across populations. Note: Trio families are required to build the minGQ filtering model in this step. We provide tables pre-trained with the 1000 genomes samples at different FDR thresholds for projects that lack family structures, and they can be found at the paths below. These tables assume that GQ has a scale of [0,999], so they will not work with newer VCFs where GQ has a scale of [0,99].
gs://gatk-sv-resources-public/hg38/v0/sv-resources/ref-panel/1KG/v2/mingq/1KGP_2504_and_698_with_GIAB.10perc_fdr.PCRMINUS.minGQ.filter_lookup_table.txt
gs://gatk-sv-resources-public/hg38/v0/sv-resources/ref-panel/1KG/v2/mingq/1KGP_2504_and_698_with_GIAB.1perc_fdr.PCRMINUS.minGQ.filter_lookup_table.txt
gs://gatk-sv-resources-public/hg38/v0/sv-resources/ref-panel/1KG/v2/mingq/1KGP_2504_and_698_with_GIAB.5perc_fdr.PCRMINUS.minGQ.filter_lookup_table.txt
- BatchEffect - remove variants that show significant discrepancies in allele frequencies across batches
- FilterOutlierSamplesPostMinGQ - remove outlier samples with unusually high or low number of SVs
- FilterCleanupQualRecalibration - sanitize filter columns and recalibrate variant QUAL scores for easier interpretation
AnnotateVcf (in development)
Formerly Module08Annotation
Add annotations, such as the inferred function and allele frequencies of variants, to final VCF.
Annotations methods include:
- Functional annotation - The GATK tool SVAnnotate is used to annotate SVs with inferred functional consequence on protein-coding regions, regulatory regions such as UTR and promoters, and other non-coding elements.
- Allele Frequency annotation - annotate SVs with their allele frequencies across all samples, and samples of specific sex, as well as specific sub-populations.
- Allele Frequency annotation with external callset - annotate SVs with the allele frequencies of their overlapping SVs in another callset, eg. gnomad SV callset.
Module 09 (in development)
Visualize SVs with IGV screenshots and read depth plots.
Visualization methods include:
- RD Visualization - generate RD plots across all samples, ideal for visualizing large CNVs.
- IGV Visualization - generate IGV plots of each SV for individual sample, ideal for visualizing de novo small SVs.
- Module09.visualize.wdl - generate RD plots and IGV plots, and combine them for easy review.
This repository is maintained following the norms of
continuous integration (CI) and continuous delivery (CD).
GATK-SV CI/CD is developed as a set of Github Actions
workflows that are available under the .github/workflows
directory. Please refer to the workflow's README
for their current coverage and setup.
- Default pipeline settings are tuned for batches of 100 samples. Larger batches or cohorts may require additional VM resources. Most runtime attributes can be modified through the
RuntimeAttrinputs. These are formatted like this in the json:
"MyWorkflow.runtime_attr_override": {
"disk_gb": 100,
"mem_gb": 16
},
Note that a subset of the struct attributes can be specified. See wdl/Structs.wdl for available attributes.
Example error message from GatherSampleEvidence.MELT.GetWgsMetrics:
Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: The requested index 701766 is out of counter bounds. Possible cause of exception can be wrong READ_LENGTH parameter (much smaller than actual read length)
This error message was observed for a sample with an average read length of 117, but for which half the reads were of length 90 and half were of length 151. As a workaround, override the calculated read length by providing a read_length input of 151 (or the expected read length for the sample in question) to GatherSampleEvidence.
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent