The redlat_qc.rmd pipeline is designed to be run as an R markdown file in RStudio. This way you can run it in a step-by-step mode and generate a rendered quality control report.
Download the redlat_qc.rmd file to your local RStudio and modify steps 1. Set up your environment and 2. Customize the quality control process to fit your quality control goals. The rest of the code does not require modifications. (More information below)
You could also edit redlat_qc.rmd and run it directly from the r command line if you already have the sample_data.txt and the problematic_relatedness.txt files in your workspace.
library(rmarkdown)
render("path/to/your/file.Rmd")
The Exome folder has a full rendered markdown report as an example.
For this Quality control pipeline you will need the following:
A plink formatted file.bed, file.fam, file.bim set, or a bgzipped file.vcf.gz file.
Always Take a look at your files before beginning:
If you start with a plink dataset:
- Do the Individual IDs (column 2 in file.fam) match what you were expecting?
- Have the families been given a Family ID (column 1 in file.fam)?
- Do the Individuals have their sex assigned (column 5 in file.fam?
- Do the variants in the .bim have an identifier (column 2 in file.bim)? Some analyses will require this information, and we may have to incorporate it to the file.fam/file.bim if its not already there.
⚠️ Make sure your files are properly aligned and the alleles are being called from the correct strand. INDELs should be left aligned and normalized.
If you are starting with a *file.vcf, or your *file.fam does not have the sex/family of the samples already specified please provide an additional file sample_data.txt that includes all the individuals in your data and has the following header:
IID ID of the sample as it is in the plink IID or in the VCF
SEX should be specified (1=male, 2=female, 0=no data)
FID Family ID of the sample
PID Paternal ID of the sample. If this individual is also in the dataset, the PID should be identical to the father's IID
MID Maternal ID of the sample. If this individual is also in the dataset, the MID should be identical to the mother's IID
PHENO Optional, if you are interested in any downstream analyses involving the phenotype. (1=control, 2=case, -9=missing)
A trio would look like this (order of the columns does not matter)
| FID | IID | PID | MID | SEX | PHENO |
|---|---|---|---|---|---|
| FID1 | SON | DAD | MOM | 1 | 2 |
| FID1 | MOM | 0 | 0 | 2 | 1 |
| FID1 | DAD | 0 | 0 | 1 | 1 |
R is expecting a tab delimited file. If your file is delimited by spaces you can fix it with the following bash command
sed -i 's/ /\t/g' sample_data.txt
If you are working with Exome or Genome data, you will also need:
-vcftools
-bcftools
- Set up your environment
- Install required packages
- Set your working directory
- Set up path to software
- Give the name of your starting file
- Define the type of data you will be working with. ('GENOME', 'EXOME', 'ARRAY')
- Specify your reference genome ('hg19', 'hg38')
- Import sample data (if provided)
- Customize the quality control process
- Do you want to do filter variant calls for genotype depth (DP) and Genotype Quality (GQ)?
- Do you want to keep only the variants with PASS in the VQSR filtering?
- Do you want to check for known and cryptic relatedness among samples?
- Do you want to create directories and to organize your data as you go?
- Start Quality Control process
- Generate and plot basic statistics:
- I. General statistics .vchk
- II. Sample based metrics metrics -- missingness per sample (.imiss) -- depth per sample (.idepth)
- III. Site based metrics* -- Missingness per site (.lmiss) -- Mean depth per site (.ldepth.mean) --- VQSR quality vqsr
- Genotype Quality control (Only for Exome and Genome data)
- Filter your genotypes according to genotype depth (DP) and genotype quality (GQ)
- Filter your sites according to their Variant Quality Score Recalibration ranks
- Genotypes with DP and GQ below desired thresholds are turned missing values
- Filter for missingness
- Identify samples and variants (sites) missing more than 10% of data and remove them. The 10% or 0.1 threshold can be modified as desired.
- Samples and variants with missingness over the desired threshold will be removed
- Calculate heterozygosity
- Use plink to calculate sample heterozygosity and then exclude individuals that are beyoond 3 Standard deviations from the cohort mean.
- Heterozygosity outliers will be removed
- Check sex
- Use plink to determine chromosomal sex according to X and Y chromosomes
- Individuals with discrepancy between genetic and disclosed sex will be removed
- Identify duplicates
- Use King to detect duplicate samples
- Duplicate samples are removed
- Calculate relatedness(optional)
- Use King to identify samples that are up tho 4th degree of relatedness
⚠️ You have to manually check if King's inference match your previous kinship knowledge.- Samples with cryptic relatedness are removed
- Remove variants & Individuals and with missingness ≥5%
- Do a final removal of samples and variants with high missigness.
- Samples and variants with missingness over the desired threshold will be removed
All of these steps are extensively described in redlat_qc.rmd
- 0.1
- Initial Release
This pipeline integrated multiple workflows for quality control. Some of our resources were:
-
Broad Institute gnomAD
-
Anderson, C. A., Pettersson, F. H., Clarke, G. M., Cardon, L. R., Morris, A. P., & Zondervan, K. T. (2010). Data quality control in genetic case-control association studies. Nature protocols, 5(9), 1564-1573.
-
Panoutsopoulou, K., & Walter, K. (2018). Quality control of common and rare variants. Chapter in: Genetic Epidemiology: Methods and Protocols, Methods in Molecular Biology, vol. 1793, Springer Science Business Media, LLC, part of Springer Nature 2018