= Recommended BIOS datasets for downstream analysis = = Freeze I = == RNAseq data == === Data available === Raw RNA seq data is avalable at the grid, see [wiki:BIOS_RnaSeq RNASeq data]. This data has been aligned using the pipeline described at [wiki:BIOS_Pipeline RNAseq alignment and quantification pipeline], the exon, transcript and gene level count output is described in the following. Count data is available from the so called 'Freeze1': These are the 2116 samples from Groningen (N=626), Leiden (N=654), Rotterdam (N=652) and Maastricht (N=184) that passed QC. This is around half of the BIOS RNA seq data that is used for the first papers: the other half has been measured but is still in the process of aligning and QC. Both raw and TMM normalized data are available. TMM normalization corrects for the different library sizes across subjects, see attached script for R code or the R package edgeR, and http://genomebiology.com/2010/11/3/r25. === Location on VM === * exon counts raw: /virdir/Backup/RP3_data/RNASeq/run_01/exoncounts/exon_count_freeze1_R_object.RData [[BR]] * exon counts TMM normalized: /virdir/Backup/RP3_data/RNASeq/run_01/exoncounts/exon_count_freeze1_TMM_normalized_R_object.RData [[BR]] * transcript counts raw: /virdir/Backup/RP3_data/RNASeq/run_01/transcriptcounts/transcript_count_freeze1_R_object.RData [[BR]] * transcript counts TMM normalized: /virdir/Backup/RP3_data/RNASeq/run_01/transcriptcounts/transcript_count_freeze1_TMM_normalized_R_object.RData [[BR]] * gene counts raw: /virdir/Backup/RP3_data/RNASeq/run_01/genecounts/gene_count_freeze1_R_object.RData [[BR]] * gene counts TMM normalized: /virdir/Backup/RP3_data/RNASeq/run_01/genecounts/gene_count_freeze1_TMM_normalized_R_object.RData [[BR]] === How to use the data === Data is stored in R objects, by loading the files in R (e.g. type load('/virdir/Backup/RP3_data/RNASeq/run_01/exoncounts/exon_count_freeze1_R_object.RData') in R) there will be a matrix called RNA in your workspace for the raw data, and RNAs for the TMM normalized data. The row names of these matrices (type rownames(RNAs)) contain gene, exon or transcript IDs, the column names (colnames(RNAs) are the subject BIOS IDs (called uuid in other files). We used ensembl v.71 for annotation, see [wiki:BIOS_ReferenceFiles Reference and annotation]. If you want to export the data to a tab delimited text file, use write.table(RNAs, file='yourfile.txt', quote =FALSE, col.names=TRUE, row.names=TRUE, sep='\t').[[BR]] == DNA methylation data == === Data available === Prepared data files are available on the VM. Follow [http://bios-vm.bbmrirp3-lumc.surf-hosted.nl/BIOSRutils/README.html#prepared-datasets this link] for instructions on how to use them. === Location on VM === The idat-files are located on: /virdir/Scratch/RP3_data/IlluminaHumanMethylation450k/450k separated by biobank: /virdir/Scratch/RP3_data/IlluminaHumanMethylation450k/450k/CODAM, /virdir/Scratch/RP3_data/IlluminaHumanMethylation450k/450k/LL and all folders contain the samplesheets provided by the data generation center including a unique and universal BIOS identifier (uuid in phenotype files). === How to use the data === The Bioconductor/R packages minfi and illuminaio provide reading capabilities for the idat-files. Annotation of methylation sites: see [wiki:BIOS_ReferenceFiles Reference and annotation] and at the VM: /virdir/Scratch/RP3_data/reference/Illumina450K_Annotation.txt == Genotype data == === Data available === All genotype data that has been imputed(GoNL version 5) and stored on the SRM is also available from the VM. Beware the imputed files contain indels as well and the Biobank person_id is used in the sample-files. Genotype data has also been imputed using the Human Reference Consortium (HRC) reference panel and is available from both the SRM and the VM. The same warnings apply for this set. === Location on VM === Gzipped IMPUTE2 files are stored at /virdir/Backup/RP3_data/GWAS_ImputationGoNLv5 per biobank. HRC imputed data is contained in per-chromosome Variant Call Format (VCF) files at /virdir/Backup/RP3_data/HRC_Imputation/[Biobank]/results/unzipped/.. === How to use the data === Once unzipped IMPUTE2 files can easily be read as these are tab-separated files (see [https://mathgen.stats.ox.ac.uk/impute/impute_v2.html]). Note that the HRC imputed data is in VCF format, which you may need to convert before usage. == Phenotype data == === Data available === BIOS phenotype data is stored in a meta database, see [wiki:BIOS_Metadatabase this page]. This databases can be accessed by so called views, using e.g. R. Three views were extracted (January 2015) and stored at the VM: [[BR]] * phenotype data: view="allPhenotypes" design="phenotypes"[[BR]] * RNA seq sample sheets: view="rnaseq", design="samplesheets" [[BR]] * IDs: view="getIds", design="identifiers" [[BR]] These files are available in .RData and .csv file formats. See for a complete overview of available phenotypes, and column name explanations the page [wiki:BIOS_Phenotype Phenotype data]. Phenotype data is not complete yet: we are currently contacting the biobanks to complete their files. Available phenotypes include: || Blood sampling metdata || || DNA quality metrics || || RNA quality metrics || || Sample metadata || || Smoking status || || Lipids || || Cholesterol || || Triglycerides || || CRP levels || || Cellcounts || === Location on VM === * Phenotypes: /virdir/Backup/RP3_data/Phenotypes/BIOS_Phenotypes.RData (matrix P) and /virdir/Backup/RP3_data/Phenotypes/BIOS_Phenotypes.csv [[BR]] * RNA-seq sample sheets: /virdir/Backup/RP3_data/Phenotypes/rna_seq_sample_sheets.RData (matrix S) and /virdir/Backup/RP3_data/Phenotypes/rna_seq_sample_sheets.csv [[BR]] * IDs: /virdir/Backup/RP3_data/Phenotypes/BIOS_IDs.RData (matrix F) and /virdir/Backup/RP3_data/Phenotypes/BIOS_IDs.csv [[BR]] === How to use the data === Link the files to the RNA-seq, genotype or methylation data by mapping the corresponding IDs. = Freeze II = === Data available === === Location on VM === === How to use the data ===