SEATTLE – The complete 1000 Genomes Project is now available on Amazon Web Services as a publicly available data set, the largest collection of human genetics available to researchers worldwide, free of charge.
Amazon Web Services and the National Institutes of Health (NIH) announced the availability at the end of March at the White House Big Data Summit (See P. 30).
The initiative is an international one, coordinated by a consortium of 75 companies and organizations to establish the most detailed catalogue of human genetic variation. The project has grown to 200 terabytes of genomic data including DNA sequenced from more than 1,700 individuals that researchers can now access on AWS for use in disease research.
The 1000 Genomes Project aims to include the genomes of more than 2,600 individuals from 26 populations around the world, and the NIH will continue to add the remaining genome samples to the public data set this year.
The National Institutes of Health, part of the Department of Health and Human Services, serves as one of the data coordinators for the 1000 Genomes Project.
“Previously, researchers wanting access to public data sets such as the 1000 Genomes Project had to download them from government data centers to their own systems, or have the data physically shipped to them on discs. This process took a long time, and that’s assuming a lab had the bandwidth to download the data and sufficient storage and compute infrastructure to hold and analyze the data once they had it,” said Lisa D. Brooks, program director for the Genetic Variation Program, National Human Genome Research Institute, a part of NIH. “We are happy that the 1000 Genomes Project data are on AWS to give researchers anywhere in the world a simple way to access the data so they can put the data to work in their research.”
“Putting the data in the AWS cloud provides a tremendous opportunity for researchers around the world who want to study large-scale human genetic variation but lack the computer capability to do so,” said Richard Durbin, co-director of the 1000 Genomes Project and joint head of human genetics at the Wellcome Trust Sanger Institute, Hinxton, England.
Public Data Sets on AWS provide a centralized repository of public data stored in Amazon Simple Storage Service (Amazon S3) and Amazon Elastic Block Store (Amazon EBS). The data can then be directly accessed from AWS services such as Amazon Elastic Compute Cloud (Amazon EC2) and Amazon Elastic MapReduce (Amazon EMR), eliminating the need for organizations to move the data in-house and then procure enough technology infrastructure to analyze the data effectively.
AWS’s highly scalable compute resources are being used to power big data and high performance computing applications such as those found in science and research.