{"id":705,"date":"2023-11-13T13:00:12","date_gmt":"2023-11-13T13:00:12","guid":{"rendered":"https:\/\/terrabioappdev.wpenginepowered.com\/neale-lab-uk-biobank-on-terra\/"},"modified":"2023-12-27T04:56:02","modified_gmt":"2023-12-27T04:56:02","slug":"neale-lab-uk-biobank-on-terra","status":"publish","type":"post","link":"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/","title":{"rendered":"Managing Access to UK Biobank Data on Terra"},"content":{"rendered":"

<\/h1>\n

Having access to good data is crucial for genomics research. Without large-scale datasets, there\u2019s little chance of uncovering the genetic underpinnings of disease. This is particularly important when studying diseases whose risk is determined by a large number of genes, each of which has a relatively small effect.\u00a0<\/span><\/p>\n

But analyzing and managing these large datasets can be challenging. This is particularly true when the data are protected, so that only approved researchers can access it. Because of these challenges, many good scientific stories happen alongside equally-interesting stories about data management.\u00a0<\/span><\/p>\n

In one such story, Terra\u2019s data management tools allowed researchers to access data from the <\/span>UK Biobank<\/span><\/a>. In turn, this access has fueled many innovative projects that were only possible with large-scale data.\u00a0\u00a0<\/span><\/p>\n

Getting the data onto the Cloud<\/span><\/h2>\n

The UK Biobank amasses genotypic and phenotypic data from roughly half a million participants in the United Kingdom. Research groups interested in working with the data can apply for access to this data set. In 2017, a group of Broadies across different research interests \u2014 including Krishna Aragam, Andrea Ganna, and Mary Hross \u2014 understood that having a single dataset available on the Cloud (and on the Broad Cluster) would allow more researchers to study the keys to disease, and simultaneously reduce storage costs. As a result, Ben Neale\u2019s lab sponsored a project to undertake this work. The project\u2019s storage is funded by Broad ITS and managed by Sam Bryant, who was a Senior Data Management Specialist at the time. Bryant has since become the Associate Director of Data Management at the Broad\u2019s Stanley Center for Psychiatric Research.\u00a0<\/span><\/p>\n

Working with such large data was no easy task. To start, it took a long time to obtain the files \u2014 at the time, the UK Biobank limited downloads to 10 concurrent files. So, Sam Bryant got approval to access genotype and phenotype data from roughly half a million participants, then spent about two weeks downloading it onto the Broad\u2019s on-premises cluster. From there, he uploaded the data to a Terra workspace in the Cloud.<\/span><\/p>\n

Managing access to the data<\/span><\/h2>\n

With these data in hand, Bryant faced a second challenge: managing who could use the data. The UK Biobank uses a careful approval process to protect their data. So now Bryant needed a way to ensure that only approved users could access the Terra dataset.\u00a0<\/span><\/p>\n

The solution was to create a Terra Group of approved researchers. Researchers who wanted to access the data \u2014 including the Neale lab\u2019s collaborators \u2014 applied for approval from the UK Biobank, which then let Bryant know who he could add to the Terra group. Once added to the group, collaborators could access the data \u2014 from inside or outside of Terra \u2014 in order to analyze it.\u00a0<\/span><\/p>\n

An alternative method: using DUOS to manage controlled data on Terra<\/span><\/h4>\n

In many cases, Bryant\u2019s method is still the best way to share controlled-access data with collaborators. However, it works best when data managers are sharing their data with known collaborators. DUOS offers an alternative to share controlled-access data from the Broad and the National Human Genome Research Institute (NHGRI). DUOS speeds the data-access application process by automatically updating access permissions whenever someone is approved. This system makes it easy to share data with unknown researchers, as well as collaborators. You can learn more about how DUOS makes it easier to access controlled-access data in <\/span>Streamlining Data Access<\/span><\/a> and on <\/span>DUOS\u2019 documentation<\/span><\/a>.\u00a0<\/span><\/p>\n

The data\u2019s scientific impact<\/span><\/h2>\n

Since 2017, research groups have accessed the UK Biobank dataset on Terra to answer questions about several aspects of human health. These include coronary artery disease (<\/span>Fahed et al., 2022<\/span><\/a>; <\/span>Patel et al., 2022<\/span><\/a>; <\/span>Patel et al., 2023<\/span><\/a>; <\/span>Dron et al., 2023<\/span><\/a>; <\/span>Khera et al., 2022<\/span><\/a>); Alzheimer\u2019s (<\/span>Paranjpe et al., 2022<\/span><\/a>); obesity (<\/span>Agrawal et al., 2022<\/span><\/a>); liver disease (<\/span>Haas et al., 2021<\/span><\/a>); heteroplasmy (<\/span>Gupta et al., 2023<\/span><\/a>); and clonal hematopoiesis (<\/span>Brown et al., 2023<\/span><\/a>). These data have also supported a growing understanding of how the human genome and phenome are structured \u2013 for example, uncovering correlations within the human phenome (<\/span>Carey et al., 2022<\/span><\/a>). In addition, the UK Biobank dataset has helped researchers better understand the effects of a dataset\u2019s size and diversity on machine learning models (<\/span>Cui et al., 2023<\/span><\/a>; <\/span>Majara et al., 2023<\/span><\/a>).<\/span><\/p>\n

How can you access this data?<\/span><\/h2>\n

The Broad\u2019s UK Biobank dataset is still available on Terra. This dataset is a subset of the full UK Biobank data \u2014 the remainder is accessible via DNANexus.\u00a0<\/span><\/p>\n

If you\u2019d like to leverage this dataset for your own research, and you\u2019ve already applied for access to the UK Biobank, follow the <\/span>instructions in this document<\/span><\/a>. If you have not yet applied for access to the UK Biobank, contact Sam Bryant directly at <\/span>sbryant@broadinstitute.org<\/span><\/a>. And to learn more about sharing controlled data on Terra, see <\/span>Best practices for sharing and protecting data resources<\/span><\/a> and <\/span>Managing access to shared data and tools with groups<\/span><\/a>.<\/span><\/p>\n

Many thanks to Sam Bryant, Caroline Cusick, and Jonathan Lawson for their help preparing this post.<\/span><\/i><\/p>\n","protected":false},"excerpt":{"rendered":"

Having access to good data is crucial for genomics research. Without large-scale datasets, there\u2019s little chance of uncovering the genetic underpinnings of disease. This is particularly important when studying diseases whose risk is determined by a large number of genes, each of which has a relatively small effect.\u00a0 But analyzing and managing these large datasets […]<\/p>\n","protected":false},"author":58,"featured_media":706,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[119],"tags":[197,196,207],"class_list":["post-705","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-most-recent","tag-controlled-access","tag-terra","tag-uk-biobank"],"acf":[],"yoast_head":"\nManaging Access to UK Biobank Data on Terra - Terra<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Managing Access to UK Biobank Data on Terra - Terra\" \/>\n<meta property=\"og:description\" content=\"Having access to good data is crucial for genomics research. Without large-scale datasets, there\u2019s little chance of uncovering the genetic underpinnings of disease. This is particularly important when studying diseases whose risk is determined by a large number of genes, each of which has a relatively small effect.\u00a0 But analyzing and managing these large datasets […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/\" \/>\n<meta property=\"og:site_name\" content=\"Terra\" \/>\n<meta property=\"article:published_time\" content=\"2023-11-13T13:00:12+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-12-27T04:56:02+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/UKBiobankblog-pic1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"936\" \/>\n\t<meta property=\"og:image:height\" content=\"492\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Leyla Tarhan\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Leyla Tarhan\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/\"},\"author\":{\"name\":\"Leyla Tarhan\",\"@id\":\"https:\/\/terra.bio\/#\/schema\/person\/8fa81a720f36a99643e444ca82d1af7a\"},\"headline\":\"Managing Access to UK Biobank Data on Terra\",\"datePublished\":\"2023-11-13T13:00:12+00:00\",\"dateModified\":\"2023-12-27T04:56:02+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/\"},\"wordCount\":834,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/terra.bio\/#organization\"},\"image\":{\"@id\":\"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/UKBiobankblog-pic1.jpg\",\"keywords\":[\"Controlled-Access\",\"Terra\",\"UK Biobank\"],\"articleSection\":[\"Most Recent\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/\",\"url\":\"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/\",\"name\":\"Managing Access to UK Biobank Data on Terra - Terra\",\"isPartOf\":{\"@id\":\"https:\/\/terra.bio\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/UKBiobankblog-pic1.jpg\",\"datePublished\":\"2023-11-13T13:00:12+00:00\",\"dateModified\":\"2023-12-27T04:56:02+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/#primaryimage\",\"url\":\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/UKBiobankblog-pic1.jpg\",\"contentUrl\":\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/UKBiobankblog-pic1.jpg\",\"width\":936,\"height\":492,\"caption\":\"UKBiobankblog pic1\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/terra.bio\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Managing Access to UK Biobank Data on Terra\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/terra.bio\/#website\",\"url\":\"https:\/\/terra.bio\/\",\"name\":\"Terra\",\"description\":\"Science at Scale\",\"publisher\":{\"@id\":\"https:\/\/terra.bio\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/terra.bio\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/terra.bio\/#organization\",\"name\":\"Terra\",\"url\":\"https:\/\/terra.bio\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/terra.bio\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Terra-Bio-App@2x.webp\",\"contentUrl\":\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Terra-Bio-App@2x.webp\",\"width\":287,\"height\":318,\"caption\":\"Terra\"},\"image\":{\"@id\":\"https:\/\/terra.bio\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/terra.bio\/#\/schema\/person\/8fa81a720f36a99643e444ca82d1af7a\",\"name\":\"Leyla Tarhan\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/terra.bio\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/78bcbd8997e8579ee5af417a7887c835beffec45ab89760e362507fd6139ac52?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/78bcbd8997e8579ee5af417a7887c835beffec45ab89760e362507fd6139ac52?s=96&d=mm&r=g\",\"caption\":\"Leyla Tarhan\"},\"url\":\"https:\/\/terra.bio\/author\/ltarhan\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Managing Access to UK Biobank Data on Terra - Terra","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/","og_locale":"en_US","og_type":"article","og_title":"Managing Access to UK Biobank Data on Terra - Terra","og_description":"Having access to good data is crucial for genomics research. Without large-scale datasets, there\u2019s little chance of uncovering the genetic underpinnings of disease. This is particularly important when studying diseases whose risk is determined by a large number of genes, each of which has a relatively small effect.\u00a0 But analyzing and managing these large datasets […]","og_url":"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/","og_site_name":"Terra","article_published_time":"2023-11-13T13:00:12+00:00","article_modified_time":"2023-12-27T04:56:02+00:00","og_image":[{"width":936,"height":492,"url":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/UKBiobankblog-pic1.jpg","type":"image\/jpeg"}],"author":"Leyla Tarhan","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Leyla Tarhan","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/#article","isPartOf":{"@id":"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/"},"author":{"name":"Leyla Tarhan","@id":"https:\/\/terra.bio\/#\/schema\/person\/8fa81a720f36a99643e444ca82d1af7a"},"headline":"Managing Access to UK Biobank Data on Terra","datePublished":"2023-11-13T13:00:12+00:00","dateModified":"2023-12-27T04:56:02+00:00","mainEntityOfPage":{"@id":"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/"},"wordCount":834,"commentCount":0,"publisher":{"@id":"https:\/\/terra.bio\/#organization"},"image":{"@id":"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/#primaryimage"},"thumbnailUrl":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/UKBiobankblog-pic1.jpg","keywords":["Controlled-Access","Terra","UK Biobank"],"articleSection":["Most Recent"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/","url":"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/","name":"Managing Access to UK Biobank Data on Terra - Terra","isPartOf":{"@id":"https:\/\/terra.bio\/#website"},"primaryImageOfPage":{"@id":"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/#primaryimage"},"image":{"@id":"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/#primaryimage"},"thumbnailUrl":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/UKBiobankblog-pic1.jpg","datePublished":"2023-11-13T13:00:12+00:00","dateModified":"2023-12-27T04:56:02+00:00","breadcrumb":{"@id":"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/#primaryimage","url":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/UKBiobankblog-pic1.jpg","contentUrl":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/UKBiobankblog-pic1.jpg","width":936,"height":492,"caption":"UKBiobankblog pic1"},{"@type":"BreadcrumbList","@id":"https:\/\/terra.bio\/neale-lab-uk-biobank-on-terra\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/terra.bio\/"},{"@type":"ListItem","position":2,"name":"Managing Access to UK Biobank Data on Terra"}]},{"@type":"WebSite","@id":"https:\/\/terra.bio\/#website","url":"https:\/\/terra.bio\/","name":"Terra","description":"Science at Scale","publisher":{"@id":"https:\/\/terra.bio\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/terra.bio\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/terra.bio\/#organization","name":"Terra","url":"https:\/\/terra.bio\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/terra.bio\/#\/schema\/logo\/image\/","url":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Terra-Bio-App@2x.webp","contentUrl":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Terra-Bio-App@2x.webp","width":287,"height":318,"caption":"Terra"},"image":{"@id":"https:\/\/terra.bio\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/terra.bio\/#\/schema\/person\/8fa81a720f36a99643e444ca82d1af7a","name":"Leyla Tarhan","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/terra.bio\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/78bcbd8997e8579ee5af417a7887c835beffec45ab89760e362507fd6139ac52?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/78bcbd8997e8579ee5af417a7887c835beffec45ab89760e362507fd6139ac52?s=96&d=mm&r=g","caption":"Leyla Tarhan"},"url":"https:\/\/terra.bio\/author\/ltarhan\/"}]}},"_links":{"self":[{"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/posts\/705","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/users\/58"}],"replies":[{"embeddable":true,"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/comments?post=705"}],"version-history":[{"count":0,"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/posts\/705\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/media\/706"}],"wp:attachment":[{"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/media?parent=705"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/categories?post=705"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/tags?post=705"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}