{"id":206,"date":"2020-08-25T12:50:15","date_gmt":"2020-08-25T12:50:15","guid":{"rendered":"https:\/\/terrabioappdev.wpenginepowered.com\/coming-soon-faster-cheaper-workflows\/"},"modified":"2023-12-27T04:54:10","modified_gmt":"2023-12-27T04:54:10","slug":"coming-soon-faster-cheaper-workflows","status":"publish","type":"post","link":"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/","title":{"rendered":"Coming Soon &#8211; Faster, cheaper workflows"},"content":{"rendered":"<p>Whether you\u2019re processing ten data files or ten thousand, making your workflows run faster and cost less is always a goal. The Terra Workflow (aka \u201cBatch\u201d) team has been working on some cost and performance improvements. These aren\u2019t available quite yet, but we wanted to give you a preview of two of the improvements that are in progress:<\/p>\n<h3>Less wait time to load Broad&#8217;s public genome references<\/h3>\n<p>One performance improvement that\u2019s almost ready will speed things up if your workflow uses one of the <a href=\"https:\/\/console.cloud.google.com\/storage\/browser\/gcp-public-data--broad-references;tab=objects?prefix=&amp;forceOnObjectsSortingFiltering=false\" target=\"_blank\" rel=\"noopener\">Broad Institute&#8217;s public genome reference data<\/a>. Until now, having to copy gigabytes of references to the virtual machine meant waiting a few minutes before a task started. To reduce the wait time, we\u2019re adding a reference disk that is automatically mounted when using one or more of the Broad references (<em>gs:\/\/gcp-public-data&#8211;broad-references\/<\/em>) in a workflow. Since most references are quite large, it\u2019s usually much faster to reference the file via an attached disk than to copy it onto the drive. Best of all, you don\u2019t need to change anything to take advantage of this improvement.<\/p>\n<h3>Run workflows optimized with Google Pipelines API V1 on Terra<\/h3>\n<p>Using pipelines developed or optimized with Google Pipelines API V1? You\u2019ll soon be able to use these pipelines in Terra. With Google Pipelines API V1, there were fewer machine options available, and some pipelines were developed and optimized with this in mind. A new option is in the works that will allow you to leverage Google Pipelines API V1 machine optimization within V2 &#8211; Terra\u2019s current version.<\/p>\n<h3>Other improvements<\/h3>\n<p>Along with the aforementioned items, the team is also looking at Docker image caching. We hope you enjoyed this sneak peek of what\u2019s coming next for workflows. Look for more on these improvements in future updates.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Whether you\u2019re processing ten data files or ten thousand, making your workflows run faster and cost less is always a goal. The Terra Workflow (aka \u201cBatch\u201d) team has been working on some cost and performance improvements. These aren\u2019t available quite yet, but we wanted to give you a preview of two of the [&#8230;]<\/p>\n","protected":false},"author":7,"featured_media":207,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[55,32],"tags":[56,57],"class_list":["post-206","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-cost-control","category-workflows","tag-optimizations","tag-speed"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.0 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Coming Soon - Faster, cheaper workflows - Terra<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Coming Soon - Faster, cheaper workflows - Terra\" \/>\n<meta property=\"og:description\" content=\"Whether you\u2019re processing ten data files or ten thousand, making your workflows run faster and cost less is always a goal. The Terra Workflow (aka \u201cBatch\u201d) team has been working on some cost and performance improvements. These aren\u2019t available quite yet, but we wanted to give you a preview of two of the [...]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/\" \/>\n<meta property=\"og:site_name\" content=\"Terra\" \/>\n<meta property=\"article:published_time\" content=\"2020-08-25T12:50:15+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-12-27T04:54:10+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Coral_reef.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"627\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Kyle Vernest\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Kyle Vernest\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/\"},\"author\":{\"name\":\"Kyle Vernest\",\"@id\":\"https:\/\/terra.bio\/#\/schema\/person\/f9107f1ce8c3d544c61f1bbd0a22081c\"},\"headline\":\"Coming Soon &#8211; Faster, cheaper workflows\",\"datePublished\":\"2020-08-25T12:50:15+00:00\",\"dateModified\":\"2023-12-27T04:54:10+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/\"},\"wordCount\":311,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/terra.bio\/#organization\"},\"image\":{\"@id\":\"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Coral_reef.png\",\"keywords\":[\"optimizations\",\"speed\"],\"articleSection\":[\"Cost Control\",\"Workflows\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/\",\"url\":\"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/\",\"name\":\"Coming Soon - Faster, cheaper workflows - Terra\",\"isPartOf\":{\"@id\":\"https:\/\/terra.bio\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Coral_reef.png\",\"datePublished\":\"2020-08-25T12:50:15+00:00\",\"dateModified\":\"2023-12-27T04:54:10+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/#primaryimage\",\"url\":\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Coral_reef.png\",\"contentUrl\":\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Coral_reef.png\",\"width\":1200,\"height\":627,\"caption\":\"Coral_reef\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/terra.bio\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Coming Soon &#8211; Faster, cheaper workflows\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/terra.bio\/#website\",\"url\":\"https:\/\/terra.bio\/\",\"name\":\"Terra\",\"description\":\"Science at Scale\",\"publisher\":{\"@id\":\"https:\/\/terra.bio\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/terra.bio\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/terra.bio\/#organization\",\"name\":\"Terra\",\"url\":\"https:\/\/terra.bio\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/terra.bio\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Terra-Bio-App@2x.webp\",\"contentUrl\":\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Terra-Bio-App@2x.webp\",\"width\":287,\"height\":318,\"caption\":\"Terra\"},\"image\":{\"@id\":\"https:\/\/terra.bio\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/terra.bio\/#\/schema\/person\/f9107f1ce8c3d544c61f1bbd0a22081c\",\"name\":\"Kyle Vernest\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/terra.bio\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/6f02e1252581e9e225f2c1bfe6232b192af997438cfc67a13339f2179ed11eef?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/6f02e1252581e9e225f2c1bfe6232b192af997438cfc67a13339f2179ed11eef?s=96&d=mm&r=g\",\"caption\":\"Kyle Vernest\"},\"url\":\"https:\/\/terra.bio\/author\/kvernest\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Coming Soon - Faster, cheaper workflows - Terra","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/","og_locale":"en_US","og_type":"article","og_title":"Coming Soon - Faster, cheaper workflows - Terra","og_description":"Whether you\u2019re processing ten data files or ten thousand, making your workflows run faster and cost less is always a goal. The Terra Workflow (aka \u201cBatch\u201d) team has been working on some cost and performance improvements. These aren\u2019t available quite yet, but we wanted to give you a preview of two of the [...]","og_url":"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/","og_site_name":"Terra","article_published_time":"2020-08-25T12:50:15+00:00","article_modified_time":"2023-12-27T04:54:10+00:00","og_image":[{"width":1200,"height":627,"url":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Coral_reef.png","type":"image\/png"}],"author":"Kyle Vernest","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Kyle Vernest","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/#article","isPartOf":{"@id":"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/"},"author":{"name":"Kyle Vernest","@id":"https:\/\/terra.bio\/#\/schema\/person\/f9107f1ce8c3d544c61f1bbd0a22081c"},"headline":"Coming Soon &#8211; Faster, cheaper workflows","datePublished":"2020-08-25T12:50:15+00:00","dateModified":"2023-12-27T04:54:10+00:00","mainEntityOfPage":{"@id":"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/"},"wordCount":311,"commentCount":0,"publisher":{"@id":"https:\/\/terra.bio\/#organization"},"image":{"@id":"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/#primaryimage"},"thumbnailUrl":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Coral_reef.png","keywords":["optimizations","speed"],"articleSection":["Cost Control","Workflows"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/","url":"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/","name":"Coming Soon - Faster, cheaper workflows - Terra","isPartOf":{"@id":"https:\/\/terra.bio\/#website"},"primaryImageOfPage":{"@id":"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/#primaryimage"},"image":{"@id":"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/#primaryimage"},"thumbnailUrl":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Coral_reef.png","datePublished":"2020-08-25T12:50:15+00:00","dateModified":"2023-12-27T04:54:10+00:00","breadcrumb":{"@id":"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/#primaryimage","url":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Coral_reef.png","contentUrl":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Coral_reef.png","width":1200,"height":627,"caption":"Coral_reef"},{"@type":"BreadcrumbList","@id":"https:\/\/terra.bio\/coming-soon-faster-cheaper-workflows\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/terra.bio\/"},{"@type":"ListItem","position":2,"name":"Coming Soon &#8211; Faster, cheaper workflows"}]},{"@type":"WebSite","@id":"https:\/\/terra.bio\/#website","url":"https:\/\/terra.bio\/","name":"Terra","description":"Science at Scale","publisher":{"@id":"https:\/\/terra.bio\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/terra.bio\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/terra.bio\/#organization","name":"Terra","url":"https:\/\/terra.bio\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/terra.bio\/#\/schema\/logo\/image\/","url":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Terra-Bio-App@2x.webp","contentUrl":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Terra-Bio-App@2x.webp","width":287,"height":318,"caption":"Terra"},"image":{"@id":"https:\/\/terra.bio\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/terra.bio\/#\/schema\/person\/f9107f1ce8c3d544c61f1bbd0a22081c","name":"Kyle Vernest","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/terra.bio\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/6f02e1252581e9e225f2c1bfe6232b192af997438cfc67a13339f2179ed11eef?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/6f02e1252581e9e225f2c1bfe6232b192af997438cfc67a13339f2179ed11eef?s=96&d=mm&r=g","caption":"Kyle Vernest"},"url":"https:\/\/terra.bio\/author\/kvernest\/"}]}},"_links":{"self":[{"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/posts\/206","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/comments?post=206"}],"version-history":[{"count":0,"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/posts\/206\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/media\/207"}],"wp:attachment":[{"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/media?parent=206"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/categories?post=206"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/tags?post=206"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}