We’re answering those questions by introducing the Public Terra Roadmap—a tool to provide visibility into what we’re planning, invite feedback on new features, and foster a collaborative development process.

Why a Public Roadmap?

We believe that the development of Terra is best guided by the needs of its users. With the launch of the public roadmap, we aim to:

1. Provide clarity and visibility into development plans
   In this roadmap, we offer a view of what’s coming to Terra. You’ll be able to follow features and functionality across four stages of active development:
   
   • Near Term: What the team has planned or is actively working on
   • Preview: New features that you can opt into and test early to provide feedback 
   • Launching: Production-ready, newly released features for all users
   • Released: A historical view of what has been delivered
     
     
2. Create opportunities for feedback
   Feature previews allow you to opt in and test new functionality with your use cases, your data, your tools—all before it’s fully released. We hope you’ll provide valuable feedback to help influence how new features are shaped.
   
   
3. Enhance communication and collaboration
   The roadmap is hosted on a platform that enables users to leave comments, making it easy to share your thoughts, ask questions, and engage directly with Terra’s product team. In turn, our team will actively respond to and engage with you. Your input matters, and this is one of the ways we’re ensuring your voice helps shape Terra’s future.
   
   

What This Means for You

By making our development plans transparent, we aim to ensure that the features we deliver truly address your needs. The roadmap is now live and will be routinely updated to ensure it reflects the latest priorities. This roadmap is not a static snapshot—it’s a dynamic tool designed to grow with the platform and its community. Whether you’re a researcher managing large datasets, a public health expert involved in pathogen genomic surveillance, or a bioinformatician optimizing workflows, the roadmap is designed to keep you informed and involved. The launch of the roadmap is a reflection of a core belief: Terra is better when built in partnership with its community. We invite you to explore the roadmap, share your feedback, and be a part of shaping the future of Terra. 

View the Public Terra Roadmap

-The Terra Team

The post Introducing the Public Terra Roadmap: Shaping the Future Together appeared first on Terra.

All materials discussed here are publicly available in the study’s Featured Workspace.

At the start of 2020, I had just begun working with members of the Sabeti Lab to demonstrate the use case and flexibility of Terra as a platform for pathogen genomic surveillance (PGS). PGS refers to using genomics as an epidemiological tool for tracking sources of infection, detecting outbreaks, and understanding the evolution of an epidemic or pandemic. We had recently received funding from the Gates Foundation to adapt Terra for viral genomic data and genomic surveillance applications and to accelerate the adoption of genomic surveillance by public health researchers and practitioners around the world. Shortly before the world went into lockdown, the project launched successfully and we began to make plans for how we could use Ebola data previously generated by the Sabeti lab to demonstrate sharing an analysis in Terra.

As the pandemic swept through Europe then the USA, however, everything changed. The Sabeti lab had begun formalizing plans with their partners at Massachusetts General Hospital and the Massachusetts Dept of Public Health to sequence the viral genomes of COVID-19 patients in the greater Boston area. They needed to formulate a plan for handling that data — and fast. We realized very quickly that this would be the right time to adapt our plans for sharing Ebola data and mobilize on Terra for SARS-CoV-2. This realization kick-started our work and we immediately began to plan for how this would come together — from flow cell to downstream analysis — in Terra.

As a starting point, I began by reviewing the lab’s workflows and typical processes, from wet bench to analytical outputs — with my formal background in molecular biology and significant experience at the bench in previous roles, I was able to ‘speak the language’ and understand the lab processes. One of our field engineers, Sushma Chaluvadi, jumped in with me to help get the lab’s analytical workflows set up in Terra.

Once we understood the processes, Sushma and I began porting their existing workflows from DNAnexus and GitHub to Terra. In parallel, I worked with our Pipeline Operations team to set up an automated workflow to transfer flow cell data from the Genomics Platform sequencing facility to Google Cloud Storage.

By this time, COVID-19 cases were rising sharply in the greater Boston area and the lab was receiving numerous plates of samples from their collaborators. As samples were sent for sequencing by our Genomics Platform, I tracked each run, so that the data could be made available in Terra as soon as possible. Once the raw data was in Terra, I ran demultiplexing and assembly workflows. Unsurprisingly, in working with such large amounts of data, there were some initial hiccups and challenges; for example, we had to figure out how to organize the data effectively, and we ran into some Google Cloud usage quotas. Various colleagues in the Data Sciences Platform stepped up to help us solve these issues, playing a critical role in getting the data demultiplexed and analyzed very quickly.

We also worked with the lab to create a workflow to use Nextstrain, a collection of open source phylogenetic analysis tools that are widely used by scientists, epidemiologists, and public health officials for studying pathogen spread and evolution, especially in outbreak scenarios. One of these tools, Augur, was developed for tracking pathogen evolution from sequencing data. We used it to build customized phylogenetic trees to analyze the evolutionary relationships between viral genomes isolated from cases of COVID-19, which enabled us to map the initial emergence and sustained transmission of the virus in the greater Boston area. You can see some of those outputs here.

The study of COVID-19 in the greater Boston area will continue; meanwhile, the initial study findings are available in MedRxiv, pending peer review, and the data and tools are publicly available in the featured workspace. Our team will continue to support the Sabeti Lab and others in the research and public health communities around the world by enabling them to organize, analyze, and share their data. We hope this will empower public health labs, as they scale their viral sequencing work.

I have been very lucky to be able to be a part of this important work this year. It has given both myself and my colleagues in the Data Sciences Platform an incredible amount of insight into the needs of the researchers and public health officials who are engaged in pathogen surveillance and infectious diseases work. We plan to use the knowledge and perspective we gained to further improve how we support research and data sharing in Terra.

This initiative was sponsored in part by the National Institute of Allergy and Infectious Diseases and the Bill and Melinda Gates Foundation and is working in partnership with the Public Health Alliance for Genomic Epidemiology (PHA4GE) and the Virus Pathogen Resource (ViPR).

The post Behind the scenes: Bringing the analysis of COVID-19 data from greater Boston into the cloud appeared first on Terra.