{"id":431,"date":"2021-09-10T12:30:48","date_gmt":"2021-09-10T12:30:48","guid":{"rendered":"https:\/\/terrabioappdev.wpenginepowered.com\/moving-to-a-project-per-workspace-model-for-improved-resource-management\/"},"modified":"2023-12-27T04:54:57","modified_gmt":"2023-12-27T04:54:57","slug":"moving-to-a-project-per-workspace-model-for-improved-resource-management","status":"publish","type":"post","link":"https:\/\/terra.bio\/moving-to-a-project-per-workspace-model-for-improved-resource-management\/","title":{"rendered":"Moving to a project-per-workspace model for improved resource management"},"content":{"rendered":"

Janki Kaneria, Senior Software Product Manager in the Data Sciences Platform at the Broad Institute, is responsible for Terra UI Cloud Integration and App Services. In this blog, she announces an upcoming change in how Terra uses Google Projects to manage workspace resources that will have important implications for most users: starting the week of September 27th, each newly created Terra workspace will be associated with a dedicated Google Project. <\/span><\/i>Related to this change, Billing Account administrators are advised to<\/i><\/b> request a quota increase from Google Cloud<\/i><\/b> before September 27th, as described below<\/i><\/b>. Please read the full blog to avoid any surprises or disruptions to your work when this change comes into effect.<\/span><\/i><\/p>\n

\n

 <\/p>\n

As part of an effort to improve cost reporting functionality in Terra, we are making changes to how workspace resources are managed. Until now, Terra supported creating multiple workspaces under a single Google Project, but we have come to realize that this severely limits our ability to add functionality for tracking and reporting detailed cost information through the Terra user interface. That is why we are moving to a model where each Terra workspace is associated with its own Google Project, created by Terra on your behalf when you create the workspace.\u00a0<\/span><\/p>\n

Switching to this “project-per-workspace” model will enable us to add functionality for displaying a breakdown of costs per workspace in the Terra user interface, as well as other cost-related features further down the line. The new model will also enable you to set up <\/span>budget alerts<\/span><\/a> in the GCP console that map to individual workspaces, for any workspaces you create after the changes go into effect.<\/span><\/p>\n

In addition to enabling much-requested cost reporting features, this change will have some knock-on effects on the use of interactive cloud environments for running Jupyter Notebooks, RStudio, and Galaxy. Briefly, since these environments are created and managed per Google project, going forward you will have a separate cloud environment \u2014 and its dedicated persistent disk \u2014 for each workspace, instead of sharing the same environment across multiple workspaces under a given project. There will also be minor changes to the environment variables available in Jupyter Notebooks and in the Bioconductor AnVIL package.\u00a0 These changes will all be documented in detail in the relevant documentation upon release.<\/span><\/p>\n

Based on our analysis of what the majority of researchers need from Terra, we believe this change will be an improvement for most of you. We understand that in a subset of cases, this new model may cause some inconvenience, for which we sincerely apologize. We expect that the sum of benefits will vastly outweigh the drawbacks, and we remain open to your feedback as we continue to improve the functionality and user experience offered by Terra. <\/span><\/p>\n

 <\/p>\n

Action item for billing account administrators: Request a project quota increase from Google Cloud<\/span><\/h3>\n

There is one important limitation that comes into play with this change: by default, Google Cloud only allows the creation of 5 projects per billing account. Once we move to the project-per-workspace model, this would mean that a single billing account could only support 5 Terra workspaces, which would be insufficient for most individuals’ needs, let alone groups who share a billing account.\u00a0<\/span><\/p>\n

The good news is that you can request a quota increase from Google Cloud to lift this limitation. The quota increase is free and it takes just a minute to fill out the web form following the instructions included below.\u00a0<\/span><\/p>\n

It can, however, take several days to have the quota increase approved by Google. <\/span>We are therefore advising all Billing Account administrators to<\/b> request a quota increase from Google Cloud<\/b> before September 27th<\/b>. Failure to do so will result in limitations on how many workspaces can be created per billing account.\u00a0<\/span><\/p>\n

If you do not have administrator privileges on the account you use in your work, please check in with your account administrator to make sure they are aware of this notice and take the recommended action. <\/span><\/p>\n

 <\/p>\n

How to request the quota increase<\/span><\/h4>\n

Due to Google Cloud’s policies, we are not able to make the quota request on your behalf; however, the procedure is straightforward and the instructions below will ensure your request is successful with minimal effort.\u00a0<\/span><\/p>\n

Go to <\/span>https:\/\/support.google.com\/code\/contact\/billing_quota_increase<\/span><\/a><\/p>\n

Fill out the form as follows:<\/span><\/p>\n