{"id":398,"date":"2021-08-04T13:30:53","date_gmt":"2021-08-04T13:30:53","guid":{"rendered":"https:\/\/terrabioappdev.wpenginepowered.com\/speed-up-your-machine-learning-work-with-gpus\/"},"modified":"2023-12-27T04:54:53","modified_gmt":"2023-12-27T04:54:53","slug":"speed-up-your-machine-learning-work-with-gpus","status":"publish","type":"post","link":"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/","title":{"rendered":"Speed up your machine learning work with GPUs\u00a0"},"content":{"rendered":"<p><span style=\"font-weight: 400;\">Hot on the heels of <\/span><a href=\"https:\/\/terra.bio\/try-out-r-shiny-apps-in-terra\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">R Shiny support<\/span><\/a><span style=\"font-weight: 400;\">, our Interactive Analysis team has just released an upgrade that enables adding Graphical Processor Units (GPUs) to your Notebook cloud environments in Terra.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">GPUs were originally developed for graphical processing, as the name implies, and rose to prominence as a way to accelerate 3D computer graphics for applications like video games, which involve a ton of math that has to be done very quickly. Specifically, linear algebra operations like matrix multiplications, which happen to be the same kind of computations involved in a lot of machine learning (ML) algorithms.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Fast forward a decade or two, and there is now a vibrant ecosystem of ML tools and packages that make use of GPUs to accelerate computations in a wide variety of domains, including the life sciences.<\/span><\/p>\n<p>&nbsp;<\/p>\n<h3><span style=\"font-weight: 400;\">How to use GPUs in Terra<\/span><\/h3>\n<p><span style=\"font-weight: 400;\">Terra has offered the ability to use <\/span><a href=\"https:\/\/support.terra.bio\/hc\/en-us\/articles\/360055066731-Why-and-how-to-use-GPUs-when-running-a-workflow\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">GPUs in workflows<\/span><\/a><span style=\"font-weight: 400;\"> for quite some time, yet many of you have <\/span><a href=\"https:\/\/support.terra.bio\/hc\/en-us\/community\/posts\/360056049171-GPUs-for-Notebook-Runtime-Environments\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">told us<\/span><\/a><span style=\"font-weight: 400;\"> that you also need to be able to run GPU-enabled computations interactively, so we&#8217;re really excited to roll out GPU support for Jupyter Notebooks.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">To create a Notebook cloud environment with GPU(s) attached, simply check the &#8220;Enable GPUs&#8221; option in the environment configuration panel. This will bring up two additional menus from which you can select a specific type of GPU, as well as the number of GPUs you want, as shown in the screenshot below.<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400;\"><img fetchpriority=\"high\" decoding=\"async\" class=\"alignnone size-large wp-image-1055\" src=\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/gpu-menu-1024x654.png\" alt=\"\" width=\"800\" height=\"511\" \/><\/span><\/p>\n<p><i><span style=\"font-weight: 400;\">The Tesla T4 is currently the most popular model of NVIDIA GPUs on Google Cloud for ML applications. As a result, T4 instances may become unavailable during peak utilization periods. If your environment creation request fails with an error about resources being unavailable, see the <\/span><\/i><a href=\"https:\/\/support.terra.bio\/hc\/en-us\/articles\/4403006001947-How-to-add-GPUs-to-a-Cloud-Environment\" target=\"_blank\" rel=\"noopener\"><i><span style=\"font-weight: 400;\">documentation<\/span><\/i><\/a><i><span style=\"font-weight: 400;\"> for workarounds.<\/span><\/i><\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400;\">Note that if you already have an existing cloud environment configuration, you will have to delete it explicitly before you can set up the GPU-enabled configuration, as documented <\/span><a href=\"https:\/\/support.terra.bio\/hc\/en-us\/articles\/4403006001947-How-to-add-GPUs-to-a-Cloud-Environment\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">here<\/span><\/a><span style=\"font-weight: 400;\">. This is a bit different than how the cloud environment configuration options normally work, but we expect this to be temporary \u2014 the GPU support feature is currently in beta status, and the development team has plans to address this and some other <\/span><a href=\"https:\/\/support.terra.bio\/hc\/en-us\/articles\/4403006001947-How-to-add-GPUs-to-a-Cloud-Environment\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">minor limitations<\/span><\/a><span style=\"font-weight: 400;\"> in upcoming work.\u00a0<\/span><\/p>\n<p>&nbsp;<\/p>\n<h3><span style=\"font-weight: 400;\">GPUs in action for single-cell analysis<\/span><\/h3>\n<p><span style=\"font-weight: 400;\">You can try out this new functionality with a Python analysis package called Pegasus, a component of the Cumulus framework developed by the <\/span><a href=\"https:\/\/lilab.mgh.harvard.edu\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Li lab<\/span><\/a><span style=\"font-weight: 400;\"> to analyze the transcriptomes of millions of single cells. Pegasus features several algorithms that can optionally take advantage of GPUs: a Pytorch-based implementation of <\/span><a href=\"https:\/\/www.nature.com\/articles\/s41592-019-0619-0\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Harmony<\/span><\/a><span style=\"font-weight: 400;\"> (Korsunsky et al., 2019), which applies a batch correction in order to integrate single-cell data from a variety of experimental sources; and two types of non-negative matrix factorizations using the <\/span><a href=\"https:\/\/github.com\/lilab-bcb\/nmf-torch\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">nmf-torch<\/span><\/a><span style=\"font-weight: 400;\"> package.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Conveniently, Bo Li and colleagues maintain a <\/span><a href=\"https:\/\/app.terra.bio\/#workspaces\/kco-tech\/Cumulus\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">public Terra workspace named Cumulus<\/span><\/a><span style=\"font-weight: 400;\"> that contains several Jupyter Notebooks as well as a cloud environment image that contains all the software dependencies required to run Pegasus, which is available as one of the preset community-maintained environments. This means you can take Pegasus \u2014 and a GPU! \u2014 for a spin with just a few clicks: clone the <\/span><a href=\"https:\/\/app.terra.bio\/#workspaces\/kco-tech\/Cumulus\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Cumulus workspace<\/span><\/a><span style=\"font-weight: 400;\">, then set up your cloud environment by selecting the Pegasus image and enabling GPU support as outlined above. Your configuration panel should look something like this:\u00a0<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400;\"><img decoding=\"async\" class=\"alignnone size-large wp-image-1053\" src=\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/compute-profile-1024x925.png\" alt=\"\" width=\"800\" height=\"723\" \/><\/span><\/p>\n<p><i><span style=\"font-weight: 400;\">We&#8217;re using 8 CPUs with 30 GB of memory to provide a solid compute base for the other analysis steps that can&#8217;t use the CPU. For the GPU, we&#8217;re selecting the Tesla T4, which is the most widely recommended option for ML from NVIDIA&#8217;s lineup.\u00a0<\/span><\/i><\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400;\">Once your environment is running, open the notebook named &#8220;GPU Benchmark&#8221; in the Notebooks tab and run all the cells. Scroll down to the Batch Correction section and you&#8217;ll see two cells that run two slightly different versions of the same &#8220;run_harmony&#8221; command, each on a copy of the same original dataset.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">In the first one, the Harmony algorithm uses the CPUs only, even though a GPU is available in the environment because use of the GPU is not explicitly enabled in the command:<\/span><\/p>\n<p><span style=\"font-weight: 400;\"><img decoding=\"async\" class=\"alignnone size-full wp-image-1052\" src=\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/cpu-runtime.png\" alt=\"\" width=\"1019\" height=\"267\" \/><\/span><\/p>\n<p><span style=\"font-weight: 400;\">Compare this to the second one, where the Harmony algorithm is able to use the GPU thanks to the addition of the &#8220;use_gpu=True&#8221; parameter:<\/span><\/p>\n<p><span style=\"font-weight: 400;\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1054\" src=\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/gpu-runtime.png\" alt=\"\" width=\"1019\" height=\"288\" \/><\/span><\/p>\n<p><span style=\"font-weight: 400;\">As you can see, the GPU-enabled version ran more than twice as fast as the CPU-only version of the command. The CPU-only configuration is quite a bit cheaper, but since it has to run for a longer amount of time, you may end up paying similar amounts regardless of what you choose. The tiebreaker to this tradeoff then, is this: <strong>what is the value of <em>your<\/em> time?<\/strong><\/span><\/p>\n<p><i><span style=\"font-weight: 400;\">If you try to run the GPU-enabled version of the command on a CPU-only configuration, the Pegasus software will warn you that &#8220;<\/span><\/i><i><span style=\"font-weight: 400;\">CUDA is not available on your machine&#8221; and it will fall back to using the CPU-only mode. CUDA is the programming interface that software tools like Pegasus use under the hood to access GPU capabilities.<\/span><\/i><\/p>\n<p>&nbsp;<\/p>\n<h3><span style=\"font-weight: 400;\">Finding the sweet spot of performance vs cost<\/span><\/h3>\n<p><span style=\"font-weight: 400;\">For completeness, we ran this again several times to test the range of CPU-only configurations available in the system and see how performance scales with the number of CPUs we throw at the problem. We also tested the other available types of NVIDIA GPUs to see if everyone was right about the Tesla T4 being the best option for this kind of work.\u00a0<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-large wp-image-1057\" src=\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/gpu-chart-1024x638.png\" alt=\"\" width=\"800\" height=\"498\" \/><\/p>\n<p><span style=\"font-weight: 400;\">This summary graph suggests that you can certainly get pretty far just by adding more CPUs, but CPU-only performance quickly reaches a plateau (though cost does not, oh no \u2014 that just keeps going up). And yes, out of the available NVIDIA machines, the Tesla T4 does look like the right option for this job, with the lowest price point <em>and<\/em> lowest runtime, a rare combination indeed. \u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Keep in mind of course that this is a fairly informal benchmark of just one algorithm implementation, using a dataset that is not small but also not enormous. We did see some variability in the runtimes, which may be due to latency in the data handling and so on, so your mileage may vary.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">More generally, what you see here does not demonstrate the full scale of the acceleration that you can reap from using the right GPUs in the right place. Consider it more of a teaser meant to motivate you to try out this new feature&#8230; and as always, let us know how it goes!\u00a0<\/span><\/p>\n<p>&nbsp;<\/p>\n<hr \/>\n<p>&nbsp;<\/p>\n<h4><span style=\"color: #008000;\"><b>Resources<\/b><\/span><\/h4>\n<p><span style=\"font-weight: 400;\">Korsunsky, I., Millard, N., Fan, J. <\/span><i><span style=\"font-weight: 400;\">et al.<\/span><\/i><span style=\"font-weight: 400;\"> Fast, sensitive and accurate integration of single-cell data with Harmony. <\/span><i><span style=\"font-weight: 400;\">Nat Methods<\/span><\/i><span style=\"font-weight: 400;\"> 16, 1289\u20131296 (2019). <\/span><a href=\"https:\/\/doi.org\/10.1038\/s41592-019-0619-0\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">https:\/\/doi.org\/10.1038\/s41592-019-0619-0<\/span><\/a><\/p>\n<p><span style=\"font-weight: 400;\">Li, B., Gould, J., Yang, Y. <\/span><i><span style=\"font-weight: 400;\">et al. <\/span><\/i><span style=\"font-weight: 400;\">Cumulus provides cloud-based data analysis for large-scale single-cell and single-nucleus RNA-seq. <\/span><i><span style=\"font-weight: 400;\">Nat Methods<\/span><\/i><span style=\"font-weight: 400;\"> 17, 793\u2013798 (2020). <\/span><a href=\"https:\/\/doi.org\/10.1038\/s41592-020-0905-x\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">https:\/\/doi.org\/10.1038\/s41592-020-0905-x<\/span><\/a><\/p>\n<p><span style=\"font-weight: 400;\">Yang, Y. and Li. B. Harmony-PyTorch: a PyTorch implementation of the popular Harmony data integration algorithm. <\/span><a href=\"https:\/\/github.com\/lilab-bcb\/harmony-pytorch\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">https:\/\/github.com\/lilab-bcb\/harmony-pytorch<\/span><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Terra has offered the ability to use GPUs in workflows for quite some time, yet many of you have told us that you also need to be able to run GPU-enabled computations interactively, so we&#8217;re really excited to roll out GPU support for Jupyter Notebooks.\u00a0<\/p>\n","protected":false},"author":4,"featured_media":404,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[43,44,119,45,59,14],"tags":[144,145,146,147,148],"class_list":["post-398","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-features","category-interactive-analysis","category-most-recent","category-notebooks","category-single-cell","category-workspaces","tag-gpu","tag-inference","tag-machine-learning","tag-ml","tag-nvidia"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.0 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Speed up your machine learning work with GPUs\u00a0 - Terra<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Speed up your machine learning work with GPUs\u00a0 - Terra\" \/>\n<meta property=\"og:description\" content=\"Terra has offered the ability to use GPUs in workflows for quite some time, yet many of you have told us that you also need to be able to run GPU-enabled computations interactively, so we&#039;re really excited to roll out GPU support for Jupyter Notebooks.\u00a0\" \/>\n<meta property=\"og:url\" content=\"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/\" \/>\n<meta property=\"og:site_name\" content=\"Terra\" \/>\n<meta property=\"article:published_time\" content=\"2021-08-04T13:30:53+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-12-27T04:54:53+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/shutterstock_1839285907.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"627\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Geraldine Van der Auwera\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Geraldine Van der Auwera\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/\"},\"author\":{\"name\":\"Geraldine Van der Auwera\",\"@id\":\"https:\/\/terra.bio\/#\/schema\/person\/ad0522d0b331a5e08fa1733f65086ee2\"},\"headline\":\"Speed up your machine learning work with GPUs\u00a0\",\"datePublished\":\"2021-08-04T13:30:53+00:00\",\"dateModified\":\"2023-12-27T04:54:53+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/\"},\"wordCount\":1161,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/terra.bio\/#organization\"},\"image\":{\"@id\":\"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/shutterstock_1839285907.jpg\",\"keywords\":[\"gpu\",\"inference\",\"machine learning\",\"ml\",\"nvidia\"],\"articleSection\":[\"Features\",\"Interactive Analysis\",\"Most Recent\",\"Notebooks\",\"Single-Cell\",\"Workspaces\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/\",\"url\":\"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/\",\"name\":\"Speed up your machine learning work with GPUs\u00a0 - Terra\",\"isPartOf\":{\"@id\":\"https:\/\/terra.bio\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/shutterstock_1839285907.jpg\",\"datePublished\":\"2021-08-04T13:30:53+00:00\",\"dateModified\":\"2023-12-27T04:54:53+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/#primaryimage\",\"url\":\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/shutterstock_1839285907.jpg\",\"contentUrl\":\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/shutterstock_1839285907.jpg\",\"width\":1200,\"height\":627,\"caption\":\"genome map sequence on PCB, analysis dna software, bioinformatics concept\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/terra.bio\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Speed up your machine learning work with GPUs\u00a0\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/terra.bio\/#website\",\"url\":\"https:\/\/terra.bio\/\",\"name\":\"Terra\",\"description\":\"Science at Scale\",\"publisher\":{\"@id\":\"https:\/\/terra.bio\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/terra.bio\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/terra.bio\/#organization\",\"name\":\"Terra\",\"url\":\"https:\/\/terra.bio\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/terra.bio\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Terra-Bio-App@2x.webp\",\"contentUrl\":\"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Terra-Bio-App@2x.webp\",\"width\":287,\"height\":318,\"caption\":\"Terra\"},\"image\":{\"@id\":\"https:\/\/terra.bio\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/terra.bio\/#\/schema\/person\/ad0522d0b331a5e08fa1733f65086ee2\",\"name\":\"Geraldine Van der Auwera\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/terra.bio\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/d73bdaf6740465b385e0e3b290786d8cb9d9d548eadec23364254ba06c85204b?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/d73bdaf6740465b385e0e3b290786d8cb9d9d548eadec23364254ba06c85204b?s=96&d=mm&r=g\",\"caption\":\"Geraldine Van der Auwera\"},\"sameAs\":[\"https:\/\/app.terra.bio\/\"],\"url\":\"https:\/\/terra.bio\/author\/geraldinevanterra\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Speed up your machine learning work with GPUs\u00a0 - Terra","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/","og_locale":"en_US","og_type":"article","og_title":"Speed up your machine learning work with GPUs\u00a0 - Terra","og_description":"Terra has offered the ability to use GPUs in workflows for quite some time, yet many of you have told us that you also need to be able to run GPU-enabled computations interactively, so we're really excited to roll out GPU support for Jupyter Notebooks.\u00a0","og_url":"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/","og_site_name":"Terra","article_published_time":"2021-08-04T13:30:53+00:00","article_modified_time":"2023-12-27T04:54:53+00:00","og_image":[{"width":1200,"height":627,"url":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/shutterstock_1839285907.jpg","type":"image\/jpeg"}],"author":"Geraldine Van der Auwera","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Geraldine Van der Auwera","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/#article","isPartOf":{"@id":"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/"},"author":{"name":"Geraldine Van der Auwera","@id":"https:\/\/terra.bio\/#\/schema\/person\/ad0522d0b331a5e08fa1733f65086ee2"},"headline":"Speed up your machine learning work with GPUs\u00a0","datePublished":"2021-08-04T13:30:53+00:00","dateModified":"2023-12-27T04:54:53+00:00","mainEntityOfPage":{"@id":"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/"},"wordCount":1161,"commentCount":0,"publisher":{"@id":"https:\/\/terra.bio\/#organization"},"image":{"@id":"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/#primaryimage"},"thumbnailUrl":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/shutterstock_1839285907.jpg","keywords":["gpu","inference","machine learning","ml","nvidia"],"articleSection":["Features","Interactive Analysis","Most Recent","Notebooks","Single-Cell","Workspaces"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/","url":"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/","name":"Speed up your machine learning work with GPUs\u00a0 - Terra","isPartOf":{"@id":"https:\/\/terra.bio\/#website"},"primaryImageOfPage":{"@id":"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/#primaryimage"},"image":{"@id":"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/#primaryimage"},"thumbnailUrl":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/shutterstock_1839285907.jpg","datePublished":"2021-08-04T13:30:53+00:00","dateModified":"2023-12-27T04:54:53+00:00","breadcrumb":{"@id":"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/#primaryimage","url":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/shutterstock_1839285907.jpg","contentUrl":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/shutterstock_1839285907.jpg","width":1200,"height":627,"caption":"genome map sequence on PCB, analysis dna software, bioinformatics concept"},{"@type":"BreadcrumbList","@id":"https:\/\/terra.bio\/speed-up-your-machine-learning-work-with-gpus\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/terra.bio\/"},{"@type":"ListItem","position":2,"name":"Speed up your machine learning work with GPUs\u00a0"}]},{"@type":"WebSite","@id":"https:\/\/terra.bio\/#website","url":"https:\/\/terra.bio\/","name":"Terra","description":"Science at Scale","publisher":{"@id":"https:\/\/terra.bio\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/terra.bio\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/terra.bio\/#organization","name":"Terra","url":"https:\/\/terra.bio\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/terra.bio\/#\/schema\/logo\/image\/","url":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Terra-Bio-App@2x.webp","contentUrl":"https:\/\/terra.bio\/wp-content\/uploads\/2023\/12\/Terra-Bio-App@2x.webp","width":287,"height":318,"caption":"Terra"},"image":{"@id":"https:\/\/terra.bio\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/terra.bio\/#\/schema\/person\/ad0522d0b331a5e08fa1733f65086ee2","name":"Geraldine Van der Auwera","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/terra.bio\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/d73bdaf6740465b385e0e3b290786d8cb9d9d548eadec23364254ba06c85204b?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d73bdaf6740465b385e0e3b290786d8cb9d9d548eadec23364254ba06c85204b?s=96&d=mm&r=g","caption":"Geraldine Van der Auwera"},"sameAs":["https:\/\/app.terra.bio\/"],"url":"https:\/\/terra.bio\/author\/geraldinevanterra\/"}]}},"_links":{"self":[{"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/posts\/398","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/comments?post=398"}],"version-history":[{"count":0,"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/posts\/398\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/media\/404"}],"wp:attachment":[{"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/media?parent=398"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/categories?post=398"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/terra.bio\/wp-json\/wp\/v2\/tags?post=398"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}