{"id":1115,"date":"2021-10-13T16:25:46","date_gmt":"2021-10-13T16:25:46","guid":{"rendered":"https:\/\/www.grid.ai\/?p=1115"},"modified":"2021-10-13T16:25:46","modified_gmt":"2021-10-13T16:25:46","slug":"managing-machine-learning-with-limited-resources","status":"publish","type":"post","link":"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/","title":{"rendered":"Managing Machine Learning With Limited Resources"},"content":{"rendered":"

Machine Learning Made Easier With Grid.ai<\/strong><\/p>\n

In the race to implement machine learning, businesses of all sizes look for more accurate predictions that will allow them to stay ahead and differentiate themselves from the competition. One of the main roadblocks in getting there is the availability and affordability of machine learning resources. In this post, we speak with Felix Dittrich<\/a>, the lead Machine Learning Developer at Memoresa to discuss how Grid.ai solved some of their ML challenges.<\/span><\/p>\n

 <\/p>\n

Discovering Grid<\/h2>\n

Based in Leipzig, Germany, Memoresa<\/a> is an online platform and mobile app for easy estate planning, secure emergency provision, and digital organization with a system. Memoresa prides itself on helping estates organize their life documents to allow peace of mind for the organizing and planning of life.<\/span><\/p>\n

Before finding Grid, Felix and his team felt challenged by all the steps related to training machine learning management, mainly due to their limited number of developers, capabilities, and resources brought on by a small team.<\/span><\/p>\n

Memoresa captures image documents in their application; the ML engineer uses Grid to train their model to capture metadata for each user and auto-complete forms that are required to simplify the onboarding process. \u201c<\/span>We used Grid to train a custom named entity recognition model using Transformers and PyTorch Lightning as well as Onnx for quantization,\u201d mentioned Felix.\u00a0<\/span><\/p>\n

While using the open-source<\/span> PyTorch Lightning project<\/span><\/a> to eliminate boilerplate in his code, Felix discovered Grid.ai. <\/span>Founded by the creators of PyTorch Lightning<\/span><\/a>, Grid is a platform designed to develop and train deep learning models at scale. The team at Memoresa needed an easy way to coordinate all the steps in training and managing machine learning models. Grid made it easy for Felix\u2019s team to address this, as well as version control all their training data and model artifacts out of the box.<\/span><\/p>\n

 <\/p>\n

\"Memoresa<\/p>\n

<\/h2>\n

Exceeded Expectations!<\/span><\/h2>\n

Implementing Grid exceeded Felix and his team’s expectations. \u201cAll the steps related to end-to-end model training can be managed in one place. When my code runs in Sessions, I can scale it with Runs without any code changes.\u201d<\/span><\/p>\n

For start-ups like Memoresa, this means that it takes less time to go from an innovative prototype to a top-performing model. Felix remarked that he likes \u201chow easily Grid Sessions enables me to prototype and debug my models and how I can scale my Session code with different hyperparameters configurations with Runs without any code modifications.\u201d<\/span><\/p>\n

\u201cI love that Grid supports automatic versioning of <\/span>datastores<\/span><\/a> and model artifacts. \u200bGrid makes it simple to share datasets and model assets and code. As our company scales, it\u2019s straightforward to introduce new teammates for collaboration.\u201d This means that start-ups such as Memoresa can easily share the outcomes of their machine learning experiments reducing the time from expiration to business value.<\/span><\/p>\n

\"Memoresa<\/p>\n

 <\/p>\n

\"Memoresa<\/p>\n

Getting Started With Grid.ai<\/span><\/h2>\n

Interested in learning more about how Grid can help you manage deep learning model development for your next project? Get started with Grid\u2019s free community tier account (and get $25 in free credits!) by\u00a0clicking here<\/u><\/a>. Also, explore our documentation<\/u><\/a> and join the Slack community<\/u><\/a> to learn more about what the Grid platform can do for you.<\/span><\/p>\n

\"Grid<\/p>\n","protected":false},"excerpt":{"rendered":"

Machine Learning Made Easier With Grid.ai In the race to implement machine learning, businesses of all sizes look for more accurate predictions that will allow them to stay ahead and differentiate themselves from the competition. One of the main roadblocks in getting there is the availability and affordability of machine learning resources. In this post,… Read more »<\/a><\/p>\n","protected":false},"author":16,"featured_media":1256,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":"","_links_to":"","_links_to_target":""},"categories":[26],"tags":[30,31,32,33,34],"glossary":[],"acf":{"hide_from_archive":null,"content_type":null,"code_embed":null,"code_shortcode":null,"custom_styles":null,"sticky":null,"additional_authors":null,"mathjax":null,"default_editor":null,"sections":null,"show_table_of_contents":null,"table_of_contents":null,"tabs":null,"tab_group":null},"yoast_head":"\nManaging Machine Learning With Limited Resources - Lightning AI<\/title>\n<meta name=\"description\" content=\"Felix from Memoresa talks about how implementing Grid has allowed their team to scale and get a better grip on machine learning management.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Managing Machine Learning With Limited Resources - Lightning AI\" \/>\n<meta property=\"og:description\" content=\"Felix from Memoresa talks about how implementing Grid has allowed their team to scale and get a better grip on machine learning management.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/\" \/>\n<meta property=\"og:site_name\" content=\"Lightning AI\" \/>\n<meta property=\"article:published_time\" content=\"2021-10-13T16:25:46+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2021\/10\/Customer-Stories-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"1280\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"JP Hennessy\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@LightningAI\" \/>\n<meta name=\"twitter:site\" content=\"@LightningAI\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"JP Hennessy\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/\"},\"author\":{\"name\":\"JP Hennessy\",\"@id\":\"https:\/\/lightning.ai\/pages\/#\/schema\/person\/2518f4d5541f8e98016f6289169141a6\"},\"headline\":\"Managing Machine Learning With Limited Resources\",\"datePublished\":\"2021-10-13T16:25:46+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/\"},\"wordCount\":536,\"publisher\":{\"@id\":\"https:\/\/lightning.ai\/pages\/#organization\"},\"image\":{\"@id\":\"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2021\/10\/Customer-Stories-1.png\",\"keywords\":[\"artifacts\",\"deep learning\",\"machine learning\",\"model training\",\"scale\"],\"articleSection\":[\"Case Studies\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/\",\"url\":\"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/\",\"name\":\"Managing Machine Learning With Limited Resources - Lightning AI\",\"isPartOf\":{\"@id\":\"https:\/\/lightning.ai\/pages\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2021\/10\/Customer-Stories-1.png\",\"datePublished\":\"2021-10-13T16:25:46+00:00\",\"description\":\"Felix from Memoresa talks about how implementing Grid has allowed their team to scale and get a better grip on machine learning management.\",\"breadcrumb\":{\"@id\":\"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/#primaryimage\",\"url\":\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2021\/10\/Customer-Stories-1.png\",\"contentUrl\":\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2021\/10\/Customer-Stories-1.png\",\"width\":2560,\"height\":1280},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/lightning.ai\/pages\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Managing Machine Learning With Limited Resources\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/lightning.ai\/pages\/#website\",\"url\":\"https:\/\/lightning.ai\/pages\/\",\"name\":\"Lightning AI\",\"description\":\"The platform for teams to build AI.\",\"publisher\":{\"@id\":\"https:\/\/lightning.ai\/pages\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/lightning.ai\/pages\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/lightning.ai\/pages\/#organization\",\"name\":\"Lightning AI\",\"url\":\"https:\/\/lightning.ai\/pages\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/lightning.ai\/pages\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/02\/image-17.png\",\"contentUrl\":\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/02\/image-17.png\",\"width\":1744,\"height\":856,\"caption\":\"Lightning AI\"},\"image\":{\"@id\":\"https:\/\/lightning.ai\/pages\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/x.com\/LightningAI\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/lightning.ai\/pages\/#\/schema\/person\/2518f4d5541f8e98016f6289169141a6\",\"name\":\"JP Hennessy\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/lightning.ai\/pages\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/28ade268218ae45f723b0b62499f527a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/28ade268218ae45f723b0b62499f527a?s=96&d=mm&r=g\",\"caption\":\"JP Hennessy\"},\"url\":\"https:\/\/lightning.ai\/pages\/author\/jplightning-ai\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Managing Machine Learning With Limited Resources - Lightning AI","description":"Felix from Memoresa talks about how implementing Grid has allowed their team to scale and get a better grip on machine learning management.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/","og_locale":"en_US","og_type":"article","og_title":"Managing Machine Learning With Limited Resources - Lightning AI","og_description":"Felix from Memoresa talks about how implementing Grid has allowed their team to scale and get a better grip on machine learning management.","og_url":"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/","og_site_name":"Lightning AI","article_published_time":"2021-10-13T16:25:46+00:00","og_image":[{"width":2560,"height":1280,"url":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2021\/10\/Customer-Stories-1.png","type":"image\/png"}],"author":"JP Hennessy","twitter_card":"summary_large_image","twitter_creator":"@LightningAI","twitter_site":"@LightningAI","twitter_misc":{"Written by":"JP Hennessy","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/#article","isPartOf":{"@id":"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/"},"author":{"name":"JP Hennessy","@id":"https:\/\/lightning.ai\/pages\/#\/schema\/person\/2518f4d5541f8e98016f6289169141a6"},"headline":"Managing Machine Learning With Limited Resources","datePublished":"2021-10-13T16:25:46+00:00","mainEntityOfPage":{"@id":"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/"},"wordCount":536,"publisher":{"@id":"https:\/\/lightning.ai\/pages\/#organization"},"image":{"@id":"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/#primaryimage"},"thumbnailUrl":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2021\/10\/Customer-Stories-1.png","keywords":["artifacts","deep learning","machine learning","model training","scale"],"articleSection":["Case Studies"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/","url":"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/","name":"Managing Machine Learning With Limited Resources - Lightning AI","isPartOf":{"@id":"https:\/\/lightning.ai\/pages\/#website"},"primaryImageOfPage":{"@id":"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/#primaryimage"},"image":{"@id":"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/#primaryimage"},"thumbnailUrl":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2021\/10\/Customer-Stories-1.png","datePublished":"2021-10-13T16:25:46+00:00","description":"Felix from Memoresa talks about how implementing Grid has allowed their team to scale and get a better grip on machine learning management.","breadcrumb":{"@id":"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/#primaryimage","url":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2021\/10\/Customer-Stories-1.png","contentUrl":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2021\/10\/Customer-Stories-1.png","width":2560,"height":1280},{"@type":"BreadcrumbList","@id":"https:\/\/lightning.ai\/pages\/community\/case-studies\/managing-machine-learning-with-limited-resources\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/lightning.ai\/pages\/"},{"@type":"ListItem","position":2,"name":"Managing Machine Learning With Limited Resources"}]},{"@type":"WebSite","@id":"https:\/\/lightning.ai\/pages\/#website","url":"https:\/\/lightning.ai\/pages\/","name":"Lightning AI","description":"The platform for teams to build AI.","publisher":{"@id":"https:\/\/lightning.ai\/pages\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/lightning.ai\/pages\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/lightning.ai\/pages\/#organization","name":"Lightning AI","url":"https:\/\/lightning.ai\/pages\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/lightning.ai\/pages\/#\/schema\/logo\/image\/","url":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/02\/image-17.png","contentUrl":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/02\/image-17.png","width":1744,"height":856,"caption":"Lightning AI"},"image":{"@id":"https:\/\/lightning.ai\/pages\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/LightningAI"]},{"@type":"Person","@id":"https:\/\/lightning.ai\/pages\/#\/schema\/person\/2518f4d5541f8e98016f6289169141a6","name":"JP Hennessy","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/lightning.ai\/pages\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/28ade268218ae45f723b0b62499f527a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/28ade268218ae45f723b0b62499f527a?s=96&d=mm&r=g","caption":"JP Hennessy"},"url":"https:\/\/lightning.ai\/pages\/author\/jplightning-ai\/"}]}},"_links":{"self":[{"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/posts\/1115"}],"collection":[{"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/users\/16"}],"replies":[{"embeddable":true,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/comments?post=1115"}],"version-history":[{"count":0,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/posts\/1115\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/media\/1256"}],"wp:attachment":[{"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/media?parent=1115"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/categories?post=1115"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/tags?post=1115"},{"taxonomy":"glossary","embeddable":true,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/glossary?post=1115"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}