{"id":5647104,"date":"2023-01-05T14:09:54","date_gmt":"2023-01-05T19:09:54","guid":{"rendered":"https:\/\/lightning.ai\/pages\/?p=5647104"},"modified":"2023-01-05T14:09:54","modified_gmt":"2023-01-05T19:09:54","slug":"how-to-scale-model-serving-in-production","status":"publish","type":"post","link":"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/","title":{"rendered":"How To Scale Model Serving in Production"},"content":{"rendered":"<p>[vc_row full_width=&#8221;stretch_row&#8221; css=&#8221;.vc_custom_1659550605174{margin-bottom: 30px !important;background: #ededed url(https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2022\/07\/poster3-1-scaled.jpg?id=5646423) !important;background-position: center !important;background-repeat: no-repeat !important;background-size: cover !important;}&#8221;][vc_column width=&#8221;1\/2&#8243; css=&#8221;.vc_custom_1658981067516{margin-top: 100px !important;}&#8221;][vc_column_text]<\/p>\n<h2>How To Scale Model Serving in Production<\/h2>\n<p>[\/vc_column_text][vc_column_text el_class=&#8221;date-ctm&#8221; css=&#8221;.vc_custom_1660920337158{margin-top: 25px !important;}&#8221;]Thursday, January 12th, 2023 | 7 AM PT[\/vc_column_text][vc_column_text el_class=&#8221;desc-ctm&#8221; css=&#8221;.vc_custom_1659033048749{margin-top: 25px !important;}&#8221;]Learn how you can scale model serving on Lightning AI with dynamic batching and autoscaling.[\/vc_column_text][\/vc_column][vc_column width=&#8221;1\/2&#8243; css=&#8221;.vc_custom_1659033147339{margin-top: 50px !important;padding-top: 30px !important;padding-right: 50px !important;padding-bottom: 30px !important;padding-left: 50px !important;}&#8221;][vc_row_inner el_class=&#8221;box-shadow-ctm&#8221; css=&#8221;.vc_custom_1659033155106{background-color: #ffffff !important;}&#8221;][vc_column_inner css=&#8221;.vc_custom_1659030898493{padding-top: 25px !important;padding-right: 25px !important;padding-bottom: 25px !important;padding-left: 25px !important;}&#8221;]<script charset=\"utf-8\" type=\"text\/javascript\" src=\"\/\/js.hsforms.net\/forms\/embed\/v2.js\"><\/script><br \/>\n<script>\n  hbspt.forms.create({\n    region: \"na1\",\n    portalId: \"9067487\",\n    formId: \"abda5742-d6d3-4b01-9ca9-671bd7f4c38e\"\n  });\n<\/script>[\/vc_column_inner][\/vc_row_inner][\/vc_column][\/vc_row][vc_row css=&#8221;.vc_custom_1658947969678{margin-top: 50px !important;}&#8221;][vc_column width=&#8221;1\/6&#8243;][\/vc_column][vc_column width=&#8221;2\/3&#8243;][vc_column_text css=&#8221;.vc_custom_1658982881413{margin-bottom: 20px !important;border-bottom-width: 1px !important;padding-bottom: 20px !important;border-bottom-color: #e5e5e5 !important;border-bottom-style: solid !important;}&#8221; el_class=&#8221;team-pre-ctm&#8221;]<\/p>\n<h4>About this Webinar<\/h4>\n<p>[\/vc_column_text][vc_column_text]Serving large models in production with high concurrency and throughput is essential for businesses to respond quickly to users and be available to handle a large number of requests.<\/p>\n<p>Join Lightning\u2019s Neil Bhatt and Sherin Thomas to learn about how we took advantage of Dynamic Batching and Autoscaling to serve Stable Diffusion in production and scaled it to handle over 1K concurrent users.<\/p>\n<p>&nbsp;<\/p>\n<p class=\"p1\">Learn how to:<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<ul>\n<li class=\"p1\">Improve throughput with dynamic batching<span class=\"Apple-converted-space\">\u00a0<\/span><\/li>\n<li class=\"p1\">Implement horizontal scaling that will dynamically scale up and down dependent on traffic, saving your money<\/li>\n<li class=\"p1\">Adjust scaling parameters with minimal development experience required<\/li>\n<\/ul>\n<p>[\/vc_column_text][vc_column_text css=&#8221;.vc_custom_1658982481861{margin-bottom: 20px !important;border-bottom-width: 1px !important;padding-bottom: 20px !important;border-bottom-color: #e5e5e5 !important;border-bottom-style: solid !important;}&#8221; el_class=&#8221;team-pre-ctm&#8221;]<\/p>\n<h4>Presented By<\/h4>\n<p>Neil Bhatt | Director of Product | Lightning<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-5647105\" src=\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/1628143241194-300x300.jpeg\" alt=\"\" width=\"123\" height=\"123\" srcset=\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/1628143241194-150x150@2x.jpeg 300w, https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/1628143241194-150x150.jpeg 150w, https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/1628143241194-125x125.jpeg 125w, https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/1628143241194.jpeg 800w, https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/1628143241194-300x300@2x.jpeg 600w, https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/1628143241194-125x125@2x.jpeg 250w\" sizes=\"(max-width: 123px) 100vw, 123px\" \/><\/p>\n<p class=\"text-heading-xlarge inline t-24 v-align-middle break-words\">Sherin Thomas | Senior Software Engineer | Lightning<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-5647106\" src=\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/Screen-Shot-2023-01-05-at-10.22.05-AM-295x300.png\" alt=\"\" width=\"123\" height=\"125\" srcset=\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/Screen-Shot-2023-01-05-at-10.22.05-AM-295x300.png 295w, https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/Screen-Shot-2023-01-05-at-10.22.05-AM.png 494w\" sizes=\"(max-width: 123px) 100vw, 123px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>[vc_row full_width=&#8221;stretch_row&#8221; css=&#8221;.vc_custom_1659550605174{margin-bottom: 30px !important;background: #ededed url(https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2022\/07\/poster3-1-scaled.jpg?id=5646423) !important;background-position: center !important;background-repeat: no-repeat !important;background-size: cover !important;}&#8221;][vc_column width=&#8221;1\/2&#8243; css=&#8221;.vc_custom_1658981067516{margin-top: 100px !important;}&#8221;][vc_column_text] How To Scale Model Serving in Production [\/vc_column_text][vc_column_text el_class=&#8221;date-ctm&#8221; css=&#8221;.vc_custom_1660920337158{margin-top: 25px !important;}&#8221;]Thursday, January 12th, 2023 | 7 AM PT[\/vc_column_text][vc_column_text el_class=&#8221;desc-ctm&#8221; css=&#8221;.vc_custom_1659033048749{margin-top: 25px !important;}&#8221;]Learn how you can scale model serving on Lightning AI with dynamic batching and autoscaling.[\/vc_column_text][\/vc_column][vc_column<a class=\"excerpt-read-more\" href=\"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/\" title=\"ReadHow To Scale Model Serving in Production\">&#8230; Read more &raquo;<\/a><\/p>\n","protected":false},"author":16,"featured_media":5647107,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":"","_links_to":"","_links_to_target":""},"categories":[72],"tags":[],"glossary":[],"acf":{"additional_authors":false,"hide_from_archive":false,"content_type":"Webinar","custom_styles":".wpb_wrapper h4{\r\n        white-space: nowrap;\r\n    text-align: left;\r\n    width: 100%;\r\n    display: flex;\r\n    align-items: flex-start;\r\n\r\n}\r\n\r\n.vc_col-sm-6 .vc_row.wpb_row.vc_inner.vc_row-fluid.box-shadow-ctm.vc_row-has-fill {\r\n    margin-bottom:3rem;\r\n  border-radius:8px;\r\n}"},"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v24.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How To Scale Model Serving in Production - Lightning AI<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How To Scale Model Serving in Production | Webinar\" \/>\n<meta property=\"og:description\" content=\"[vc_row full_width=&#8221;stretch_row&#8221; css=&#8221;.vc_custom_1659550605174{margin-bottom: 30px !important;background: #ededed url(https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2022\/07\/poster3-1-scaled.jpg?id=5646423) !important;background-position: center !important;background-repeat: no-repeat !important;background-size: cover !important;}&#8221;][vc_column width=&#8221;1\/2&#8243; css=&#8221;.vc_custom_1658981067516{margin-top: 100px !important;}&#8221;][vc_column_text] How To Scale Model Serving in Production [\/vc_column_text][vc_column_text el_class=&#8221;date-ctm&#8221; css=&#8221;.vc_custom_1660920337158{margin-top: 25px !important;}&#8221;]Thursday, January 12th, 2023 | 7 AM PT[\/vc_column_text][vc_column_text el_class=&#8221;desc-ctm&#8221; css=&#8221;.vc_custom_1659033048749{margin-top: 25px !important;}&#8221;]Learn how you can scale model serving on Lightning AI with dynamic batching and autoscaling.[\/vc_column_text][\/vc_column][vc_column... Read more &raquo;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/\" \/>\n<meta property=\"og:site_name\" content=\"Lightning AI\" \/>\n<meta property=\"article:published_time\" content=\"2023-01-05T19:09:54+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/Webinar-Social-Post.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1280\" \/>\n\t<meta property=\"og:image:height\" content=\"720\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"JP Hennessy\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:title\" content=\"How To Scale Model Serving in Production | Webinar\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/Webinar-Social-Post.png\" \/>\n<meta name=\"twitter:creator\" content=\"@LightningAI\" \/>\n<meta name=\"twitter:site\" content=\"@LightningAI\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"JP Hennessy\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/\"},\"author\":{\"name\":\"JP Hennessy\",\"@id\":\"https:\/\/lightning.ai\/pages\/#\/schema\/person\/2518f4d5541f8e98016f6289169141a6\"},\"headline\":\"How To Scale Model Serving in Production\",\"datePublished\":\"2023-01-05T19:09:54+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/\"},\"wordCount\":371,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/lightning.ai\/pages\/#organization\"},\"image\":{\"@id\":\"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/Webinar-Social-Post.png\",\"articleSection\":[\"Webinar\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/\",\"url\":\"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/\",\"name\":\"How To Scale Model Serving in Production - Lightning AI\",\"isPartOf\":{\"@id\":\"https:\/\/lightning.ai\/pages\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/Webinar-Social-Post.png\",\"datePublished\":\"2023-01-05T19:09:54+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/#primaryimage\",\"url\":\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/Webinar-Social-Post.png\",\"contentUrl\":\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/Webinar-Social-Post.png\",\"width\":1280,\"height\":720},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/lightning.ai\/pages\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How To Scale Model Serving in Production\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/lightning.ai\/pages\/#website\",\"url\":\"https:\/\/lightning.ai\/pages\/\",\"name\":\"Lightning AI\",\"description\":\"The platform for teams to build AI.\",\"publisher\":{\"@id\":\"https:\/\/lightning.ai\/pages\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/lightning.ai\/pages\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/lightning.ai\/pages\/#organization\",\"name\":\"Lightning AI\",\"url\":\"https:\/\/lightning.ai\/pages\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/lightning.ai\/pages\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/02\/image-17.png\",\"contentUrl\":\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/02\/image-17.png\",\"width\":1744,\"height\":856,\"caption\":\"Lightning AI\"},\"image\":{\"@id\":\"https:\/\/lightning.ai\/pages\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/x.com\/LightningAI\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/lightning.ai\/pages\/#\/schema\/person\/2518f4d5541f8e98016f6289169141a6\",\"name\":\"JP Hennessy\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/lightning.ai\/pages\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/28ade268218ae45f723b0b62499f527a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/28ade268218ae45f723b0b62499f527a?s=96&d=mm&r=g\",\"caption\":\"JP Hennessy\"},\"url\":\"https:\/\/lightning.ai\/pages\/author\/jplightning-ai\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How To Scale Model Serving in Production - Lightning AI","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/","og_locale":"en_US","og_type":"article","og_title":"How To Scale Model Serving in Production | Webinar","og_description":"[vc_row full_width=&#8221;stretch_row&#8221; css=&#8221;.vc_custom_1659550605174{margin-bottom: 30px !important;background: #ededed url(https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2022\/07\/poster3-1-scaled.jpg?id=5646423) !important;background-position: center !important;background-repeat: no-repeat !important;background-size: cover !important;}&#8221;][vc_column width=&#8221;1\/2&#8243; css=&#8221;.vc_custom_1658981067516{margin-top: 100px !important;}&#8221;][vc_column_text] How To Scale Model Serving in Production [\/vc_column_text][vc_column_text el_class=&#8221;date-ctm&#8221; css=&#8221;.vc_custom_1660920337158{margin-top: 25px !important;}&#8221;]Thursday, January 12th, 2023 | 7 AM PT[\/vc_column_text][vc_column_text el_class=&#8221;desc-ctm&#8221; css=&#8221;.vc_custom_1659033048749{margin-top: 25px !important;}&#8221;]Learn how you can scale model serving on Lightning AI with dynamic batching and autoscaling.[\/vc_column_text][\/vc_column][vc_column... Read more &raquo;","og_url":"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/","og_site_name":"Lightning AI","article_published_time":"2023-01-05T19:09:54+00:00","og_image":[{"width":1280,"height":720,"url":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/Webinar-Social-Post.png","type":"image\/png"}],"author":"JP Hennessy","twitter_card":"summary_large_image","twitter_title":"How To Scale Model Serving in Production | Webinar","twitter_image":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/Webinar-Social-Post.png","twitter_creator":"@LightningAI","twitter_site":"@LightningAI","twitter_misc":{"Written by":"JP Hennessy","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/#article","isPartOf":{"@id":"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/"},"author":{"name":"JP Hennessy","@id":"https:\/\/lightning.ai\/pages\/#\/schema\/person\/2518f4d5541f8e98016f6289169141a6"},"headline":"How To Scale Model Serving in Production","datePublished":"2023-01-05T19:09:54+00:00","mainEntityOfPage":{"@id":"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/"},"wordCount":371,"commentCount":0,"publisher":{"@id":"https:\/\/lightning.ai\/pages\/#organization"},"image":{"@id":"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/#primaryimage"},"thumbnailUrl":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/Webinar-Social-Post.png","articleSection":["Webinar"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/","url":"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/","name":"How To Scale Model Serving in Production - Lightning AI","isPartOf":{"@id":"https:\/\/lightning.ai\/pages\/#website"},"primaryImageOfPage":{"@id":"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/#primaryimage"},"image":{"@id":"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/#primaryimage"},"thumbnailUrl":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/Webinar-Social-Post.png","datePublished":"2023-01-05T19:09:54+00:00","breadcrumb":{"@id":"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/#primaryimage","url":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/Webinar-Social-Post.png","contentUrl":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/01\/Webinar-Social-Post.png","width":1280,"height":720},{"@type":"BreadcrumbList","@id":"https:\/\/lightning.ai\/pages\/webinar\/how-to-scale-model-serving-in-production\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/lightning.ai\/pages\/"},{"@type":"ListItem","position":2,"name":"How To Scale Model Serving in Production"}]},{"@type":"WebSite","@id":"https:\/\/lightning.ai\/pages\/#website","url":"https:\/\/lightning.ai\/pages\/","name":"Lightning AI","description":"The platform for teams to build AI.","publisher":{"@id":"https:\/\/lightning.ai\/pages\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/lightning.ai\/pages\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/lightning.ai\/pages\/#organization","name":"Lightning AI","url":"https:\/\/lightning.ai\/pages\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/lightning.ai\/pages\/#\/schema\/logo\/image\/","url":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/02\/image-17.png","contentUrl":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/02\/image-17.png","width":1744,"height":856,"caption":"Lightning AI"},"image":{"@id":"https:\/\/lightning.ai\/pages\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/LightningAI"]},{"@type":"Person","@id":"https:\/\/lightning.ai\/pages\/#\/schema\/person\/2518f4d5541f8e98016f6289169141a6","name":"JP Hennessy","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/lightning.ai\/pages\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/28ade268218ae45f723b0b62499f527a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/28ade268218ae45f723b0b62499f527a?s=96&d=mm&r=g","caption":"JP Hennessy"},"url":"https:\/\/lightning.ai\/pages\/author\/jplightning-ai\/"}]}},"_links":{"self":[{"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/posts\/5647104"}],"collection":[{"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/users\/16"}],"replies":[{"embeddable":true,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/comments?post=5647104"}],"version-history":[{"count":0,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/posts\/5647104\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/media\/5647107"}],"wp:attachment":[{"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/media?parent=5647104"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/categories?post=5647104"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/tags?post=5647104"},{"taxonomy":"glossary","embeddable":true,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/glossary?post=5647104"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}