{"id":5646849,"date":"2022-11-01T14:14:01","date_gmt":"2022-11-01T18:14:01","guid":{"rendered":"https:\/\/lightning.ai\/pages\/?p=5646849"},"modified":"2022-11-02T15:24:39","modified_gmt":"2022-11-02T19:24:39","slug":"lightning-1-8-release","status":"publish","type":"post","link":"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/","title":{"rendered":"Lightning 1.8: Colossal-AI, Secrets for Apps, and more"},"content":{"rendered":"<p>We&#8217;re excited to announce the release of Lightning 1.8 \u26a1\ufe0f (<a href=\"https:\/\/github.com\/Lightning-AI\/lightning\/releases\/tag\/1.8.0\"><span style=\"text-decoration: underline; color: #9329e5;\"><strong>release notes<\/strong><\/span><\/a>).<\/p>\n<p>v1.8 of Lightning is the culmination of work from 52 contributors who have worked on features, bug fixes, and documentation for a total of over 550 commits since 1.7.0.<\/p>\n<h1>Highlights<\/h1>\n<ul>\n<li>Colossal-AI strategy<\/li>\n<li>Secrets for Lightning Apps<\/li>\n<li>CLI Commands for Lightning Apps<\/li>\n<li>Auto-wrapping for FSDP<\/li>\n<\/ul>\n<p>These four highlights in the Lightning 1.8 release are focused on making your machine learning development faster, easier, and more powerful than ever before. As models get larger, more complex, and require more resources to train, we all need the ability to train ever-expanding models with more flexible requirements for hardware without sacrificing speed and performance.<\/p>\n<p>&nbsp;<\/p>\n<h4 style=\"text-align: center;\">. . .<\/h4>\n<p>&nbsp;<\/p>\n<h2>Colossal-AI<\/h2>\n<p><a href=\"https:\/\/github.com\/hpcaitech\/ColossalAI\"><span style=\"color: #7345e4;\"><strong>Colossal-AI<\/strong><\/span><\/a>\u00a0focuses on improving efficiency when training large-scale AI models with billions of parameters. With the new Colossal-AI strategy in Lightning 1.8, you can train existing models like GPT-3 with up to half as many GPUs as usually needed. You can also train models up to twice as big with the same number of GPUs, saving you significant cost. Here is how you use it:<\/p>\n<script src=\"https:\/\/gist.github.com\/47fa1002beaa8ebf50054fbe395db0f0.js\"><\/script>\n<p>You can find Colossal-AI&#8217;s benchmarks with Lightning on GPT-2\u00a0<span style=\"color: #7345e4;\"><strong><a style=\"color: #7345e4;\" href=\"https:\/\/github.com\/hpcaitech\/ColossalAI-Pytorch-lightning\/tree\/main\/benchmark\">here<\/a><\/strong><\/span>.<\/p>\n<p>Under the hood, Colossal-AI implements different parallelism algorithms that are especially interesting for the development of SOTA transformer models:<\/p>\n<ul>\n<li>Data Parallelism<\/li>\n<li>Pipeline Parallelism<\/li>\n<li>1D, 2D, 2.5D, 3D Tensor Parallelism<\/li>\n<li>Sequence Parallelism<\/li>\n<li>Zero Redundancy Optimization<\/li>\n<\/ul>\n<p>Learn how to install and use Colossal-AI effectively with Lightning\u00a0<strong><span style=\"color: #7345e4;\"><a style=\"color: #7345e4;\" href=\"https:\/\/pytorch-lightning.readthedocs.io\/en\/latest\/advanced\/model_parallel.html?highlight=colossal-ai#colossal-ai\" rel=\"nofollow\">here<\/a><\/span><\/strong>.<\/p>\n<p><strong>NOTE:<\/strong>\u00a0This strategy is marked as\u00a0<strong>experimental<\/strong>. Stay tuned for more updates in the future.<\/p>\n<p>&nbsp;<\/p>\n<h4 style=\"text-align: center;\">. . .<\/h4>\n<p>&nbsp;<\/p>\n<h2>Secrets for Lightning Apps<\/h2>\n<p>Introducing <a href=\"https:\/\/lightning.ai\/lightning-docs\/glossary\/secrets.html\">encrypted secrets<\/a>, a feature requested by Lightning App users\u00a0\ud83c\udf89!<\/p>\n<p>Encrypted secrets allow you to securely pass private data to your apps, like API keys, access tokens, database passwords, or other credentials, without exposing them in your code.<\/p>\n<ol>\n<li>Add a secret to your Lightning account.<\/li>\n<li>Add an environment variable to your app to read the secret:<script src=\"https:\/\/gist.github.com\/beb6af2fbd061e6d09fc3cdb02c6e1ce.js\"><\/script><\/li>\n<li>Pass the secret to your app run with the following command:<script src=\"https:\/\/gist.github.com\/108478bb601a62dc39c5198e1e0fd741.js\"><\/script><\/li>\n<\/ol>\n<p>These secrets are encrypted and stored in the Lightning database. Nothing except your app can access the value.<\/p>\n<p><strong>NOTE:<\/strong>\u00a0This strategy is marked as\u00a0<strong>experimental<\/strong>. Stay tuned for more updates in the future.<\/p>\n<p>&nbsp;<\/p>\n<h4 style=\"text-align: center;\">. . .<\/h4>\n<p>&nbsp;<\/p>\n<h2>CLI Commands for Lightning Apps<\/h2>\n<p>Introducing CLI commands for apps (<strong><span style=\"color: #7345e4;\"><a style=\"color: #7345e4;\" href=\"https:\/\/github.com\/Lightning-AI\/lightning\/pull\/13602\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"\/Lightning-AI\/lightning\/pull\/13602\/hovercard\">#13602<\/a><\/span><\/strong>)!<\/p>\n<p>As a <span style=\"color: #7345e4;\"><strong><a style=\"color: #7345e4;\" href=\"https:\/\/lightning.ai\/apps\">Lightning App<\/a><\/strong><\/span> builder, if you want to easily create a CLI interface for users to interact with your app, then this is for you.<\/p>\n<p>Here is an example where users can dynamically create notebooks from the CLI.<\/p>\n<p>All you need to do is implement the\u00a0<code>configure_commands<\/code>\u00a0hook on the\u00a0<code>LightningFlow<\/code>:<\/p>\n<script src=\"https:\/\/gist.github.com\/34ea570c24d72796079e00cc17185d4b.js\"><\/script>\n<p>Once the app is running with\u00a0<code>lightning run app app.py<\/code>, you can connect to the app with the following command:<\/p>\n<script src=\"https:\/\/gist.github.com\/d30e47ce7e6cc7be19bd7cc930610ba1.js\"><\/script>\n<p>and run the command that was configured:<\/p>\n<script src=\"https:\/\/gist.github.com\/7cb238e2a3e7142fca6713c18144d171.js\"><\/script>\n<p><strong>NOTE:<\/strong>\u00a0This strategy is marked as\u00a0<strong>experimental<\/strong>. Stay tuned for more updates in the future.<\/p>\n<p>&nbsp;<\/p>\n<h4 style=\"text-align: center;\">. . .<\/h4>\n<p>&nbsp;<\/p>\n<h3>Auto-wrapping for FSDP Strategy<\/h3>\n<p>In <strong><span style=\"color: #7345e4;\"><a style=\"color: #7345e4;\" href=\"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/pytorch-lightning-1-7-release\/\">Lightning v1.7<\/a><\/span><\/strong>, we introduced an integration for PyTorch&#8217;s Fully Sharded Data Parallel (FSDP) in the form of our FSDP strategy, which allows you to train huge models with billions of parameters across hundreds of GPUs and machines:<\/p>\n<script src=\"https:\/\/gist.github.com\/3b5e1686c347cda88eaa175694fdee2c.js\"><\/script>\n<p>We are continuing to improve the support for this feature by adding automatic wrapping of layers for use cases where the model fits into CPU memory, but not into GPU memory (<span style=\"color: #7345e4;\"><strong><a style=\"color: #7345e4;\" href=\"https:\/\/github.com\/Lightning-AI\/lightning\/issues\/14383\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"\/Lightning-AI\/lightning\/pull\/14383\/hovercard\">#14383<\/a><\/strong><\/span>).<\/p>\n<p>Here are some examples:<\/p>\n<p><strong>Case 1:<\/strong>\u00a0Model is so large that it does not fit into CPU memory.<br \/>\nConstruct your layers in the\u00a0<code>configure_sharded_model<\/code>\u00a0hook and wrap the large ones you want to shard across GPUs:<\/p>\n<script src=\"https:\/\/gist.github.com\/2aef00508039b68c669ee0bceaaa91e8.js\"><\/script>\n<p><strong>Case 2:<\/strong>\u00a0Model fits into CPU memory, but not into GPU memory. In Lightning v1.8, you no longer need to do anything special here, as we can automatically wrap the layers for you using FSDP&#8217;s policy:<\/p>\n<div><script src=\"https:\/\/gist.github.com\/7e9ce94a16b4e55d16421eaacb00ad7a.js\"><\/script><\/div>\n<div>\n<p><strong>Case 3:<\/strong>\u00a0Model fits into GPU memory. No action required, use any strategy you want.<\/p>\n<p><strong>Note:<\/strong>\u00a0if you want to manually wrap layers for more control, you can still do that!<\/p>\n<p>Read more about FSDP and how layer wrapping works in our\u00a0<strong><span style=\"color: #7345e4;\"><a style=\"color: #7345e4;\" href=\"https:\/\/pytorch-lightning.readthedocs.io\/en\/latest\/advanced\/model_parallel.html#pytorch-fully-sharded-training\" rel=\"nofollow\">docs<\/a><\/span><\/strong>.<\/p>\n<p>&nbsp;<\/p>\n<h4 style=\"text-align: center;\">. . .<\/h4>\n<p>&nbsp;<\/p>\n<\/div>\n<h3>New Tuner Callbacks<\/h3>\n<p>In this release, we focused on Tuner improvements and introduced two new callbacks that can help you customize the batch size finder and learning rate finder as per your use case.<\/p>\n<h4>Batch Size Finder (<strong><span style=\"color: #7345e4;\"><a style=\"color: #7345e4;\" href=\"https:\/\/github.com\/PyTorchLightning\/pytorch-lightning\/pull\/11089\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"\/Lightning-AI\/lightning\/pull\/11089\/hovercard\">#11089<\/a><\/span><\/strong>)<\/h4>\n<ol>\n<li>You can customize the\u00a0<code>BatchSizeFinder<\/code>\u00a0callback to run at different epochs. This feature is useful while fine-tuning models since you can&#8217;t always use the same batch size after unfreezing the backbone.\n<div class=\"highlight highlight-source-python notranslate position-relative overflow-auto\">\n<script src=\"https:\/\/gist.github.com\/704f9fd0ab61d52a2ae6eb6ffdb01929.js\"><\/script>\n<\/div>\n<\/li>\n<li>Run batch size finder for\u00a0<code>validate<\/code>\/<code>test<\/code>\/<code>predict<\/code>.<script src=\"https:\/\/gist.github.com\/061598ef346d0b9dbadc62eb452e28e7.js\"><\/script><\/li>\n<\/ol>\n<p>&nbsp;<\/p>\n<h4 style=\"text-align: center;\">. . .<\/h4>\n<p>&nbsp;<\/p>\n<h4>Learning Rate Finder (<span style=\"color: #7345e4;\"><a style=\"color: #7345e4;\" href=\"https:\/\/github.com\/PyTorchLightning\/pytorch-lightning\/pull\/13802\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"\/Lightning-AI\/lightning\/pull\/13802\/hovercard\">#13802<\/a><\/span>)<\/h4>\n<p>You can now use the\u00a0<code>LearningRateFinder<\/code>\u00a0callback to run at different intervals. This feature is useful when fine-tuning models, for example.<\/p>\n<script src=\"https:\/\/gist.github.com\/423b1fdf3e360405cc57eec036f6749e.js\"><\/script>\n<p>&nbsp;<\/p>\n<h4 style=\"text-align: center;\">. . .<\/h4>\n<p>&nbsp;<\/p>\n<h3>LightningCLI Improvements<\/h3>\n<p>Even though the\u00a0<code>LightningCLI<\/code>\u00a0class is designed to help in the implementation of command line tools, there are instances when it might be more desirable to run directly from Python. In Lightning 1.8, you can now do this (<a href=\"https:\/\/github.com\/Lightning-AI\/lightning\/pull\/14596\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"\/Lightning-AI\/lightning\/pull\/14596\/hovercard\"><strong><span style=\"color: #7345e4;\">#14596<\/span><\/strong><\/a>):<\/p>\n<script src=\"https:\/\/gist.github.com\/60e083886031ea23c5c7bd336049446a.js\"><\/script>\n<p>Anywhere in your program, you can now call the CLI directly:<\/p>\n<script src=\"https:\/\/gist.github.com\/ac9da6a7b6f6054cbaf3eecf302dbe25.js\"><\/script>\n<p><span style=\"color: #7345e4;\"><strong><a style=\"color: #7345e4;\" href=\"https:\/\/pytorch-lightning.readthedocs.io\/en\/stable\/cli\/lightning_cli.html\" rel=\"nofollow\">Learn about all features of the LightningCLI!<\/a><\/strong><\/span><\/p>\n<p>&nbsp;<\/p>\n<h4 style=\"text-align: center;\">. . .<\/h4>\n<p>&nbsp;<\/p>\n<h3>Improvements to the SLURM Support<\/h3>\n<p>Multi-node training on a SLURM cluster has been supported since the inception of Lightning Trainer, and has seen several improvements over time thanks to many community contributions. And we just keep going! In this release, we&#8217;ve added two quality of life improvements:<\/p>\n<ul>\n<li>The preemption\/termination signal is now configurable (<span style=\"color: #7345e4;\"><strong><a style=\"color: #7345e4;\" href=\"https:\/\/github.com\/Lightning-AI\/lightning\/pull\/14626\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"\/Lightning-AI\/lightning\/pull\/14626\/hovercard\">#14626<\/a><\/strong><\/span>):<script src=\"https:\/\/gist.github.com\/02459c7e76449674914ae8216205473a.js\"><\/script><\/li>\n<\/ul>\n<ul>\n<li>Automatic requeuing of jobs now also works for array jobs (<a href=\"https:\/\/github.com\/Lightning-AI\/lightning\/pull\/15040\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"\/Lightning-AI\/lightning\/pull\/15040\/hovercard\"><strong><span style=\"color: #7345e4;\">#15040<\/span><\/strong><\/a>)! Array jobs are a convenient way to group\/launch several scripts at once. When the SLURM scheduler interrupts your jobs, Lightning will save a checkpoint, resubmit a new job, and, once the scheduler allocates resources, the Trainer will resume from where it left off.<\/li>\n<\/ul>\n<p>Read more about our SLURM integration\u00a0<strong><span style=\"color: #7345e4;\"><a style=\"color: #7345e4;\" href=\"https:\/\/pytorch-lightning.readthedocs.io\/en\/stable\/clouds\/cluster_advanced.html\" rel=\"nofollow\">here<\/a><\/span><\/strong>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>We&#8217;re excited to announce the release of Lightning 1.8 \u26a1\ufe0f (release notes). v1.8 of Lightning is the culmination of work from 52 contributors who have worked on features, bug fixes, and documentation for a total of over 550 commits since 1.7.0. Highlights Colossal-AI strategy Secrets for Lightning Apps CLI Commands for Lightning Apps Auto-wrapping for<a class=\"excerpt-read-more\" href=\"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/\" title=\"ReadLightning 1.8: Colossal-AI, Secrets for Apps, and more\">&#8230; Read more &raquo;<\/a><\/p>\n","protected":false},"author":16,"featured_media":5646850,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":"","_links_to":"","_links_to_target":""},"categories":[104],"tags":[96,121,45,97,51,62,120],"glossary":[],"acf":{"hide_from_archive":null,"content_type":null,"code_embed":null,"code_shortcode":null,"custom_styles":null,"sticky":null,"additional_authors":null,"mathjax":null,"default_editor":null,"sections":null,"show_table_of_contents":null,"table_of_contents":null,"tabs":null,"tab_group":null},"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v24.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Lightning 1.8: Colossal-AI, Secrets for Apps, and more<\/title>\n<meta name=\"description\" content=\"The release of Lightning 1.8 includes the new Colossal-AI strategy, secrets and CLI commands for Lightning Apps, and improvements to FSDP.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Lightning 1.8: Colossal-AI, Secrets for Apps, and more\" \/>\n<meta property=\"og:description\" content=\"The release of Lightning 1.8 includes the new Colossal-AI strategy, secrets and CLI commands for Lightning Apps, and improvements to FSDP.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/\" \/>\n<meta property=\"og:site_name\" content=\"Lightning AI\" \/>\n<meta property=\"article:published_time\" content=\"2022-11-01T18:14:01+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-11-02T19:24:39+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2022\/11\/Lightning-1.8.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1740\" \/>\n\t<meta property=\"og:image:height\" content=\"900\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"JP Hennessy\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2022\/11\/Lightning-1.8.png\" \/>\n<meta name=\"twitter:creator\" content=\"@LightningAI\" \/>\n<meta name=\"twitter:site\" content=\"@LightningAI\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"JP Hennessy\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/\"},\"author\":{\"name\":\"JP Hennessy\",\"@id\":\"https:\/\/lightning.ai\/pages\/#\/schema\/person\/2518f4d5541f8e98016f6289169141a6\"},\"headline\":\"Lightning 1.8: Colossal-AI, Secrets for Apps, and more\",\"datePublished\":\"2022-11-01T18:14:01+00:00\",\"dateModified\":\"2022-11-02T19:24:39+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/\"},\"wordCount\":1060,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/lightning.ai\/pages\/#organization\"},\"image\":{\"@id\":\"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2022\/11\/Lightning-1.8.png\",\"keywords\":[\"ai\",\"CLI\",\"lightning apps\",\"ml\",\"pytorch\",\"pytorch lightning\",\"secrets\"],\"articleSection\":[\"Lightning Releases\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/\",\"url\":\"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/\",\"name\":\"Lightning 1.8: Colossal-AI, Secrets for Apps, and more\",\"isPartOf\":{\"@id\":\"https:\/\/lightning.ai\/pages\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2022\/11\/Lightning-1.8.png\",\"datePublished\":\"2022-11-01T18:14:01+00:00\",\"dateModified\":\"2022-11-02T19:24:39+00:00\",\"description\":\"The release of Lightning 1.8 includes the new Colossal-AI strategy, secrets and CLI commands for Lightning Apps, and improvements to FSDP.\",\"breadcrumb\":{\"@id\":\"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/#primaryimage\",\"url\":\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2022\/11\/Lightning-1.8.png\",\"contentUrl\":\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2022\/11\/Lightning-1.8.png\",\"width\":1740,\"height\":900},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/lightning.ai\/pages\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Lightning 1.8: Colossal-AI, Secrets for Apps, and more\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/lightning.ai\/pages\/#website\",\"url\":\"https:\/\/lightning.ai\/pages\/\",\"name\":\"Lightning AI\",\"description\":\"The platform for teams to build AI.\",\"publisher\":{\"@id\":\"https:\/\/lightning.ai\/pages\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/lightning.ai\/pages\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/lightning.ai\/pages\/#organization\",\"name\":\"Lightning AI\",\"url\":\"https:\/\/lightning.ai\/pages\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/lightning.ai\/pages\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/02\/image-17.png\",\"contentUrl\":\"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/02\/image-17.png\",\"width\":1744,\"height\":856,\"caption\":\"Lightning AI\"},\"image\":{\"@id\":\"https:\/\/lightning.ai\/pages\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/x.com\/LightningAI\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/lightning.ai\/pages\/#\/schema\/person\/2518f4d5541f8e98016f6289169141a6\",\"name\":\"JP Hennessy\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/lightning.ai\/pages\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/28ade268218ae45f723b0b62499f527a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/28ade268218ae45f723b0b62499f527a?s=96&d=mm&r=g\",\"caption\":\"JP Hennessy\"},\"url\":\"https:\/\/lightning.ai\/pages\/author\/jplightning-ai\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Lightning 1.8: Colossal-AI, Secrets for Apps, and more","description":"The release of Lightning 1.8 includes the new Colossal-AI strategy, secrets and CLI commands for Lightning Apps, and improvements to FSDP.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/","og_locale":"en_US","og_type":"article","og_title":"Lightning 1.8: Colossal-AI, Secrets for Apps, and more","og_description":"The release of Lightning 1.8 includes the new Colossal-AI strategy, secrets and CLI commands for Lightning Apps, and improvements to FSDP.","og_url":"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/","og_site_name":"Lightning AI","article_published_time":"2022-11-01T18:14:01+00:00","article_modified_time":"2022-11-02T19:24:39+00:00","og_image":[{"width":1740,"height":900,"url":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2022\/11\/Lightning-1.8.png","type":"image\/png"}],"author":"JP Hennessy","twitter_card":"summary_large_image","twitter_image":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2022\/11\/Lightning-1.8.png","twitter_creator":"@LightningAI","twitter_site":"@LightningAI","twitter_misc":{"Written by":"JP Hennessy","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/#article","isPartOf":{"@id":"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/"},"author":{"name":"JP Hennessy","@id":"https:\/\/lightning.ai\/pages\/#\/schema\/person\/2518f4d5541f8e98016f6289169141a6"},"headline":"Lightning 1.8: Colossal-AI, Secrets for Apps, and more","datePublished":"2022-11-01T18:14:01+00:00","dateModified":"2022-11-02T19:24:39+00:00","mainEntityOfPage":{"@id":"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/"},"wordCount":1060,"commentCount":0,"publisher":{"@id":"https:\/\/lightning.ai\/pages\/#organization"},"image":{"@id":"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/#primaryimage"},"thumbnailUrl":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2022\/11\/Lightning-1.8.png","keywords":["ai","CLI","lightning apps","ml","pytorch","pytorch lightning","secrets"],"articleSection":["Lightning Releases"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/","url":"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/","name":"Lightning 1.8: Colossal-AI, Secrets for Apps, and more","isPartOf":{"@id":"https:\/\/lightning.ai\/pages\/#website"},"primaryImageOfPage":{"@id":"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/#primaryimage"},"image":{"@id":"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/#primaryimage"},"thumbnailUrl":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2022\/11\/Lightning-1.8.png","datePublished":"2022-11-01T18:14:01+00:00","dateModified":"2022-11-02T19:24:39+00:00","description":"The release of Lightning 1.8 includes the new Colossal-AI strategy, secrets and CLI commands for Lightning Apps, and improvements to FSDP.","breadcrumb":{"@id":"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/#primaryimage","url":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2022\/11\/Lightning-1.8.png","contentUrl":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2022\/11\/Lightning-1.8.png","width":1740,"height":900},{"@type":"BreadcrumbList","@id":"https:\/\/lightning.ai\/pages\/community\/lightning-releases\/lightning-1-8-release\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/lightning.ai\/pages\/"},{"@type":"ListItem","position":2,"name":"Lightning 1.8: Colossal-AI, Secrets for Apps, and more"}]},{"@type":"WebSite","@id":"https:\/\/lightning.ai\/pages\/#website","url":"https:\/\/lightning.ai\/pages\/","name":"Lightning AI","description":"The platform for teams to build AI.","publisher":{"@id":"https:\/\/lightning.ai\/pages\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/lightning.ai\/pages\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/lightning.ai\/pages\/#organization","name":"Lightning AI","url":"https:\/\/lightning.ai\/pages\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/lightning.ai\/pages\/#\/schema\/logo\/image\/","url":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/02\/image-17.png","contentUrl":"https:\/\/lightningaidev.wpengine.com\/wp-content\/uploads\/2023\/02\/image-17.png","width":1744,"height":856,"caption":"Lightning AI"},"image":{"@id":"https:\/\/lightning.ai\/pages\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/LightningAI"]},{"@type":"Person","@id":"https:\/\/lightning.ai\/pages\/#\/schema\/person\/2518f4d5541f8e98016f6289169141a6","name":"JP Hennessy","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/lightning.ai\/pages\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/28ade268218ae45f723b0b62499f527a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/28ade268218ae45f723b0b62499f527a?s=96&d=mm&r=g","caption":"JP Hennessy"},"url":"https:\/\/lightning.ai\/pages\/author\/jplightning-ai\/"}]}},"_links":{"self":[{"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/posts\/5646849"}],"collection":[{"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/users\/16"}],"replies":[{"embeddable":true,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/comments?post=5646849"}],"version-history":[{"count":0,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/posts\/5646849\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/media\/5646850"}],"wp:attachment":[{"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/media?parent=5646849"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/categories?post=5646849"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/tags?post=5646849"},{"taxonomy":"glossary","embeddable":true,"href":"https:\/\/lightning.ai\/pages\/wp-json\/wp\/v2\/glossary?post=5646849"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}