{"id":5646957,"date":"2022-12-01T13:33:28","date_gmt":"2022-12-01T18:33:28","guid":{"rendered":"https:\/\/lightning.ai\/pages\/?p=5646957"},"modified":"2022-12-01T13:33:28","modified_gmt":"2022-12-01T18:33:28","slug":"openais-new-chatbot-stable-diffusion-2-0-and-the-tldr-on-the-top-papers-at-neurips-2022","status":"publish","type":"post","link":"https:\/\/lightning.ai\/pages\/community\/openais-new-chatbot-stable-diffusion-2-0-and-the-tldr-on-the-top-papers-at-neurips-2022\/","title":{"rendered":"OpenAI\u2019s New Chatbot, Stable Diffusion 2.0, and the TLDR on the Top Papers at NeurIPS 2022"},"content":{"rendered":"

Researchers are testing the limits of language models and datasets while diffusion models continue to evolve. You can now deploy Stable Diffusion 2.0 on your own servers and have a surprisingly human conversation with OpenAI\u2019s ChatGPT. We\u2019ve had an awesome time at NeurIPS and are giving the TLDR on our favorite papers from the conference. Let\u2019s dive in!<\/em><\/strong><\/p>\n

Research Highlights: NeurIPS 2022 Edition<\/strong><\/h2>\n

13 Outstanding Papers, 2 in the Datasets & Benchmarks category, and a Test of Time paper were recognized with coveted awards this week by the NeurIPS 2022 organizing committee. NVIDIA research scientist\u00a0Jim Fan wrote a fantastic thread<\/a>\u00a0summarizing all of these papers, including his own!<\/p>\n

Here are the 5 catching our interest:<\/p>\n

\ud83c\udfc6 <\/span>Deepmind\u2019s\u00a0Chinchilla<\/a>, a new 70B language model that claims to outperform much bigger language models. This research shows that most LLMs in need of more of data and typically under-trained.<\/p>\n

\ud83c\udfc6 <\/span>Google\u2019s\u00a0Imagen<\/a>, a large text-to-image and super-resolution diffusion model that generates beautiful photorealistic images. This model uses a stronger text encoder than DALLE2 (T5-XXL) and was trained on enormous text corpus.<\/p>\n

\ud83c\udfc6 <\/span>Allen Institute for AI\u2019s\u00a0ProcTHOR<\/a>, a simulator for training embodied agents that procedurally creates a wide range of interactive, adaptable, and physics-capable homes.<\/p>\n

\ud83c\udfc6 <\/span>NVIDIA\u2019s\u00a0MineDojo<\/a>, an open framework to help the community develop generally capable agents. MineDojo features a simulator suite based on Minecraft, a massive internet database (YouTube, Wiki, Reddit), and a foundation model recipe for agents.<\/p>\n

\ud83c\udfc6 <\/span>LAION\u2019s\u00a0LAION-5B<\/a>, an open dataset that gave birth to Stable Diffusion made up of 5.85 billion CLIP-filtered image-text pairs to democratize multimodal foundation models.<\/p>\n

ML Engineering Highlights<\/h2>\n

\ud83d\udde3\ufe0f OpenAI introduced\u00a0ChatGPT<\/a>, a model that aims for a more human and conversational interaction online. ChatGPT can respond to follow-up inquiries, acknowledge mistakes, refute unfounded assumptions, and reject inappropriate requests with a dialogue format. Their model was trained using using Reinforcement Learning from Human Feedback (RLHF), similar to its sibling model,\u00a0InstructGPT<\/a>.<\/p>\n

\ud83d\udcc4 <\/span>AWS\u00a0unveiled\u00a0Amazon DataZone<\/a>\u00a0at its re:Invent conference, a new data management service that can assist businesses in cataloguing, discovering, sharing, and managing their data. By leveraging machine learning, the service seeks to assist businesses in creating these data catalogs and creating the metadata necessary to make the data searchable.<\/p>\n

\ud83d\udea2 <\/span>SeeByte<\/a>, the current leader in software for uncrewed maritime systems, has been awarded an extended contract to support the US Navy\u2019s autonomous systems and machine learning capabilities. SeeByte will deliver engineering, technical support, training, and simulation services under this contract which has a maximum 10-year duration and a total potential value of $87M.<\/p>\n

Open Source Highlights<\/h2>\n

\ud83e\udd16 <\/span>Petoi<\/a>, a toy company that makes robots for kids, released a programmable robot dog named Bittle. Designed for ages 14+, Bittle comes programmed with a few starter tricks like walk and trot and has an open source platform that allows users to add a\u00a0Raspberry Pi or attach Grove sensors to extend the robot\u2019s capabilities.<\/p>\n

\ud83d\udd12 <\/span>Google open sourced\u00a0KataOS<\/a>, an operating system developed to control the security and privacy of data acquired by smart devices. KataOS seeks to provide a platform that protects user’s privacy and is implemented almost entirely in\u00a0Rust<\/strong><\/a>, which Google argues provides a strong starting point for software security by eliminating entire classes of bugs, such as off-by-one errors and buffer overflows.<\/p>\n

 <\/p>\n

Lightning AI Highlights<\/h2>\n

\u26a1 Our team has been having a blast at NeurIPS this week in New Orleans! From our happy hour to the packed social where we discussed moving from academia to industry\u2013 we have loved connecting with our community in-person once again. Thanks to all those that stopped by our booth, grabbed swag and said hi!\"\"\"\"<\/a><\/p>\n

\u26a1 We released our Stable Diffusion (2.0) Lightning component that lets you run your own\u00a0Stable Diffusion 2.0<\/a>\u00a0server in ~5 min in just 4 easy steps that our lead educator\u00a0Sebastian Raschka<\/a> walks through in this thread<\/a>.<\/p>\n

 <\/p>\n

Don\u2019t Miss the Submission Deadline<\/h2>\n