{"id":5646903,"date":"2022-11-17T17:35:43","date_gmt":"2022-11-17T22:35:43","guid":{"rendered":"https:\/\/lightning.ai\/pages\/?p=5646903"},"modified":"2022-11-17T17:42:36","modified_gmt":"2022-11-17T22:42:36","slug":"nvidia-and-microsoft-team-up-to-buildan-ai-supercomputer-meta-releases-galactica-and-sony-patents-a-new-ml-system","status":"publish","type":"post","link":"https:\/\/lightning.ai\/pages\/community\/nvidia-and-microsoft-team-up-to-buildan-ai-supercomputer-meta-releases-galactica-and-sony-patents-a-new-ml-system\/","title":{"rendered":"NVIDIA and Microsoft Team Up To Build an AI Supercomputer, Meta Releases Galactica and Sony Patents a New ML System"},"content":{"rendered":"

Robot dogs and LLMs alike are gaining agility and sophistication. Meta AI\u2019s Galactica is summarizing scientific knowledge and NVIDIA and Microsoft team up to to create one of the most potent AI supercomputers in the world. Let\u2019s dive in!<\/strong><\/em><\/p>\n

Research Highlights<\/h2>\n

\ud83d\udcab <\/span>A large language model for science called Galactica<\/a>\u00a0was unveiled by Meta AI researchers. The model was birthed our of the frustration researchers feel when combing through the massive volume of scientific knowledge online. The model was trained on a large scientific corpus of papers, reference material, knowledge bases and many other sources. Galactica can respond to simple text commands to summarize academic literature, resolve mathematical issues, create Wiki articles, and more.<\/p>\n

\ud83d\udc15\u00a0<\/span><\/span> An\u00a0end-to-end locomotion system<\/a>\u00a0capable of navigating stairs, curbs, stepping stones, and gaps was introduced by researchers from Carnegie Mellon and UC Berkeley. Their medium-sized quadruped robot only uses a single onboard RGBD camera employing ecocentric vision. More videos of the \u201crobot dog\u201d can be\u00a0seen here<\/a>.<\/p>\n

\ud83d\udde3\ufe0f <\/span>Researchers at UNC Chapel Hill\u00a0studied the relationship between the knowledge memorized by large language models (LLMs) and the information in their pre-training datasets.<\/a>\u00a0Their findings showed that a LLMs ability to answer a fact-based question relates to how many documents associated with that question were seen during pre-training. Their results claim to demonstrate a strong correlational and causal relationships between accuracy and relevant document count for numerous question answering datasets, pre-training corpora and model sizes.<\/p>\n

 <\/p>\n

<\/h2>\n

ML Engineering Highlights<\/h2>\n

\ud83c\udfae\u00a0<\/span> Sony’s latest patent<\/a>\u00a0describes an artificial intelligence system that would take game footage and enhance it with auto-generated input captions, even without access to the actual controller metadata from the recorded sessions. As such, the technology would hinge on robustly trained machine learning models which would have to be taught gameplay mechanics on a per-game basis.<\/p>\n

\ud83d\udc97 <\/span>In order to more\u00a0effectively identify harmful chat<\/a>\u00a0in multiplayer video games, Ubisoft and Riot Games have joined forces to share machine learning data. This is the first time that shared machine learning data has been used in a cross-industry research project. In essence, each company has created their own deep learning neural networks. These systems employ AI to automatically scan in-game text chat and identify instances where players are acting negatively toward one another.<\/p>\n

\ud83d\udcbb <\/span>In order to help businesses train, deploy, and scale AI, including large, cutting-edge models, NVIDIA and Microsoft\u00a0announced a multi-year partnership<\/a>\u00a0to create one of the most potent AI supercomputers in the world. This supercomputer will be powered by Microsoft Azure’s supercomputing infrastructure in conjunction with NVIDIA GPUs, networking, and full stack AI software.<\/p>\n

 <\/p>\n

Open Source Highlights<\/h2>\n

\ud83d\udcf7 <\/span>Do you have sentimental low-res photos that you\u2019d like to restore?\u00a0GFPGAN<\/a>, a free open source software claims to improve the resolution and beauty of these images in addition to being able to fix some damage. GFPGAN is made for face restoration and uses a pre-trained GAN model to convert low-quality images to high-resolution<\/p>\n

\u23f1\ufe0f <\/span>TheGist<\/a>\u00a0released a product that uses AI to scan Slack messages and provide a personalized summary, aiming to filter out noise. Their Slack app can provide summaries of both channels and threads, covering time scales from one day to several weeks. Beyond this, it can summarize particularly long individual Slack messages to help folks<\/p>\n

\u2696\ufe0f <\/span>A class-action lawsuit<\/a>\u00a0alleging that AI-code-generating software Copilot violates US copyright laws named OpenAI, Microsoft, and its subsidiary GitHub as the guilty party. Because GitHub’s Copilot generative AI system is trained on a wealth of licensed open-source code scraped from the internet with no credit given to the authors, the lawsuit accuses the trio of significant piracy responsibility.<\/p>\n

Community Spotlight<\/h2>\n

Want your work featured? Contact us on Slack<\/a> or email us at community@lightning.ai<\/a><\/em><\/p>\n

\u26a1 Always wanted to contribute to an open-source project but not sure where to start? Check out our\u00a0good first issue label on GitHub<\/a>\u00a0for issues that our team has selected as good choices for newcomers to open-source work.<\/p>\n

\u26a1 This merged PR<\/a>\u00a0adds an\u00a0ax argument to\u00a0trainer.tuner.lr_find().plot(), thus allowing users to provide an optional matplotlib Axes object for plotting the LR finder graph. Shoutout to community member\u00a0Bipin Krishanan<\/a>\u00a0for landing this!<\/p>\n

\u26a1 This merged PR<\/a>\u00a0addresses the issues proposed\u00a0here<\/a>, related to unsupported configurations in the Lightning Trainer. Shoutout to community member\u00a0Atharva Pathak<\/a>\u00a0for landing this!<\/p>\n

 <\/p>\n

Lightning AI Highlights<\/h2>\n

\u26a1 Have you stopped by\u00a0our docs<\/a>\u00a0recently? \ud83d\udc40\u00a0Rumor has it we\u2019ve been making some changes so that you can understand the benefits of building with Lightning quickly and easily. They\u2019re more interactive than ever before \u2014 you can engage with the Lightning platform in a single click.\u00a0Check them out<\/a>!<\/p>\n

\u26a1 We\u2019re hiring! Check out our current openings\u00a0here<\/a>\u00a0\u2014 we\u2019ve got positions open in Engineering, Marketing, and Product & Design.<\/p>\n

Don\u2019t Miss the Submission Deadline<\/h2>\n