{"id":5646731,"date":"2022-10-20T11:50:14","date_gmt":"2022-10-20T15:50:14","guid":{"rendered":"https:\/\/lightning.ai\/pages\/?p=5646731"},"modified":"2022-10-20T14:49:47","modified_gmt":"2022-10-20T18:49:47","slug":"steve-jobs-is-resurrected-meta-is-translating-unwritten-languages-and-ai-is-running-for-office","status":"publish","type":"post","link":"https:\/\/lightning.ai\/pages\/community\/steve-jobs-is-resurrected-meta-is-translating-unwritten-languages-and-ai-is-running-for-office\/","title":{"rendered":"Steve Jobs is Resurrected, Meta Is Translating Unwritten Languages and AI is Running for Office"},"content":{"rendered":"

Researchers continue to push the limits of diffusion models, Steve Jobs returns for a conversation with Joe Rogan and Jack Dorsey\u2019s new decentralized social network is open for beta users. Let\u2019s dive in!<\/em><\/h3>\n

Featured Story<\/h2>\n

Meta released the first speech-to-speech translation system<\/a> for languages that are primarily spoken rather than written\u2013 starting with Hokkien, a primarily oral language spoken within the Chinese diaspora. Despite the fact that approximately 3,500 languages are largely spoken without a common writing system, AI-powered voice translation has primarily concentrated on written languages. Meta seeks to bridge this gap and \u201cbreak down language barriers in both the physical world and the metaverse to encourage connection and mutual understanding\u201d.<\/p>\n

\u201cFor interactions, it will enable people from around the world to communicate with each other more fluidly, making the social graph more interconnected. In addition, using artificial speech translation for content allows you to easily localize content for consumption in multiple languages.\u201d<\/em> – William Falcon, CEO of Lightning AI<\/p>\n

\"\"<\/a><\/h2>\n

Research Highlights<\/h2>\n

\ud83c\udfa8 <\/span>Researchers from Google, Technion and Weizmann Institute of Science released Imagic<\/span><\/a>, a text-based real image editor for diffusion models. Imagic claims to be the first method to apply complex (e.g., non-rigid) text-guided semantic edits to a <\/span>single<\/span> real image.<\/span> Most text-conditioned image editing methods are restricted to specific editing types, apply to synthetically generated images, or require multiple<\/span> input images of a common object. Imagic overcomes these limitations by producing a text embedding that aligns with both the input image and the target text, while fine-tuning the diffusion model to capture the image-specific appearance. This results in being able to transform an image of a sitting dog into an image of a jumping one without any extra inputs.<\/span><\/p>\n

\"\"<\/span><\/a><\/p>\n

\ud83e\ude99 <\/span>Researchers from MIT developed a new reparameterization-based methodology<\/span><\/a> that allows for automatic differentiation (AD) of programs with discrete randomness. Due to the enhanced efficiency provided by gradient-based optimization, automatic differentiation (AD), a method for creating new programs that compute the derivative of an existing program, has become widely used in deep learning and scientific computing. These systems currently face a challenge when dealing with programs that have discrete stochastic behaviors that are controlled by distribution parameters, such as flipping a coin with a probability of being heads. The MIT researchers <\/span><\/a>proposed a new approach that claims to provide a low-variance, unbiased estimator that is just as automated as conventional AD techniques.<\/span><\/p>\n

\ud83d\udc2f Researchers from Google, Carnegie Mellon and UC Irvine introduced RARR<\/span><\/a>, a model that automatically researches and revises the output of any language model to fix \u201challucinations\u201d while providing citations for each sentence. The development of RARR, which stands for Retrofit Attribution using Research and Revision, was motivated by the difficulty that current language models have in producing trustworthy outputs due to a lack of built-in mechanisms for attribution to external evidence. RARR claims to enhance this attribution while otherwise retaining the original input to a far greater degree than previously examined edit models when applied to the output of various state-of-the-art language models on a variety of generating tasks.<\/p>\n

<\/h2>\n

<\/h2>\n

ML Engineering Highlights<\/h2>\n

\ud83c\udf99\ufe0f Play.ht<\/span>, a Dubai-based voice generator, created an entirely AI-generated\u00a0podcast between Steve Jobs and Joe Rogan<\/span><\/a>. Using fine-tuned language models, the fictional interview covers topics such as\u00a0Apple’s success, Jobs\u2019 religious beliefs and experience with LSD. The 20-minute conversation is the first episode of a podcast series where listeners can vote on which character they want to hear from next.<\/span><\/p>\n

\ud83d\uddf3\ufe0f The Synthetic Party<\/span><\/a>, a new political party in Denmark, has its eyes on the elections in November and bases all of its policies on its AI persona, “Leader Lars\u201d. The bot was developed by the artist collective Computer Lars<\/span><\/a> and the nonprofit art and technology organization MindFuture Foundation<\/span><\/a>. The policies of Danish fringe parties over the last 40 years were used to program Lars, who also collects information via chats with people on Discord. According to party inventor Asker Staunaes, the AI becomes more refined the more people use it and that there are humans on the ballot who are committed to acting as a medium for the AI.<\/span><\/p>\n

\ud83d\udd25 Pano AI<\/span><\/a>, a California-based company that uses deep learning\u00a0and computer vision to detect wildfire events in real time is expanding its coverage in Montana<\/span><\/a>. The expansion comes after an effective implementation during last year\u2019s fire season when Pano AI’s software assisted a Montana fire department in promptly locating and containing a wildfire at just 74 acres. Using AI along with satellites and ultra HD panoramic cameras, Pano AI will continue to detect, assess and contain new wildfires before they grow large enough to endanger lives and property.<\/p>\n

<\/h2>\n

Open Source Highlights<\/h2>\n

\ud83d\uddc3\ufe0f Google Vizier<\/span><\/a>, the company\u2019s internal service for performing black-box optimization, is now open source. Vizier has seen thousands of monthly users on the company’s research and production sides since its debut in 2017. Google says that since its introduction, the tool has completed millions of black box optimization tasks, saving a significant amount of processing and labor resources. Google published the open source Vizier as a standalone Python implementation of the Google Vizier API. Users can optimize their objective function using a user API, while developers can create new optimization methods using a developer API.<\/p>\n

\ud83c\udf88Bluesky,<\/span><\/a> a decentralized social network initiative created by former Twitter CEO Jack Dorsey, announced its beta waitlist this week. The\u00a0social networking platform built with decentralized technologies will provide what the development team refers to as a “federated social network,” which will enable users to manage their own data and communication. As an open-source network, Bluesky will be a fully interoperable network that will work with any system built on top of it. <\/span><\/p>\n

\ud83c\udf5d The world’s largest pasta producer, Barilla, released the design for an open source device<\/a> that will help you reduce your meal\u2019s CO\u2082 emissions by up to 80% through passively cooking your pasta. The device consists of an Arduino Nano 33 BLE, an NTC probe, and a few passive parts housed in a 3D-printed enclosure. When it senses the water is boiling, the device notifies your phone that your pasta is done being passively cooked before pulling it out.<\/p>\n

<\/h2>\n

Tutorial of the Week<\/h2>\n

Databases are a fundamental piece of software services. Users rely on them to guarantee the security and integrity of their data, as well as other pertinent details such as assets or transaction records. Learn how to use Redis in a machine learning application with our tutorial here.<\/span><\/a><\/p>\n

 <\/p>\n

Community Spotlight<\/h2>\n

Want your work featured? Contact us on Slack<\/a> or email us at community@lightning.ai<\/a><\/em><\/p>\n

\u26a1Pooya Mohammadi<\/span><\/a>\u2019s project, a PyTorch implementation of the CRNN model<\/span><\/a>, shows you how to train a license plate recognition model with Lightning. The repo also includes a sample Persian dataset made available by the Amirkabir University of Technology.<\/p>\n

\u26a1 This repo by\u00a0Moeez Malik<\/a>\u00a0contains code that can be used to\u00a0detect tables in PDF documents<\/a>\u00a0by using PyTorch and Lightning. It breaks down information about training networks, the dataset used, checkpoints, logging, and evaluation.<\/p>\n

\u26a1You can now display your Lightning training logs<\/a>\u00a0using\u00a0Rich<\/a>, a Python library for visualizing information in the terminal, with Perceval Wajsburt\u2019s project. It works in Jupyter notebooks and in a command line, and integrates easily with Lightning.<\/p>\n

 <\/p>\n

Community Spotlight<\/h2>\n

\ud83c\udf93 Attending NeurIPS this year? Interested in transition from academia to industry? Stop by our social, hosted by two of Lightning\u2019s very own team members with experience making this transition.\u00a0Learn more here.<\/a><\/p>\n

\u26a1Join Thomas Chaton, one of our tech leads, as he hosts\u00a0a workshop on building tailored machine learning apps with Lightning<\/a>. He\u2019ll be focusing on reusable templates for training, servicing, UI, monitoring, autoscaling, and altering your ML solution. (October 25 at 8am PT)<\/p>\n

\ud83c\udfa8 If you\u2019ve used social media in the past six months, you\u2019ve likely come across some impressive text-to-image generation machine learning models like DALL-E 2 or Stable Diffusion that can create stunning images in seconds, just from a few words. Join Aniket Maurya, one of our developer advocates,\u00a0as he hosts a livestream<\/a>\u00a0exploring what these diffusion models are, and how you can deploy your own text-to-image generator with them,\u00a0like we did with Muse.<\/a><\/p>\n

 <\/p>\n

Don\u2019t Miss the Submission Deadline<\/h2>\n