{"id":5646684,"date":"2022-10-05T12:17:18","date_gmt":"2022-10-05T16:17:18","guid":{"rendered":"https:\/\/lightning.ai\/pages\/?p=5646684"},"modified":"2022-10-05T12:17:18","modified_gmt":"2022-10-05T16:17:18","slug":"iclr-releases-submissions-for-2023-the-white-house-pens-an-ai-bill-of-rights-and-metas-make-a-video-excites-creatives","status":"publish","type":"post","link":"https:\/\/lightning.ai\/pages\/blog\/iclr-releases-submissions-for-2023-the-white-house-pens-an-ai-bill-of-rights-and-metas-make-a-video-excites-creatives\/","title":{"rendered":"ICLR Releases Submissions for 2023, The White House Pens an \u201cAI Bill of Rights\u201d and Meta\u2019s Make-A-Video Excites Creatives"},"content":{"rendered":"

This week, the announcement of several text-to image, voice and video generation models are delighting researchers and creatives alike. ICLR makes their paper submissions for 2023 public, Microsoft warns of North Korean hackers, the White House unveils the first \u201cAI Bill of Rights\u201d and a bipedal robot sets a Guinness World Record. Let\u2019s dive in!<\/strong><\/p>\n

ICLR 2023 Submission Highlights<\/h2>\n

The submissions for the 11th International Conference on Learning Representations (ICLR 2023)<\/strong> have been released<\/a> and January 20, 2023 marked as their final date of decision. Here are a few of the submissions piquing our interest so far:<\/p>\n

\"\"<\/p>\n

DREAMFUSION: TEXT-TO-3D USING 2D DIFFUSION<\/a>:<\/strong> Text-to-3D synthesis utilizing a pretrained 2D text-to-image diffusion model without the need for large-scale datasets of labeled 3D data.<\/p>\n

QUANTUM REINFORCEMENT LEARNING:<\/strong><\/a> A proposal to combine quantum theory and reinforcement learning (RL) to create an algorithm that claims to greatly aid the fields of finance, industrial simulation, mechanical control, quantum communication, and quantum circuit optimization.<\/p>\n

PHENAKI: VARIABLE LENGTH VIDEO GENERATION FROM OPEN DOMAIN TEXTUAL DESCRIPTIONS<\/a>:<\/strong> A model for generating videos that can be multiple minutes long from text prompts that can change over time.<\/p>\n

Research Highlights<\/h2>\n

\"\"<\/p>\n

\ud83d\udcf9 <\/span>Meta AI introduced Make-A-Video<\/span><\/a>, an AI system that generates videos from text. Unlike existing models, Make-A-Video c<\/span>laims to negate the need to learn visual and multimodal representations from scratch, doesn\u2019t require paired text-video data and the videos it generates inherit the expansiveness (diversity in aesthetic, fantastical depictions, etc.) of modern image generation models. Make-A-Video builds on Meta AI’s recent advancements in generative technology research and has the potential to open new doors for creators and artists alike.<\/p>\n

\ud83c\udfa4 <\/span>Researchers from The Hebrew University of Jerusalem introduced AudioGen<\/a> for textually guided audio generation. AudioGen produces audio samples based on descriptive text captions<\/a> and claims to surmount typical text-to-audio difficulties such as being able to distinguish between sounds, rough recording conditions and insufficient text annotations. The model outperforms the evaluated baselines across both objective and subjective metrics and will be available to the public soon.<\/p>\n

\ud83d\uddbc\ufe0f <\/span>Researchers in China introduced ERNIE-ViL 2.0<\/a>, a multi-view contrastive learning framework for image-text pre-training. Pre-trained with 29M publicly accessible datasets, ERNIE-ViL 2.0 claims to surpass current Vision-Language Pre-trained (VLP) models that are only able to construct a single view by being able to construct multiple<\/em> views within each modality to learn the intra-modal correlation for enhancing the single-modal representation. Their pre-trained models are now available for public use.<\/a><\/p>\n

ML Engineering Highlights<\/h2>\n

\"\"<\/p>\n

\ud83d\udcdc <\/span>The White House unveiled a blueprint for an \u201cAI Bill of Rights\u201d<\/a> to outline how the US government, tech companies and citizens should work together to hold AI accountable. The bill seeks to provide practical guidance to government agencies and a call to action for tech companies to build stronger privacy protections for their AI products.<\/p>\n

\ud83e\uddbf\u00a0<\/span><\/span>Cassie, a bipedal robot developed by ML engineers at Oregon State University, just set a new Guinness World Record<\/a> by running 100 meters in just 24.73 seconds. Operating with no cameras or external sensors, Cassie was trained for the equivalent of a full year in a simulation environment, compressed to a week through a computing technique known as parallelization. “This may be the first bipedal robot to learn to run, but it won’t be the last,\u201d says OSU robotics professor Jonathan Hurst.<\/p>\n

\ud83d\udc53 <\/span>Google is using generative adversarial networks (GANs) to allow Google Lens users to more easily translate text that appears in the real world<\/a>. Currently, any text that\u2019s converted into a different language uses colored blocks to mask bits of the background image. This new release removes these blocks and swaps the text outright to make the translated image look as though it was part of the original asset. The new model seems to point to Google\u2019s plans to further invest in the creation of new AR glasses that would allow people to translate street signs and storefront in the blink of an eye.<\/p>\n

Open Source Highlights<\/h2>\n

\ud83e\uddf0<\/span> Meta AI released\u00a0AITemplate (AIT)<\/a>, a unified inference system with separate acceleration back ends for both AMD and NVIDIA GPU hardware. This new set of open source tools have the potential to make it simpler for developers to switch between various underlying chips.<\/p>\n

\u26a0\ufe0f <\/span>Microsoft announced<\/a> that hackers backed by the North Korean government are weaponizing well-known open source software in an ongoing campaign that has already compromised “numerous” organizations in the media, defense and aerospace, and IT services industries. By posing as job recruiters, ZINC, Microsoft’s name for the threat actor group, is infecting employee work environments by coercing individuals into installing applications with \u201cobjectives focused on espionage, data theft, financial gain, and network destruction\u201d.<\/p>\n

Tutorial of the Week<\/h2>\n

\ud83d\udcaa Want to enable GPU-accelerated training on Apple Silicon in PyTorch? This tutorial<\/a>\u2019s got you covered if you want to train models faster with Apple\u2019s M1 or M2 chips.<\/p>\n

Community Spotlight<\/h2>\n

Want your work featured? Contact us on Slack<\/a> or email us at community@lightning.ai<\/a><\/em><\/p>\n

\ud83d\udca1<\/span>This repo<\/a> features super resolution algorithms implemented with Lightning, and supports several models, including DDBPN<\/a> and SRResNet<\/a>. Super-resolution models are used to intelligently enhance low-resolution images.<\/p>\n

\ud83c\udf03<\/span>O\u011fuzcan Turan<\/a>\u2019s Light Side of the Night<\/a> is a low-light image enhancement library that consists of state-of-the-art deep learning methods. We can\u2019t decide which part of this repo we love more: the ample Star Wars references, or the way this work enhances images captured in low-light environments.<\/p>\n

\ud83d\ude4fWe just closed the last PR resolving typing in the PyTorch portion of Lightning<\/a>! A big thank you to everyone who contributed to this issue. As always, keep an eye out for issues like these, which are a great way to make your first contribution to open-source projects.<\/p>\n

Don\u2019t Miss the Submission Deadline<\/h2>\n

AISTATS 2023<\/a>:<\/strong> The 26th International Conference on Artificial Intelligence and Statistics. Spring 2023. (Location TBD). Paper Submission Deadline: Fri Oct 14 2022 04:59:59 GMT-0700<\/strong><\/p>\n

AAMAS 2023<\/a>:<\/strong> The 22nd International Conference on Autonomous Agents and Multiagent Systems. May 29 – June 2, 2023. (London, UK) Paper Submission Deadline: Sat Oct 29 2022 04:59:59 GMT-0700<\/strong><\/p>\n

CVPR 2023:<\/a><\/strong>\u00a0The IEEE\/CVF Conference on Computer Vision and Pattern Recognition. Jun 18-22, 2023. (Vancouver, Canada).\u00a0Paper Submission Deadline:\u00a0Fri Nov 11 2022 23:59:59 GMT-0800<\/strong><\/p>\n

Upcoming Conferences<\/h2>\n