Enhancing Backpropagation via Local Loss Optimization

Favorite Posted by Ehsan Amid, Research Scientist, and Rohan Anil, Principal Engineer, Google Research, Brain Team While model design and training data are key ingredients in a deep neural network’s (DNN’s) success, less-often discussed is the specific optimization method used for updating the model parameters (weights). Training DNNs involves minimizing

Read More
Shared by Google AI Technology July 29, 2022

Look and Talk: Natural Conversations with Google Assistant

Favorite Posted by Tuan Anh Nguyen, Staff Software Engineer, Google Assistant, and Sourish Chaudhuri, Staff Software Engineer, Google Research In natural conversations, we don’t say people’s names every time we speak to each other. Instead, we rely on contextual signaling mechanisms to initiate conversations, and eye contact is often all

Read More
Shared by Google AI Technology July 27, 2022

ML-Enhanced Code Completion Improves Developer Productivity

Favorite Posted by Maxim Tabachnyk, Staff Software Engineer and Stoyan Nikolov, Senior Engineering Manager, Google Research The increasing complexity of code poses a key challenge to productivity in software engineering. Code completion has been an essential tool that has helped mitigate this complexity in integrated development environments (IDEs). Conventionally, code

Read More
Shared by Google AI Technology July 26, 2022

Training Generalist Agents with Multi-Game Decision Transformers

Favorite Posted by Winnie Xu, Student Researcher and Kuang-Huei Lee, Software Engineer, Google Research, Brain Team Current deep reinforcement learning (RL) methods can train specialist artificial agents that excel at decision-making on various individual tasks in specific environments, such as Go or StarCraft. However, little progress has been made to

Read More
Shared by Google AI Technology July 21, 2022

Google at ICML 2022

Favorite Posted by Cat Armato, Program Manager, University Relations Google is a leader in machine learning (ML) research with groups innovating across virtually all aspects of the field, from theory to application. We build machine learning systems to solve deep scientific and engineering challenges in areas of language, music, visual

Read More
Shared by Google AI Technology July 18, 2022

Towards Reliability in Deep Learning Systems

Favorite Posted by Dustin Tran and Balaji Lakshminarayanan, Research Scientists, Google Research Deep learning models have made impressive progress in vision, language, and other modalities, particularly with the rise of large-scale pre-training. Such models are most accurate when applied to test data drawn from the same distribution as their training

Read More
Shared by Google AI Technology July 14, 2022

Revisiting Mask Transformer from a Clustering Perspective

Favorite Posted by Qihang Yu, Student Researcher, and Liang-Chieh Chen, Research Scientist, Google Research Panoptic segmentation is a computer vision problem that serves as a core task for many real-world applications. Due to its complexity, previous work often divides panoptic segmentation into semantic segmentation (assigning semantic labels, such as “person”

Read More
Shared by Google AI Technology July 12, 2022

​​Deep Hierarchical Planning from Pixels

Favorite Posted by Danijar Hafner, Student Researcher, Google Research Research into how artificial agents can make decisions has evolved rapidly through advances in deep reinforcement learning. Compared to generative ML models like GPT-3 and Imagen, artificial agents can directly influence their environment through actions, such as moving a robot arm

Read More
Shared by Google AI Technology July 8, 2022