Better Language Models Without Massive Compute

Favorite Posted by Jason Wei and Yi Tay, Research Scientists, Google Research, Brain Team In recent years, language models (LMs) have become more prominent in natural language processing (NLP) research and are also becoming increasingly impactful in practice. Scaling up LMs has been shown to improve performance across a range

Read More
Shared by Google AI Technology November 29, 2022

Google at NeurIPS 2022

Favorite Posted by Cat Armato, Program Manager, Google This week marks the beginning of the 36th annual Conference on Neural Information Processing Systems (NeurIPS 2022), the biggest machine learning conference of the year, which is being held in New Orleans, LA. NeurIPS 2022 will be held in person with additional

Read More
Shared by Google AI Technology November 28, 2022

Conversation Summaries in Google Chat

Favorite Posted by Mohammad Saleh, Software Engineer, Google Research, Brain Team, and Yinan Wang, Software Engineer, Google Workspace Information overload is a significant challenge for many organizations and individuals today. It can be overwhelming to keep up with incoming chat messages and documents that arrive at our inbox everyday. This

Read More
Shared by Google AI Technology November 18, 2022

The Data Cards Playbook: A Toolkit for Transparency in Dataset Documentation

Favorite Posted by Mahima Pushkarna, Senior Interaction Designer, and Andrew Zaldivar, Senior Developer Relations Engineer, Google Research As machine learning (ML) research moves toward large-scale models capable of numerous downstream tasks, a shared understanding of a dataset’s origin, development, intent, and evolution becomes increasingly important for the responsible and informed

Read More
Shared by Google AI Technology November 17, 2022

Mixture-of-Experts with Expert Choice Routing

Favorite Posted by Yanqi Zhou, Research Scientist, Google Research Brain Team The capacity of a neural network to absorb information is limited by the number of its parameters, and as a consequence, finding more effective ways to increase model parameters has become a trend in deep learning research. Mixture-of-experts (MoE),

Read More
Shared by Google AI Technology November 16, 2022

A conversation with Thomas Friedman about AI

Favorite Technology has an unmistakable impact on society — the way we work, learn and play have all changed significantly over the past decade. As SVP of Technology and Society, part of my work at Google is connecting people and ideas to help shape the future of our most ambitious

Read More
Shared by Google AI Technology November 15, 2022