Re-weighted gradient descent via distributionally robust optimization

Favorite Ramnath Kumar, Pre-Doctoral Researcher, and Arun Sai Suggala, Research Scientist, Google Research Deep neural networks (DNNs) have become essential for solving a wide range of tasks, from standard supervised learning (image classification using ViT) to meta-learning. The most commonly-used paradigm for learning DNNs is empirical risk minimization (ERM), which

Read More
Shared by Google AI Technology September 28, 2023

Google Research embarks on effort to map a mouse brain

Favorite Posted by Michał Januszewski, Research Scientist, Google Research The human brain is perhaps the most computationally complex machine in existence, consisting of networks of billions of cells. Researchers currently don’t understand the full picture of how glitches in its network machinery contribute to mental illnesses and other diseases, such

Read More
Shared by Google AI Technology September 26, 2023

Distilling step-by-step: Outperforming larger language models with less training data and smaller model sizes

Favorite Posted by Cheng-Yu Hsieh, Student Researcher, and Chen-Yu Lee, Research Scientist, Cloud AI Team Large language models (LLMs) have enabled a new data-efficient learning paradigm wherein they can be used to solve unseen new tasks via zero-shot or few-shot prompting. However, LLMs are challenging to deploy for real-world applications

Read More
Shared by Google AI Technology September 21, 2023

MediaPipe FaceStylizer: On-device real-time few-shot face stylization

Favorite Posted by Haolin Jia, Software Engineer, and Qifei Wang, Senior Software Engineer, Core ML In recent years, we have witnessed rising interest across consumers and researchers in integrated augmented reality (AR) experiences using real-time face feature generation and editing functions in mobile applications, including short videos, virtual reality, and

Read More
Shared by Google AI Technology September 15, 2023

On-device content distillation with graph neural networks

Favorite Posted by Gabriel Barcik and Duc-Hieu Tran, Research Engineers, Google Research In today’s digital age, smartphones and desktop web browsers serve as the primary tools for accessing news and information. However, the proliferation of website clutter — encompassing complex layouts, navigation elements, and extraneous links — significantly impairs both

Read More
Shared by Google AI Technology September 14, 2023