Boost inference performance for Mixtral and Llama 2 models with new Amazon SageMaker containers

Favorite In January 2024, Amazon SageMaker launched a new version (0.26.0) of Large Model Inference (LMI) Deep Learning Containers (DLCs). This version offers support for new models (including Mixture of Experts), performance and usability improvements across inference backends, as well as new generation details for increased control and prediction explainability

Read More
Shared by AWS Machine Learning April 9, 2024

Use everyday language to search and retrieve data with Mixtral 8x7B on Amazon SageMaker JumpStart

Favorite With the widespread adoption of generative artificial intelligence (AI) solutions, organizations are trying to use these technologies to make their teams more productive. One exciting use case is enabling natural language interactions with relational databases. Rather than writing complex SQL queries, you can describe in plain language what data

Read More
Shared by AWS Machine Learning April 9, 2024

Understanding and predicting urban heat islands at Gramener using Amazon SageMaker geospatial capabilities

Favorite This is a guest post co-authored by Shravan Kumar and Avirat S from Gramener. Gramener, a Straive company, contributes to sustainable development by focusing on agriculture, forestry, water management, and renewable energy. By providing authorities with the tools and insights they need to make informed decisions about environmental and

Read More
Shared by AWS Machine Learning April 6, 2024

Build a news recommender application with Amazon Personalize

Favorite With a multitude of articles, videos, audio recordings, and other media created daily across news media companies, readers of all types—individual consumers, corporate subscribers, and more—often find it difficult to find news content that is most relevant to them. Delivering personalized news and experiences to readers can help solve

Read More
Shared by AWS Machine Learning April 5, 2024

Build a contextual text and image search engine for product recommendations using Amazon Bedrock and Amazon OpenSearch Serverless

Favorite The rise of contextual and semantic search has made ecommerce and retail businesses search straightforward for its consumers. Search engines and recommendation systems powered by generative AI can improve the product search experience exponentially by understanding natural language queries and returning more accurate results. This enhances the overall user

Read More
Shared by AWS Machine Learning April 4, 2024