Easily deploy and manage hundreds of LoRA adapters with SageMaker efficient multi-adapter inference

Favorite The new efficient multi-adapter inference feature of Amazon SageMaker unlocks exciting possibilities for customers using fine-tuned models. This capability integrates with SageMaker inference components to allow you to deploy and manage hundreds of fine-tuned Low-Rank Adaptation (LoRA) adapters through SageMaker APIs. Multi-adapter inference handles the registration of fine-tuned adapters

Read More
Shared by AWS Machine Learning November 30, 2024

Create a generative AI assistant with Slack and Amazon Bedrock

Favorite Seamless integration of customer experience, collaboration tools, and relevant data is the foundation for delivering knowledge-based productivity gains. In this post, we show you how to integrate the popular Slack messaging service with AWS generative AI services to build a natural language assistant where business users can ask questions

Read More
Shared by AWS Machine Learning November 28, 2024

Getting started with Amazon Bedrock Agents custom orchestrator

Favorite Generative AI agents are designed to interact with their environment to achieve specific objectives, such as automating repetitive tasks and augmenting human capabilities. By orchestrating multistep workflows that adapt to evolving goals in real time, these agents increase productivity, reduce errors, and deliver more personalized experiences. To manage these

Read More
Shared by AWS Machine Learning November 28, 2024

Efficiently train models with large sequence lengths using Amazon SageMaker model parallel

Favorite Large language models (LLMs) have witnessed an unprecedented surge in popularity, with customers increasingly using publicly available models such as Llama, Stable Diffusion, and Mistral. Across diverse industries—including healthcare, finance, and marketing—organizations are now engaged in pre-training and fine-tuning these increasingly larger LLMs, which often boast billions of parameters

Read More
Shared by AWS Machine Learning November 28, 2024

Embodied AI Chess with Amazon Bedrock

Favorite Generative AI continues to transform numerous industries and activities, with one such application being the enhancement of chess, a traditional human game, with sophisticated AI and large language models (LLMs). Using the Custom Model Import feature in Amazon Bedrock, you can now create engaging matches between foundation models (FMs)

Read More
Shared by AWS Machine Learning November 28, 2024

Search enterprise data assets using LLMs backed by knowledge graphs

Favorite Enterprises are facing challenges in accessing their data assets scattered across various sources because of increasing complexities in managing vast amount of data. Traditional search methods often fail to provide comprehensive and contextual results, particularly for unstructured data or complex queries. Search solutions in modern big data management must

Read More
Shared by AWS Machine Learning November 28, 2024