Operationalize LLM Evaluation at Scale using Amazon SageMaker Clarify and MLOps services

Favorite In the last few years Large Language Models (LLMs) have risen to prominence as outstanding tools capable of understanding, generating and manipulating text with unprecedented proficiency. Their potential applications span from conversational agents to content generation and information retrieval, holding the promise of revolutionizing all industries. However, harnessing this

Read More
Shared by AWS Machine Learning November 30, 2023

Accelerate data preparation for ML in Amazon SageMaker Canvas

Favorite Data preparation is a crucial step in any machine learning (ML) workflow, yet it often involves tedious and time-consuming tasks. Amazon SageMaker Canvas now supports comprehensive data preparation capabilities powered by Amazon SageMaker Data Wrangler. With this integration, SageMaker Canvas provides customers with an end-to-end no-code workspace to prepare

Read More
Shared by AWS Machine Learning November 30, 2023

Learn how to assess the risk of AI systems

Favorite Artificial intelligence (AI) is a rapidly evolving field with the potential to improve and transform many aspects of society. In 2023, the pace of adoption of AI technologies has accelerated further with the development of powerful foundation models (FMs) and a resulting advancement in generative AI capabilities. At Amazon,

Read More
Shared by AWS Machine Learning November 29, 2023

AWS AI services enhanced with FM-powered capabilities

Favorite Artificial intelligence (AI) continues to transform how we do business and serve our customers. AWS offers a range of pre-trained AI services that provide ready-to-use intelligence for your applications. In this post, we explore the new AI service capabilities and how they are enhanced using foundation models (FMs). We

Read More
Shared by AWS Machine Learning November 28, 2023

Simplify data prep for generative AI with Amazon SageMaker Data Wrangler

Favorite Generative artificial intelligence (generative AI) models have demonstrated impressive capabilities in generating high-quality text, images, and other content. However, these models require massive amounts of clean, structured training data to reach their full potential. Most real-world data exists in unstructured formats like PDFs, which requires preprocessing before it can

Read More
Shared by AWS Machine Learning November 28, 2023

Boost inference performance for LLMs with new Amazon SageMaker containers

Favorite Today, Amazon SageMaker launches a new version (0.25.0) of Large Model Inference (LMI) Deep Learning Containers (DLCs) and adds support for NVIDIA’s TensorRT-LLM Library. With these upgrades, you can effortlessly access state-of-the-art tooling to optimize large language models (LLMs) on SageMaker and achieve price-performance benefits – Amazon SageMaker LMI

Read More
Shared by AWS Machine Learning November 28, 2023

Introducing three new NVIDIA GPU-based Amazon EC2 instances

Favorite Amazon Elastic Compute Cloud (Amazon EC2) accelerated computing portfolio offers the broadest choice of accelerators to power your artificial intelligence (AI), machine learning (ML), graphics, and high performance computing (HPC) workloads. We are excited to announce the expansion of this portfolio with three new instances featuring the latest NVIDIA

Read More
Shared by AWS Machine Learning November 28, 2023