Come Partner with Us

Comprehensive observability for Amazon SageMaker AI LLM inference: From GPU utilization to LLM quality

Favorite Deploying large language models (LLMs) at scale on Amazon SageMaker AI Inference makes observability a critical pillar of any production machine learning (ML) strategy. Unlike conventional software that returns deterministic outputs, LLMs generate variable, free-form responses that are difficult to validate with standard metrics. LLM output quality can change

Read More
Shared by AWS Machine Learning May 30, 2026

Claude Opus 4.8 is now available on AWS

Favorite Today, we’re excited to announce the availability of Anthropic’s most advanced Opus model, Claude Opus 4.8, on Amazon Bedrock and the Claude Platform on AWS. Claude Opus 4.8 represents a meaningful step forward, delivering improvements across the workflows teams run in production, from agentic coding and deep knowledge work

Read More
Shared by AWS Machine Learning May 29, 2026

Evaluating Deep Agents using LangSmith on AWS

Favorite This post was co-authored with Karan Singh, Head of Partnerships at LangChain Validating AI agent behavior before production is one of the hardest problems in applied AI. Agents are non-deterministic, multi-step where errors in early steps can affect downstream results. A single bad tool call can cascade through an

Read More
Shared by AWS Machine Learning May 29, 2026

Streamline external access to Amazon SageMaker MLflow using a REST API proxy

Favorite Machine learning (ML) teams use MLflow to manage their ML lifecycle effectively. Amazon SageMaker MLflow provides comprehensive ML experiment tracking and model management capabilities. However, many enterprises have existing infrastructure requirements that need HTTPS-based integrations rather than direct SDK usage. Many organizations need to integrate Amazon SageMaker MLflow with

Read More
Shared by AWS Machine Learning May 29, 2026