A Technology Broker and Management Company Specializing in KM Systems
Favorite This post shows how to deploy one large language model (LLM) across two GPU nodes on Amazon Elastic Kubernetes Service (Amazon EKS) with the multi-node Ray LLM Deep Learning Containers. It uses separate prefill and decode nodes behind one OpenAI-compatible endpoint. This kind of multi-node setup is common for
Read More
Shared by AWS Machine Learning October 12, 2026
Favorite Applications that route requests, select agent actions, or assign policy outcomes often need scores over a fixed set of choices instead of free-form text. Deploying these decision models with llama.cpp on Amazon SageMaker AI gives you a managed path for serving quantized models on CPU or GPU infrastructure. This
Read More Shared by AWS Machine Learning October 12, 2026
Favorite Single-Region inference can throttle when demand exceeds local capacity. Teams in Thailand, Malaysia, Singapore, Indonesia, and Taiwan need access to the newest OpenAI models beyond that capacity. Amazon Bedrock offers OpenAI GPT-6 Sol and GPT-6 Luna through global cross-Region inference from all five AWS Regions, and GPT-6 Astra from
Read More Shared by AWS Machine Learning October 12, 2026
Favorite When an AI agent runs, it often needs to buy something to finish a task: a model inference, an API response, access web content, or a call to another agent. These purchases are small and frequent, sometimes a fraction of a cent each, and they happen inside the agent’s
Read More Shared by AWS Machine Learning October 9, 2026
Favorite Building an AI agent for a demo and operating one for 40 million developers are different engineering problems. Postman set out to build Agent Mode, an AI-native way to work across API testing, documentation, discovery, and implementation. The team expected model quality and prompt design to be the hardest
Read More Shared by AWS Machine Learning October 9, 2026
Favorite A recap of the latest Amazon Bedrock, Amazon Bedrock AgentCore, and Strands updates from September 2026 At AWS, we believe the fastest path to enterprise AI is giving builders real choice at every layer: model, runtime, and tooling. That belief shapes how we invest across Amazon Bedrock, AgentCore, and
Read More Shared by AWS Machine Learning October 9, 2026
Favorite Enterprise organizations are adopting Retrieval Augmented Generation (RAG) to unlock insights from company knowledge sources like Microsoft SharePoint, Google Drive, and Atlassian Confluence. However, these knowledge sources contain sensitive information governed by complex permission structures. Making sure that AI-generated answers respect those permissions is one of the hardest challenges
Read More Shared by AWS Machine Learning October 8, 2026
Favorite Today, we’re excited to announce the availability of Claude Haiku 5.5 on Amazon Bedrock and Claude Platform on AWS. According to Anthropic, Claude Haiku 5.5 is the fastest and most efficient model in the Claude 5.5 family, built for subagents and high-volume, cost-sensitive work. It also costs around 75
Read More Shared by AWS Machine Learning October 8, 2026
Favorite Multiple teams within the same company increasingly need shared access to expensive GPU clusters for their generative AI operations, while maintaining isolation boundaries, resource fairness, and operational independence. Consider a data science team training large language models, a computer vision group running inference workloads, and a research team experimenting
Read More Shared by AWS Machine Learning October 8, 2026
Favorite On Monday, September 21, with the high-level week of the 81st UN General Assembly (UNGA81) underway in New York, OSI Executive Director Duane O’Brien spoke on a UN panel about Open Source AI and joined a Creative Commons symposium on openness and digital sovereignty. The OSI also attended the
Read More
Shared by voicesofopensource October 8, 2026