A Technology Broker and Management Company Specializing in KM Systems
Favorite When prefill and decode share a GPU, long prompts stall token generation for every concurrent request. Disaggregated Prefill and Decode (DPD) removes this interference by running each phase on separate GPU pools connected through Elastic Fabric Adapter (EFA) with Remote Direct Memory Access (RDMA). Large language model (LLM) inference
Read More
Shared by AWS Machine Learning July 11, 2026
Favorite In this post, learn how KTern.AI, an SAP digital transformation platform, used Amazon Bedrock AgentCore to build and deploy AI agents ready for enterprise-scale SAP transformation workloads. These agents autonomously orchestrate workflows from reverse engineering, fit-to-standard, and code analysis to exception mining in Finance and Sales processes. The result
Read More Shared by AWS Machine Learning July 11, 2026
Favorite This post was co-written with Daniel Han and Michael Han from Unsloth. Deploying large foundation models (FMs) stored at their original 16-bit floating-point precision (BF16 or FP16) is expensive. They need large GPU instances, driving up serving costs, and slowing down iteration cycles. Quantization addresses this by reducing the
Read More Shared by AWS Machine Learning July 11, 2026
Favorite An artificial intelligence (AI) agent can process an invoice, help adjudicate a claim, or classify a support ticket in a proof of concept. But running these agents across thousands or even millions of work items in a production environment introduces an entirely different set of challenges. At enterprise scale,
Read More Shared by AWS Machine Learning July 11, 2026
Favorite In this post we show how to build a semantic layer on AWS using Stardog’s Semantic AI Application over Amazon Aurora and Amazon Redshift, and how to run a Strands Agents agent on Amazon Bedrock AgentCore that queries the layer to answer customer 360 questions across both sources without
Read More Shared by AWS Machine Learning July 11, 2026
Favorite In dentistry, image quality determines whether a claim is paid or denied. Up to 20 percent insurance claims are initially denied, with missing or low-quality images among the leading causes. Yet quality assessment has traditionally been a manual, after-the-fact process. A clinician reviews an X-ray hours or days after
Read More Shared by AWS Machine Learning July 11, 2026
Favorite Model customization transforms general-purpose AI models into specialized enterprise assets. By fine-tuning foundation models (FMs) on domain-specific data, businesses teach AI their unique workflows, terminology, and deep domain specialization, along with strict adherence to brand voice and fewer hallucinations. For enterprises, this is more than an optimization. It’s the
Read More Shared by AWS Machine Learning July 11, 2026
Favorite As enterprises scale their generative AI workloads, the demand for faster, more observable, and more flexible inference infrastructure continues to grow. Amazon SageMaker HyperPod is rising to meet that challenge with a set of new capabilities designed to streamline how organizations deploy and operate large models in production. Teams
Read More Shared by AWS Machine Learning July 10, 2026
Favorite When Model Context Protocol (MCP) tools underperform, the cause is rarely the protocol itself but the tool design. Many teams start by exposing an existing API as-is and trusting the agent to figure out the rest. It is a natural way to extend APIs to agentic systems and generative
Read More Shared by AWS Machine Learning July 10, 2026
Favorite As organizations expand AI adoption across their workforce, IT administrators need a scalable way to manage how AI applications are configured and used on employee devices. These applications include Claude Code, Claude Desktop, and OpenAI Codex. Users, meanwhile, can open approved applications and start working without manual setup. Jamf,
Read More Shared by AWS Machine Learning July 9, 2026