Come Partner with Us

Improve TTFT for multi-turn agentic workloads with bi-directional KV transfer in vLLM

Favorite Multi-turn agentic workloads build on accumulated context as an agent reasons, invokes tools, and incorporates earlier results. With each new turn, the client resends the conversation history, including system instructions, prior prompts, tool results, and model responses, causing the growing context to be processed repeatedly. In Prefill-decode (P-D) disaggregation,

Read More
Shared by AWS Machine Learning October 19, 2026

How Deepgram optimized voice AI at scale with AWS Trainium

Favorite As voice becomes a first-class modality for AI, Deepgram’s models span speech-to-text, text-to-speech, and voice agents. They now process quadrillions of audio tokens a year for more than 200,000 developers and 1,400 organizations. Customers use them through the Deepgram API or run them in their own environments, including on

Read More
Shared by AWS Machine Learning October 19, 2026

Announcing the 2027 State of Open Source Survey

Favorite The Open Source Initiative (OSI) has teamed up again with Perforce Zend and OpenLogic, as well as the Eclipse Foundation, for the 2027 State of Open Source Survey. This annual survey, now in its sixth year, brings together perspectives from OSS developers, administrators, and IT leaders around the world.

Read More
Shared by voicesofopensource October 16, 2026

Introducing Reflection Beam: an open-weight model for agentic coding on AWS

Favorite Reflection AI introduced Beam, an open-weight model for agentic coding and long-horizon tasks such as maintaining code, using tools, interpreting results, and completing multi-step workflows. The open-weight release gives developers and researchers control over the runtime, deployment environment, and customization process. In this post, we explain Reflection’s vision and

Read More
Shared by AWS Machine Learning October 16, 2026