Favorite Multi-turn agentic workloads build on accumulated context as an agent reasons, invokes tools, and incorporates earlier results. With each new turn, the client resends the conversation history, including system instructions, prior prompts, tool results, and model responses, causing the growing context to be processed repeatedly. In Prefill-decode (P-D) disaggregation,
Read More
Shared by AWS Machine Learning October 19, 2026
Favorite vLLM is an open-source inference and serving engine for large language models (LLMs). LLM inference has two distinct phases: prefill, which processes the input prompt and builds the key-value (KV) cache, and decode, which uses that cache to generate output one token at a time. These phases have different
Read More
Shared by AWS Machine Learning October 19, 2026
Favorite As voice becomes a first-class modality for AI, Deepgram’s models span speech-to-text, text-to-speech, and voice agents. They now process quadrillions of audio tokens a year for more than 200,000 developers and 1,400 organizations. Customers use them through the Deepgram API or run them in their own environments, including on
Read More
Shared by AWS Machine Learning October 19, 2026
Favorite On Oct 9, 2026 we announced the availability of TwelveLabs’ Pegasus 1.5 on Amazon Bedrock. Pegasus 1.5 is a video language model that turns long-form video into structured, timestamped metadata. You describe the moments that matter to your workflow, and the model returns every matching segment as JSON. Video
Read More
Shared by AWS Machine Learning October 19, 2026
Favorite The North Star Every organization racing to deploy AI agents faces the same reckoning: an agent that demos beautifully can quietly degrade in production, and by the time a human notices, the trust is already broken. Where traditional software fails loudly, agents fail softly. They return an answer that
Read More
Shared by AWS Machine Learning October 17, 2026
Favorite The Open Source Initiative (OSI) has teamed up again with Perforce Zend and OpenLogic, as well as the Eclipse Foundation, for the 2027 State of Open Source Survey. This annual survey, now in its sixth year, brings together perspectives from OSS developers, administrators, and IT leaders around the world.
Read More
Shared by voicesofopensource October 16, 2026
Favorite Reflection AI introduced Beam, an open-weight model for agentic coding and long-horizon tasks such as maintaining code, using tools, interpreting results, and completing multi-step workflows. The open-weight release gives developers and researchers control over the runtime, deployment environment, and customization process. In this post, we explain Reflection’s vision and
Read More
Shared by AWS Machine Learning October 16, 2026
Favorite In every conversation I have with enterprise leaders, they say the same thing. They want agents to do more, but they don’t trust them to do it right all the time. That’s fair. The same creativity and autonomy that makes agents useful makes them hard to trust. Give an
Read More
Shared by AWS Machine Learning October 15, 2026
Favorite Muse Spark Open, Meta’s coding-optimized open-weight model, is now available in Amazon SageMaker JumpStart, the machine learning (ML) hub of Amazon SageMaker AI. The model was trained on real developer workflows, such as multi-file refactors and long debugging sessions, and it supports a context window of 1 million tokens.
Read More
Shared by AWS Machine Learning October 15, 2026
Favorite AI agents increasingly need to access web resources that are priced per request. For example, premium datasets charge by the query, research APIs meter by the call, and paywalled publishers gate content behind payment. When an AI agent encounters one of these resources, the server returns HTTP 402 Payment
Read More
Shared by AWS Machine Learning October 14, 2026