Optimizing AI responsiveness: A practical guide to Amazon Bedrock latency-optimized inference

Favorite In production generative AI applications, responsiveness is just as important as the intelligence behind the model. Whether it’s customer service teams handling time-sensitive inquiries or developers needing instant code suggestions, every second of delay, known as latency, can have a significant impact. As businesses increasingly use large language models

Read More
Shared by AWS Machine Learning January 29, 2025

Secure a generative AI assistant with OWASP Top 10 mitigation

Favorite A common use case with generative AI that we usually see customers evaluate for a production use case is a generative AI-powered assistant. However, before it can be deployed, there is the typical production readiness assessment that includes concerns such as understanding the security posture, monitoring and logging, cost

Read More
Shared by AWS Machine Learning January 25, 2025

Enhance your customer’s omnichannel experience with Amazon Bedrock and Amazon Lex

Favorite The rise of AI has opened new avenues for enhancing customer experiences across multiple channels. Technologies like natural language understanding (NLU) are employed to discern customer intents, facilitating efficient self-service actions. Automatic speech recognition (ASR) translates spoken words into text, enabling seamless voice interactions. With Amazon Lex bots, businesses

Read More
Shared by AWS Machine Learning January 24, 2025

How Cato Networks uses Amazon Bedrock to transform free text search into structured GraphQL queries

Favorite This is a guest post authored by Asaf Fried, Daniel Pienica, Sergey Volkovich from Cato Networks. Cato Networks is a leading provider of secure access service edge (SASE), an enterprise networking and security unified cloud-centered service that converges SD-WAN, a cloud network, and security service edge (SSE) functions, including

Read More
Shared by AWS Machine Learning January 23, 2025

Video security analysis for privileged access management using generative AI and Amazon Bedrock

Favorite Security teams in highly regulated industries like financial services often employ Privileged Access Management (PAM) systems to secure, manage, and monitor the use of privileged access across their critical IT infrastructure. Security and compliance regulations require that security teams audit the actions performed by systems administrators using privileged credentials.

Read More
Shared by AWS Machine Learning January 23, 2025