What will I learn?

2024-10-1610:4011:15
Scaling and Managing GenAI applications with Azure API Management
With the rise of Artificial Intelligence (AI), many industries and users are exploring ways to leverage this technology for their development purposes and use cases. Azure OpenAI provides a powerful platform for utilizing large language models (LLMs) in development. However, it presents its own challenges related to scalability, security, monitoring, and resource allocation. In this session, we will explore how GenAI Gateway capabilities in Azure API Management can address these challenges. I will demonstrate how to configure API Management for authentication and authorization for Azure OpenAI endpoints, enforce limits based on token consumption, track token usage, and implement load balancing across multiple Azure OpenAI endpoints. Join me to learn how to optimize your AI deployments with Azure API Management.

Don't forget to checkout our partners!

LogoLogoLogoLogoLogoLogoLogoLogo
LogoLogoLogoLogoRevision, a tool for documenting software architecturesLogoLogo