Skip to main content

One post tagged with "Azure"

CAP is a cloud service development framework developed by SAP and released as OSS. From time to time, I cover some very specific topics.

View All Tags

How to build enterprise-ready AI solutions with Azure AI Agents

Learn about architectural options for enterprise-ready LLM AI solutions using Azure AI Agents

· 12 min read View Comments
Martin Jurran
Martin Jurran
Software Engineer - OSS, golang, .NET

AI is sometimes too good to be true — it’s so easy to integrate and use compared to rule based approaches. That’s why governance is important. Befriend the AI and be accountable together. (Photo by the author)

AI is sometimes too good to be true — it’s so easy to integrate and use compared to rule based approaches. That’s why governance is important. Befriend the AI and be accountable together. (Photo by the author)

Integrating large language models (LLMs) into apps has become popular over the past few years. But there’s challenges hiding beneath the surface.

The way some apps send general queries to LLM endpoints (like Open AI’s API) is basically a black box. If the responses start to vary or the quality decreases, figuring out the “why” becomes a challenge — unless you build governing logic yourself. Not ideal.