Content Safety & Responsible AI
A healthcare company is designing a Foundry-based application that will generate patient education summaries using a GPT model. Compliance requires that any generated content suggesting self-harm risk be automatically blocked before it reaches the end user, without requiring custom code in the application. Which approach should the team implement?
Azure AI Content Safety provides built-in, configurable severity-based filters (hate, sexual, violence, self-harm) that can be attached to a model deployment to block or flag content before it is returned to the caller, satisfying the requirement with no custom code. A system prompt is a soft mitigation the model can ignore or be jailbroken around, so it cannot guarantee blocking. Azure Monitor alerting is reactive (after the fact, for observability) and does not prevent the content from reaching the user. Azure AI Language custom classification would require custom pipeline code to intercept the response and also acts after generation rather than blocking as part of the deployment, and it is not purpose-built for real-time harm categories the way Content Safety is.