NVIDIADeployment and Scaling

Explainability & Audit Trail — NCP-AAI Practice Question

A representative NVIDIA-Certified Professional Agentic AI (NCP-AAI) exam question on Explainability & Audit Trail. Work through it below, then read why each option is right or wrong.

This question is part of the free NVIDIA-Certified Professional Agentic AI practice test.

Short answer

The correct answer is A. Configure the agent to log the input features (soil pH, moisture, weather data) and intermediate reasoning steps for each recommendation, then evaluate whether the logged evidence is sufficient for a farmer to independently verify the recommendation.

Explainable decision evidence requires logging the actual inputs and reasoning steps that led to each recommendation, not post-hoc justifications. Evaluation should verify that logged evidence allows independent verification—this is the foundation for regulatory audit trails. A post-hoc explanation layer generates unfaithful explanations that may not reflect actual reasoning. The black-box option assumes accuracy implies explainability, which is false. The confidence-score option conflates confidence with explainability. NeMo Agent Toolkit function and workflow documentation emphasizes transparent logging of inputs and intermediate steps for auditability.

The Question

An agricultural cooperative is operationalizing an agentic system that recommends crop treatments based on soil analysis and weather forecasts. Regulators require explainable decision evidence for every recommendation to ensure farmers can audit the agent's reasoning. Which evaluation design approach best ensures the agent provides auditable evidence for every recommendation?

AConfigure the agent to log the input features (soil pH, moisture, weather data) and intermediate reasoning steps for each recommendation, then evaluate whether the logged evidence is sufficient for a farmer to independently verify the recommendationCorrect
BImplement a post-hoc explanation layer that generates plausible-sounding justifications for agent recommendations after the fact, then evaluate whether explanations are persuasive to farmers
CUse a black-box model with high overall accuracy, trusting that accurate predictions implicitly provide valid evidence for regulatory compliance
DRequire the agent to output a confidence score with each recommendation, interpreting high confidence as sufficient evidence for regulatory approval

Why A is correct

Explainable decision evidence requires logging the actual inputs and reasoning steps that led to each recommendation, not post-hoc justifications. Evaluation should verify that logged evidence allows independent verification—this is the foundation for regulatory audit trails. A post-hoc explanation layer generates unfaithful explanations that may not reflect actual reasoning. The black-box option assumes accuracy implies explainability, which is false. The confidence-score option conflates confidence with explainability. NeMo Agent Toolkit function and workflow documentation emphasizes transparent logging of inputs and intermediate steps for auditability.

Why the other options are wrong

Option B: Implement a post-hoc explanation layer that generates plausible-sounding justifications for agent recommendations after the fact, then evaluate whether explanations are persuasive to farmers

Option B does not satisfy the requirement in the scenario. Review the explanation above: the correct choice (A) is the only one that fully meets every constraint stated in the question.

Option C: Use a black-box model with high overall accuracy, trusting that accurate predictions implicitly provide valid evidence for regulatory compliance

Option C does not satisfy the requirement in the scenario. Review the explanation above: the correct choice (A) is the only one that fully meets every constraint stated in the question.

Option D: Require the agent to output a confidence score with each recommendation, interpreting high confidence as sufficient evidence for regulatory approval

Option D does not satisfy the requirement in the scenario. Review the explanation above: the correct choice (A) is the only one that fully meets every constraint stated in the question.

Key idea: Explainability & Audit Trail

Explainable decision evidence requires logging the actual inputs and reasoning steps that led to each recommendation, not post-hoc justifications. Evaluation should verify that logged evidence allows independent verification—this is the foundation for regulatory audit trails. A post-hoc explanation layer generates unfaithful explanations that may not reflect actual reasoning. The black-box option assumes accuracy implies explainability, which is false. The confidence-score option conflates confidence with explainability. NeMo Agent Toolkit function and workflow documentation emphasizes transparent logging of inputs and intermediate steps for auditability. On the NCP-AAI exam, questions in the "Deployment and Scaling" domain test whether you can map a scenario's constraints to the right choice. Read the requirement carefully, eliminate options that violate any single constraint, and pick the one that satisfies all of them with the least operational overhead.

Ready to see how you'd score?

Take the free practice quiz and find out which NVIDIA-Certified Professional Agentic AI domains you need to focus on. No signup required.

Practice 5 similar questions

Same cert, same or adjacent domain. Use these after reviewing the explanation.

Related NVIDIA-Certified Professional Agentic AI Practice Questions

Official sources used

Verify program and exam details at the source before scheduling.