Troubleshooting & Prompting — CCAO-F Practice Question
A representative Claude Certified Associate - Foundations (CCAO-F) exam question on Troubleshooting & Prompting. Work through it below, then read why each option is right or wrong.
Short answer
The correct answer is B. Collect failing examples and compare them with passing ones against an explicit extraction rubric.
A small failure set and rubric reveal whether the issue is missing instructions, ambiguous source text, or evaluation drift. Changing many variables hides causality.
The Question
Claude returns inconsistent meeting-note action items across similar transcripts. What is the most useful first diagnostic?
Why B is correct
A small failure set and rubric reveal whether the issue is missing instructions, ambiguous source text, or evaluation drift. Changing many variables hides causality.
Why the other options are wrong
Option A does not satisfy the requirement in the scenario. Review the explanation above: the correct choice (B) is the only one that fully meets every constraint stated in the question.
Option C does not satisfy the requirement in the scenario. Review the explanation above: the correct choice (B) is the only one that fully meets every constraint stated in the question.
Option D does not satisfy the requirement in the scenario. Review the explanation above: the correct choice (B) is the only one that fully meets every constraint stated in the question.
Key idea: Troubleshooting & Prompting
A small failure set and rubric reveal whether the issue is missing instructions, ambiguous source text, or evaluation drift. Changing many variables hides causality. On the CCAO-F exam, questions in the "Troubleshooting and Optimization" domain test whether you can map a scenario's constraints to the right choice. Read the requirement carefully, eliminate options that violate any single constraint, and pick the one that satisfies all of them with the least operational overhead.
Ready to see how you'd score?
Take the free practice quiz and find out which Claude Certified Associate - Foundations domains you need to focus on. No signup required.
Practice 5 similar questions
Same cert, same or adjacent domain. Use these after reviewing the explanation.