Experiment Tracking & ML Metadata — PMLE Practice Question
A representative Google Cloud Professional Machine Learning Engineer (PMLE) exam question on Experiment Tracking & ML Metadata. Work through it below, then read why each option is right or wrong.
This question is part of the free Google Cloud Professional Machine Learning Engineer practice test.
Short answer
The correct answer is D. Use Vertex AI Experiments with ML Metadata to automatically log parameters, metrics, and artifacts; compare runs in the Vertex AI console; use the logged metadata to reproduce the best run..
Vertex AI Experiments with ML Metadata is purpose-built for tracking, comparing, and reproducing ML experiments at scale. It captures parameters, metrics, and artifacts, provides a unified console for comparison, and records the inputs needed to reproduce the best run. Option D is the only approach that integrates experiment tracking, comparison, and reproducibility in a single platform. Option B (BigQuery approach) requires manual orchestration and lacks built-in reproducibility features. Option C (Sheets) is not scalable for 15 parallel runs and lacks integration with model artifacts. Option A (Airflow) is for orchestration, not experiment comparison.
The Question
Your team is running 15 parallel experiments in Vertex AI to optimize a recommendation model using different feature engineering approaches, loss functions, and hyperparameters. After each experiment, you need to compare metrics (RMSE, AUC, latency), identify the best-performing configuration, and reproduce the exact training run for the winner. What is the most efficient way to track and manage this workflow?
Why D is correct
Vertex AI Experiments with ML Metadata is purpose-built for tracking, comparing, and reproducing ML experiments at scale. It captures parameters, metrics, and artifacts, provides a unified console for comparison, and records the inputs needed to reproduce the best run. Option D is the only approach that integrates experiment tracking, comparison, and reproducibility in a single platform. Option B (BigQuery approach) requires manual orchestration and lacks built-in reproducibility features. Option C (Sheets) is not scalable for 15 parallel runs and lacks integration with model artifacts. Option A (Airflow) is for orchestration, not experiment comparison.
Why the other options are wrong
Option A does not satisfy the requirement in the scenario. Review the explanation above: the correct choice (D) is the only one that fully meets every constraint stated in the question.
Option B does not satisfy the requirement in the scenario. Review the explanation above: the correct choice (D) is the only one that fully meets every constraint stated in the question.
Option C does not satisfy the requirement in the scenario. Review the explanation above: the correct choice (D) is the only one that fully meets every constraint stated in the question.
Key idea: Experiment Tracking & ML Metadata
Vertex AI Experiments with ML Metadata is purpose-built for tracking, comparing, and reproducing ML experiments at scale. It captures parameters, metrics, and artifacts, provides a unified console for comparison, and records the inputs needed to reproduce the best run. Option D is the only approach that integrates experiment tracking, comparison, and reproducibility in a single platform. Option B (BigQuery approach) requires manual orchestration and lacks built-in reproducibility features. Option C (Sheets) is not scalable for 15 parallel runs and lacks integration with model artifacts. Option A (Airflow) is for orchestration, not experiment comparison. On the PMLE exam, questions in the "Collaborating to manage data and models" domain test whether you can map a scenario's constraints to the right choice. Read the requirement carefully, eliminate options that violate any single constraint, and pick the one that satisfies all of them with the least operational overhead.
Ready to see how you'd score?
Take the free practice quiz and find out which Google Cloud Professional Machine Learning Engineer domains you need to focus on. No signup required.
Practice 5 similar questions
Same cert, same or adjacent domain. Use these after reviewing the explanation.
Related Google Cloud Professional Machine Learning Engineer Practice Questions
Official sources used
Verify program and exam details at the source before scheduling.