CoursesFree Quizzes
NVIDIAGPU Acceleration and Optimization

Nsight Systems & Profiling — NCP-GENL Practice Question

A representative NVIDIA-Certified Professional Generative AI LLMs (NCP-GENL) exam question on Nsight Systems & Profiling. Work through it below, then read why each option is right or wrong.

This question is part of the free NVIDIA-Certified Professional Generative AI LLMs practice test.

Short answer

The correct answer is D. Use NVIDIA Nsight Systems with local profiling output saved to disk, then analyze traces offline on an air-gapped workstation.

Nsight Systems is designed for local profiling and generates self-contained trace files (*.nsys-rep) that can be analyzed offline without internet connectivity or external services, making it ideal for air-gapped environments. The TensorRT-LLM documentation emphasizes profiling as a core optimization step. Prometheus/Grafana require external infrastructure setup. NIM telemetry is runtime-focused, not detailed kernel profiling. CUDA environment variables provide basic logs but lack the structured kernel-level detail needed to distinguish memory vs. execution bottlenecks.

The Question

A media archive organization is deploying an LLM inference service on a private network behind a corporate firewall. After initial deployment, users report variable response times ranging from 2 to 15 seconds for identical requests. The team lacks direct internet access to download third-party monitoring tools. Which approach best enables identification of whether the bottleneck is memory bandwidth, kernel execution, or batch queue depth without requiring external tool installation?

ADeploy Prometheus and Grafana on the private network to collect real-time GPU metrics from the inference service
BInstrument the inference application with NVIDIA NIM built-in telemetry endpoints to expose performance counters via local HTTP
CEnable CUDA profiling via environment variables and parse the resulting CSV logs to correlate kernel timing with batch sizes
DUse NVIDIA Nsight Systems with local profiling output saved to disk, then analyze traces offline on an air-gapped workstationCorrect

Why D is correct

Nsight Systems is designed for local profiling and generates self-contained trace files (*.nsys-rep) that can be analyzed offline without internet connectivity or external services, making it ideal for air-gapped environments. The TensorRT-LLM documentation emphasizes profiling as a core optimization step. Prometheus/Grafana require external infrastructure setup. NIM telemetry is runtime-focused, not detailed kernel profiling. CUDA environment variables provide basic logs but lack the structured kernel-level detail needed to distinguish memory vs. execution bottlenecks.

Why the other options are wrong

Option A: Deploy Prometheus and Grafana on the private network to collect real-time GPU metrics from the inference service

Option A does not satisfy the requirement in the scenario. Review the explanation above: the correct choice (D) is the only one that fully meets every constraint stated in the question.

Option B: Instrument the inference application with NVIDIA NIM built-in telemetry endpoints to expose performance counters via local HTTP

Option B does not satisfy the requirement in the scenario. Review the explanation above: the correct choice (D) is the only one that fully meets every constraint stated in the question.

Option C: Enable CUDA profiling via environment variables and parse the resulting CSV logs to correlate kernel timing with batch sizes

Option C does not satisfy the requirement in the scenario. Review the explanation above: the correct choice (D) is the only one that fully meets every constraint stated in the question.

Key idea: Nsight Systems & Profiling

Nsight Systems is designed for local profiling and generates self-contained trace files (*.nsys-rep) that can be analyzed offline without internet connectivity or external services, making it ideal for air-gapped environments. The TensorRT-LLM documentation emphasizes profiling as a core optimization step. Prometheus/Grafana require external infrastructure setup. NIM telemetry is runtime-focused, not detailed kernel profiling. CUDA environment variables provide basic logs but lack the structured kernel-level detail needed to distinguish memory vs. execution bottlenecks. On the NCP-GENL exam, questions in the "GPU Acceleration and Optimization" domain test whether you can map a scenario's constraints to the right choice. Read the requirement carefully, eliminate options that violate any single constraint, and pick the one that satisfies all of them with the least operational overhead.

Ready to see how you'd score?

Take the free practice quiz and find out which NVIDIA-Certified Professional Generative AI LLMs domains you need to focus on. No signup required.

Take the free quizSee all 222+ practice questions

Practice 5 similar questions

Same cert, same or adjacent domain. Use these after reviewing the explanation.

1Multi Head Attention & Attention Specialization — NCP-GENL Practice QuestionLLM Architecture2Nemo Guardrails & Jailbreak Detection — NCP-GENL Practice QuestionSafety, Ethics, and Compliance3Chain-of-Thought & Output Control — NCP-GENL Practice QuestionPrompt Engineering4Nemo Curator & Semantic Deduplication — NCP-GENL Practice QuestionData Preparation5Quantization & Memory Optimization — NCP-GENL Practice QuestionModel Optimization

Related NVIDIA-Certified Professional Generative AI LLMs Practice Questions

Multi Head Attention & Attention Specialization — NCP-GENL Practice Question→Nemo Guardrails & Jailbreak Detection — NCP-GENL Practice Question→Chain-of-Thought & Output Control — NCP-GENL Practice Question→

Official sources used

Verify program and exam details at the source before scheduling.

docs.nvidia.comTensorrt LLMdocs.nvidia.comQuantization: Quantization.html