Profiling Numba CUDA with nsight sys

GHK · July 5, 2022, 12:55pm

Tried profiling this example:

gmarkall/numba-kernel-progress/blob/main/kernel_progress.py

from numba import cuda
from time import sleep
import numpy as np
from progress.bar import Bar


# Timing parameters - adjust if things are too slow / fast for your liking and
# / or setup.

# Number of iterations in the kernel
MAX_VAL = 1000000

# How long the kernel sleeps each iteration
KERNEL_SLEEP = 1000

# How long the host sleeps before checking the progress of the kernel
HOST_SLEEP = 0.001


# A kernel that increments a counter. Simply looping and incrementing may be

This file has been truncated. show original

(which Mr. Markall suggested as an answer to my previous question)

The example runs, nvidia-smi shows GPU activity, but profiling doesn’t show the GPU activity at all only much CPU activity.
Any ideas?

I run on a 7.5 compute capability GPU with this command:

nsys profile -w true -t cuda,nvtx,osrt,cudnn,cublas -s none -o nsight_report -f true -x true python kernel_progress.py

gmarkall · July 5, 2022, 2:04pm

nsys is NSIght Systems, the whole-system profiler. You need to use NSight Compute (ncu) for profiling kernels. See: Nsight Compute CLI :: Nsight Compute Documentation.

Topic		Replies	Views
How do I profile code including numba kernels decorated with @cuda.jit? Is there a good way to apply nsight systems and nsight compute tools that replace nvprof? Support: How do I do ...?	4	806	May 12, 2023
How to profile with nsight compute? Support: How do I do ...?	1	477	January 25, 2022
Numba for CUDA Programmers course released Announcements	0	642	April 23, 2021
Numba cuda: for vs while in kernel performance difference Community Support	1	1223	February 1, 2022
CPU vs GPU version Numba	2	389	July 28, 2020

Profiling Numba CUDA with nsight sys

Related Topics