2

Is there any way to monitor GPU memory I/O from the shell, with Nvidia graphic cards used with CUDA?

I use nvidia-smi to see the current memory utilization, but I would prefer to see the deltas instead (e.g. 10 MB/s), and ideally broken down by processes (as iotop does for disk I/O).

nvidia-smi:

enter image description here

iotop:

enter image description here

2

nvprof can print nice statistics if you put the appropriate switches. Unfortunately I don't have any example output around, but it can be used like this:

nvprof \
    --devices 0 \
    --metrics l1_cache_global_hit_rate \
    --metrics shared_load_transactions \
    ./your_app

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.