Missing library in docker container

AI & Data Science NVIDIA Nemotron
1

Hi there, I’m trying to build a docker container for a VLM and I’m seeing an error:

2025-07-18 05:49:42.520250057 [E:onnxruntime:Default, provider_bridge_ort.cc:2036 TryGetProviderInfo_CUDA] /onnxruntime_src/onnxruntime/core/session/provider_bridge_ort.cc:1695 onnxruntime::Provider& onnxruntime::ProviderLibrary::Get() [ONNXRuntimeError] : 1 : FAIL : Failed to load library libonnxruntime_providers_cuda.so with error: libnvrtc.so.12: cannot open shared object file: No such file or directory

How do I go about installing that library?

2

Hi @enrac5,

It looks like a few others have hit the same issue and discussed fixes here - Failed to load library libonnxruntime_providers_cuda.so I am getting the following erro · Issue #19616 · microsoft/onnxruntime · GitHub.

I would recommend filing a issue on the onnxruntime Github, if none of the solutions proposed in that existing issue work.

Best,

Sophie

3

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.