OSError: libcusparse.so.11: cannot open shared object file: No such file or directory CUDA Setup failed despite CUDA being available. #1234
Description
System Info
Windows, 3.10.14, Installed RAM - 8.00 GB (7.75 GB usable), System type - 64-bit operating system, x64-based processor
Reproduction
python CRAG_Inference.py --generator_path model/hf-models/model-selfrag/selfrag_llama2_7b --input_file knowledge_prep/test_rbi.txt --output_file output_file --internal_knowledge_path knowledge_prep/ref/correct --external_knowledge_path knowledge_prep/ref/incorrect --combined_knowledge_path knowledge_prep/ref/ambiguous --task eli5 --method crag --device cuda:0 --ndocs 4 --batch_size 1 --upper_threshold 0.592 --lower_threshold 0.995 - I was running this file.
Expected behavior
It should have loaded the generator(selfrag-llama2 7b in this case), but it threw the above error