Error related with finetuning?

[e-m-i-r]

(tvl) [egocen21@ai18 tvl_llama]$ CUDA_VISIBLE_DEVICES=0,1,2,3 python -u -m torch.distributed.launch --master_port=1112 --nproc_per_node=2 --use_env main_finetune.py --data_config exps/finetune-data-config.yaml --batch_size 8 --accum_iter 4 --llama_type llama-2-7b --epochs 4 --warmup_epochs 1 --blr 10e-4 --weight_decay 0.02 --llama_path '/scratch/users/egocen21/tactile/models/llama-2' --output_dir '/scratch/users/egocen21/tactile/' --pretrained_path '/scratch/users/egocen21/tactile/models/tvl_llama_vittiny.pth' --active_modality_names vision --checkpoint_path '/scratch/users/egocen21/tactile/models/tvl_enc_vittiny.pth' --tactile_model vit_tiny_patch16_224 --log_name exp1 --crop_tacvis
Traceback (most recent call last):
File "/kuacc/users/egocen21/miniconda3/envs/tvl/lib/python3.10/runpy.py", line 187, in _run_module_as_main
mod_name, mod_spec, code = _get_module_details(mod_name, _Error)
File "/kuacc/users/egocen21/miniconda3/envs/tvl/lib/python3.10/runpy.py", line 110, in _get_module_details
import(pkg_name)
File "/kuacc/users/egocen21/miniconda3/envs/tvl/lib/python3.10/site-packages/torch/init.py", line 367, in
from torch._C import * # noqa: F403
ImportError: /kuacc/users/egocen21/miniconda3/envs/tvl/lib/python3.10/site-packages/torch/lib/../../nvidia/cusparse/lib/libcusparse.so.12: symbol __nvJitLinkComplete_12_4, version libnvJitLink.so.12 not defined in file libnvJitLink.so.12 with link time reference