runtime error

versions/3.10.14/lib/python3.10/site-packages/transformers/tokenization_utils_base.py:1958: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead. warnings.warn( You are using the default legacy behaviour of the <class 'transformers.models.llama.tokenization_llama.LlamaTokenizer'>. This is expected, and simply means that the `legacy` (previous) behavior will be used so nothing changes for you. If you want to use the new behaviour, set `legacy=False`. This should only be set if you understand what it means, and thoroughly read the reason why this was added as explained in https://github.com/huggingface/transformers/pull/24565 /home/user/.pyenv/versions/3.10.14/lib/python3.10/site-packages/transformers/modeling_utils.py:2988: FutureWarning: The `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead. warnings.warn( The `load_in_4bit` and `load_in_8bit` arguments are deprecated and will be removed in the future versions. Please, pass a `BitsAndBytesConfig` object in `quantization_config` argument instead. Traceback (most recent call last): File "/home/user/app/app.py", line 64, in <module> model = model_cls.from_config(model_config).to('cuda:0') File "/home/user/app/minigpt4/models/mini_gpt4.py", line 239, in from_config model = cls( File "/home/user/app/minigpt4/models/mini_gpt4.py", line 98, in __init__ self.llama_model = LlamaForCausalLM.from_pretrained( File "/home/user/.pyenv/versions/3.10.14/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3162, in from_pretrained hf_*********.validate_environment( File "/home/user/.pyenv/versions/3.10.14/lib/python3.10/site-packages/transformers/quantizers/quantizer_bnb_8bit.py", line 98, in validate_environment raise ValueError( ValueError: You have a version of `bitsandbytes` that is not compatible with 8bit inference and training make sure you have the latest version of `bitsandbytes` installed

Container logs:

Fetching error logs...