chatglm3 本地部署windows bitsandbytes不支持报错

先说结论：bitsandbytes不支持windows，目前很多教程写的使用bitsandbytes-windows也不可以用，下面说另外一个途径，使用

卸载：pip uninstall bitsandbytes
卸载：pip uninstall bitsandbytes-windows
安装： pip install https://github.com/jllllll/bitsandbytes-windows-webui/releases/download/wheels/bitsandbytes-0.41.1-py3-none-win_amd64.whl

初步怀疑是bitsandbytes-windows版本比较旧导致不能运行，换了上述内容就好用了；

报错信息：

 

RuntimeError:
        CUDA Setup failed despite GPU being available. Please run the following command to get more information:

        python -m bitsandbytes

        Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
        to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
        and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues
(venv) PS D:\gpt\ChatGLM3\composite_demo> python -m bitsandbytes