CUDA load error on Windows 10 about chatrwkv

[BlinkDL]

Thank you :) Firstly set os.environ["RWKV_CUDA_ON"] = '0' and find your fastest strategy (no need to compile CUDA and simply works - but preprocessing of context will be 10x slower).

In order to use os.environ["RWKV_CUDA_ON"] = '1' in windows:

1. Install VS 2022 and Visual Studio Build Tools 2022.
2. Reinstall CUDA 11.7 (install CUDA VS extensions).
3. Run python chat.py in "x64 Native Tools Command Prompt for VS 2022" and it should be able to compile the CUDA kernel.

[linonetwo]

Hi, currently https://developer.nvidia.com/cuda-toolkit only have CUDA 12 download.

Can CUDA 12 work for ChatRWKV?