vLLM nodes for comfyui using llama-cpp-python
Please install llama-cpp-python with cuda enabled. Can be found here for windows: https://github.com/dougeeai/llama-cpp-python-wheels
| Name | Name | Last commit date | ||
|---|---|---|---|---|
vLLM nodes for comfyui using llama-cpp-python
Please install llama-cpp-python with cuda enabled. Can be found here for windows: https://github.com/dougeeai/llama-cpp-python-wheels