Hi, I am building a local AI assistant using llama-cpp-python. I want to convert it to .exe so a user can run it on their own windows system. Is it possible to attach cuda library without needing to install the full Nvidia’s cuda toolkit on user’s windows? If so, how can I achieve it? TIA
submitted by /u/ramzeez88
[link] [comments]
r/learnpython Hi, I am building a local AI assistant using llama-cpp-python. I want to convert it to .exe so a user can run it on their own windows system. Is it possible to attach cuda library without needing to install the full Nvidia’s cuda toolkit on user’s windows? If so, how can I achieve it? TIA submitted by /u/ramzeez88 [link] [comments]
Hi, I am building a local AI assistant using llama-cpp-python. I want to convert it to .exe so a user can run it on their own windows system. Is it possible to attach cuda library without needing to install the full Nvidia’s cuda toolkit on user’s windows? If so, how can I achieve it? TIA
submitted by /u/ramzeez88
[link] [comments]