Searching…
r/ollama How good is Ollama on Windows? I have a 4070Ti 16GB card, Ryzen 5 5600X, 32GB RAM. I want to run Stable Diffusion (already installed and working), Ollama with some 7B models, maybe a …
I've just installed Ollama in my system and chatted with it a little. Unfortunately, the response time is very slow even for lightweight models like…
2024年4月8日 · Yes, I was able to run it on a RPi. Ollama works great. Mistral, and some of the smaller models work. Llava takes a bit of time, but works. For text to speech, you’ll have to run an API from …
2024年3月8日 · How to make Ollama faster with an integrated GPU? I decided to try out ollama after watching a youtube video. The ability to run LLMs locally and which could give output faster amused …
2023年12月20日 · I'm using ollama to run my models. I want to use the mistral model, but create a lora to act as an assistant that primarily references data I've supplied during training. This data will include …
Don't know Debian, but in arch, there are two packages, "ollama" which only runs cpu, and "ollama-cuda". Maybe the package you're using doesn't have cuda enabled, even if you have cuda installed. …
2024年1月10日 · That's really the worst. To get rid of the model I needed on install Ollama again and then run "ollama rm llama2". It should be transparent where it installs - so I can remove it later. Meh..
I took time to write this post to thank ollama.ai for making entry into the world of LLMs this simple for non techies like me. Edit: A lot of kind users have pointed out that it is unsafe to execute the bash file to …
HOW TO GET UNCENSORED MODELS LIKE DOLPHIN-MIXTRAL TO ACTUALLY WORK UNCENSORED SO YOU CAN STOP MAKING POSTS ABOUT IT NOT WORKING AND THEN …
2024年2月5日 · I think this question should be discussed every month. If applicable, please separate out your best models by use case. Specifically Ollama because that's the easiest way to build with LLMs …
