Is there an alternative to ollama? The point was to run something locally.
- 0 Posts
- 3 Comments
Joined 3 years ago
Cake day: October 8th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
I recently gave it a try with qwen3.5 and deepseek coder v2. I have a RTX3090 and these are the largest models that can run comfortably on it.
Conclusion, they are both fucking useless. Free tier claude runs circles.
I will check it later. I loaded whichever one cluade suggested lol