I’d like to set up a local coding assistant so that I can stop using Google to ask complex questions to for search results.
I really don’t know what I’m doing or if there’s anything that’s available that respects privacy. I don’t necessarily trust search results for this kind of query either.
I want to run it on my desktop, Ryzen 7 5800xt + Radeon RX 6950xt + 32gb of RAM. I don’t need or expect data center performance out of this thing.
Something like LM Studio and Qwen sounds like it’s what I’m looking for, but since I’m unfamiliar with what exists I figured I would ask for Lemmy’s opinion.
Is LM Studio + Qwen a good combo for my needs? Are there alternatives?
The main thing that has stopped me from doing this so far is VRAM. My server has a RTX 4060 with 8GB, and not sure that can reasonably run a model like this.