I’d like to set up a local coding assistant so that I can stop using Google to ask complex questions to for search results.

I really don’t know what I’m doing or if there’s anything that’s available that respects privacy. I don’t necessarily trust search results for this kind of query either.

I want to run it on my desktop, Ryzen 7 5800xt + Radeon RX 6950xt + 32gb of RAM. I don’t need or expect data center performance out of this thing.

Something like LM Studio and Qwen sounds like it’s what I’m looking for, but since I’m unfamiliar with what exists I figured I would ask for Lemmy’s opinion.

Is LM Studio + Qwen a good combo for my needs? Are there alternatives?

  • poVoq@slrpnk.netEnglish
    21·
    12 hours ago

    In my experience using AI for that replaces legthy documentation searches with reading lengthy AI output that turns out to be full of halucinations. Net time saved usually negative.

    • Shimitar@downonthestreet.euEnglish
      1·
      4 hours ago

      My recent experience regarding questions on documentation:

      • dovecot: shitty useless responses, totally made up
      • Gentoo linux: to be checked twice and mostly wrong or fake
      • godot: accurate and correct almost always, maybe examples not always 100% correct
      • C++ standard 17: correct, never had a wrong reply from llm, also the exact ples where on point and correct

      I think that’s all what I have used it for in the last six months.

      Note: I used only Google search AI llm, nothing else.

      So it seems that depends on what you ask.