Wondering about services to test on either a 16gb ram “AI Capable” arm64 board or on a laptop with modern rtx. Only looking for open source options, but curious to hear what people say. Cheers!

    • L_Acacia@lemmy.ml
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 days ago

      Qwen coder or the new gemma3.

      But at this size using privacy respecting api might be both cheaper and lead to better results.