ffhein@lemmy.world to LocalLLaMA@sh.itjust.worksEnglish · 5 days agoAnyone found "optimal" settings for llama.cpp partial offload?plus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareAnyone found "optimal" settings for llama.cpp partial offload?plus-squareffhein@lemmy.world to LocalLLaMA@sh.itjust.worksEnglish · 5 days agomessage-square0fedilink