Don_Dickle@lemmy.world to Ask Lemmy@lemmy.world · 5 months agoIf there was a new Anarchists Cookbook like what was back in the 90s came out today what would be inside?message-squaremessage-square139fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareIf there was a new Anarchists Cookbook like what was back in the 90s came out today what would be inside?Don_Dickle@lemmy.world to Ask Lemmy@lemmy.world · 5 months agomessage-square139fedilink
minus-squarePenisDuckCuck9001@lemmynsfw.comlinkfedilinkarrow-up0·edit-25 months agoThat should work in koboldcpp. I’m running mine on an older gpu than that but with more vram. Use the gpulayers parameter to control exactly how much of the work gets offloaded to the gpu to control how much vram gets used up.
That should work in koboldcpp. I’m running mine on an older gpu than that but with more vram. Use the gpulayers parameter to control exactly how much of the work gets offloaded to the gpu to control how much vram gets used up.