noumenon@lemmy.world to Technology@lemmy.worldEnglish · 5 days agoResearchers figured out how to run a 120-billion parameter model across four regular desktop PCsactu.epfl.chexternal-linkmessage-square7linkfedilinkarrow-up152arrow-down19
arrow-up143arrow-down1external-linkResearchers figured out how to run a 120-billion parameter model across four regular desktop PCsactu.epfl.chnoumenon@lemmy.world to Technology@lemmy.worldEnglish · 5 days agomessage-square7linkfedilink
minus-squareWereCat@lemmy.worldlinkfedilinkEnglisharrow-up2·5 days agoOFC you can… I can run the 70B DeepSeek on my 16GB RX 6800 XT with 64GB RAM already…
OFC you can… I can run the 70B DeepSeek on my 16GB RX 6800 XT with 64GB RAM already…