lidd1ejimmy@lemmy.ml to Memes@lemmy.mlEnglish · 1 year agoOffline version of Chat GPTlemmy.mlimagemessage-square27fedilinkarrow-up1502arrow-down18
arrow-up1494arrow-down1imageOffline version of Chat GPTlemmy.mllidd1ejimmy@lemmy.ml to Memes@lemmy.mlEnglish · 1 year agomessage-square27fedilink
minus-squareNoiseColor @lemmy.worldlinkfedilinkarrow-up14arrow-down2·1 year agoMight be a dvd. 70b ollama llm is like 1.5GB. So you could save many models on one dvd.
minus-squareIgnotum@lemmy.worldlinkfedilinkarrow-up8·1 year ago70b model taking 1.5GB? So 0.02 bit per parameter? Are you sure you’re not thinking of a heavily quantised and compressed 7b model or something? Ollama llama3 70b is 40GB from what i can find, that’s a lot of DVDs
minus-squareNoiseColor @lemmy.worldlinkfedilinkarrow-up9·1 year agoAh yes probably the Smaler version, your right. Still, a very good llm better than gpt 3
minus-square9point6@lemmy.worldlinkfedilinkarrow-up7·1 year agoLess than half of a BDXL though! The dream still breathes
minus-squareSteve@startrek.websitelinkfedilinkarrow-up5·11 months agoFor some reason, triple layer writable blu-ray exists. 100GB each https://www.verbatim.com/prod/optical-media/blu-ray/bd-r-xl-tl/bd-r-xl-tl/
minus-squareerrer@lemmy.worldlinkfedilinkEnglisharrow-up8·1 year agoIt is a DVD, can faintly see DVD+R on the left side
minus-squareDannyBoy@sh.itjust.workslinkfedilinkEnglisharrow-up5·1 year agoIt does have the label DVD-R
Might be a dvd. 70b ollama llm is like 1.5GB. So you could save many models on one dvd.
70b model taking 1.5GB? So 0.02 bit per parameter?
Are you sure you’re not thinking of a heavily quantised and compressed 7b model or something? Ollama llama3 70b is 40GB from what i can find, that’s a lot of DVDs
Ah yes probably the Smaler version, your right. Still, a very good llm better than gpt 3
Less than half of a BDXL though! The dream still breathes
For some reason, triple layer writable blu-ray exists. 100GB each
https://www.verbatim.com/prod/optical-media/blu-ray/bd-r-xl-tl/bd-r-xl-tl/
It is a DVD, can faintly see DVD+R on the left side
It does have the label DVD-R