Season's Savings | ₹5/mo for 3 months

₹199/month after first 3 months. Renews automatically. Terms apply.
WiCi One, Checked: A 748B AI Off an SSD vs the Mac Studio We Already Run cover art

WiCi One, Checked: A 748B AI Off an SSD vs the Mac Studio We Already Run

WiCi One, Checked: A 748B AI Off an SSD vs the Mac Studio We Already Run

Listen for free

View show details
About this listen
NetworkChuck ran a 748-billion-parameter DeepSeek model on WiCi One, a box with a 32 GB RTX 5090 that streams most of the model off an SSD, at about 8 pieces of text a second. His video is sponsored by WiCi, and he says so. I checked 21 of its claims against DeepSeek's model card, WiCi's open-source InferSSD repo and Apple's spec pages: 12 hold, 6 hold with a caveat, none fail. Then I ran what I could on our own Mac Studio (M3 Ultra, 256 GB): the same coffee questions on the smaller DeepSeek V4 Flash at 22.5 a second, our model drive at 2.6 GB/s for big reads and 34 MB/s for tiny ones, a model switch in 0.69 seconds, and an answer that used 18 kilobits a second on the network. Written analysis: https://familygpu.novcog.us.com/ · Video: https://youtu.be/fXe88jyy7lk
adbl_web_anon_alc_button_suppression_t1
No reviews yet