Join us

DeepSeek-V3 now runs at 20 tokens per second on Mac Studio, and that’s a nightmare for OpenAI

DeepSeek-V3 now runs at 20 tokens per second on Mac Studio, and that’s a nightmare for OpenAI

Meet DeepSeek-V3-0324, the renegade of language models. Packing a whopping 641GB into its digital knapsack, it's rocking an MIT license like a badge of rebellion. It buddies up with a Mac Studio's M3 Ultra processor, scoffing at the need for a stuffy datacenter.

The kicker? It flips the switch on just 37B out of a mind-boggling 685B parameters, only when needed. This clever trick cranks up efficiency and speed by a jaw-dropping 80%.


Let's keep in touch!

Stay updated with my latest posts and news. I share insights, updates, and exclusive content.

Unsubscribe anytime. By subscribing, you share your email with @faun and accept our Terms & Privacy.

Give a Pawfive to this post!


Only registered users can post comments. Please, login or signup.

Start writing about what excites you in tech — connect with developers, grow your voice, and get rewarded.

Join other developers and claim your FAUN.dev() account now!

Avatar

The FAUN

@faun
A worldwide community of developers and DevOps enthusiasts!
Developer Influence
3k

Influence

302k

Total Hits

3712

Posts