ContentPosts from @tim_david..
Link
@faun shared a link, 5 months, 1 week ago
FAUN.dev()

A Reality Check on DeepSeek's Distributed File System Benchmarks

3FSisn't quite matching its own hype. Yes, it boasts a flashy8 TB/s peak throughput, but pesky network bottlenecks throttle usage to roughly 73% of its theoretical greatness. Efficiency’s hiding somewhere, laughing. A dig intoGraySortshows storage sulking on the sidelines, perhaps tripped up by CRAQ.. read more  

A Reality Check on DeepSeek's Distributed File System Benchmarks
Link
@faun shared a link, 5 months, 1 week ago
FAUN.dev()

Deploying Llama4 and DeepSeek on AI Hypercomputer

Meta's Llama4models, Scout and Maverick, strut around with17B active parametersunder a Mixture of Experts architecture. But deploying onGoogle Cloud's Trillium TPUsor A3 GPUs? That's become a breeze with new, fine-tuned recipes. Utilizing tools likeJetStreamandPathways? It means zipping through infe.. read more  

Deploying Llama4 and DeepSeek on AI Hypercomputer
Link
@faun shared a link, 5 months, 1 week ago
FAUN.dev()

ChatGPT polluted the world forever, like the first atom bomb

AI model collapsecould hit hard with synthetic data in play. Picturepre-2022 dataas the “low-background steel” savior for pristine datasets. The industry squabbles over thetrue fallout, while researchers clamor for policies that keep data unsullied. The worry? AI behemoths might lock everyone else o.. read more  

ChatGPT polluted the world forever, like the first atom bomb
Link
@faun shared a link, 5 months, 1 week ago
FAUN.dev()

Reinforcement Learning Teachers of Test Time Scaling

Reinforcement-Learned Teachers (RLTs)ripped through LLM training bloat by swapping "solve everything from ground zero" with "lay it out in clear terms." Shockingly, a lean 7B model took down hefty beasts likeDeepSeek R1. These RLTs flipped the script, letting smaller models school the big kahunas wi.. read more  

Reinforcement Learning Teachers of Test Time Scaling
Link
@faun shared a link, 5 months, 1 week ago
FAUN.dev()

AI at Amazon: a case study of brittleness

Amazon Alexa floundered amid brittle systems: a decentralized mess where teams rowed in opposing directions, clashing product and science cultures in tow... read more  

Link
@faun shared a link, 5 months, 1 week ago
FAUN.dev()

Training a Rust 1.5B Coder LM with Reinforcement Learning (GRPO)

DeepSeek-R1flips the script on training LLMs. Armed withGRPO, it challenges the industry heavies like OpenAI's o1 by playing smart with custom data and cleverly designed rewards. Imagine this: a humble 1.5B model, running on merely asingle H100, clocks in at an 80% build pass rate. It’s nibbling at .. read more  

Training a Rust 1.5B Coder LM with Reinforcement Learning (GRPO)
Link
@faun shared a link, 5 months, 1 week ago
FAUN.dev()

AWS' custom chip strategy is showing results, and cutting into Nvidia's AI dominance

Graviton4just cranked up the juice to600 Gbps. In the grand race of public cloud champions, it's gunning straight for Nvidia's AI kingdom, powered by the formidableProject Rainier... read more  

AWS' custom chip strategy is showing results, and cutting into Nvidia's AI dominance
Link
@faun shared a link, 5 months, 1 week ago
FAUN.dev()

Announcing up to 45% price reduction for Amazon EC2 NVIDIA GPU-accelerated instances

AWS chops up to45%from Amazon EC2 NVIDIA GPU prices. Now your AI training costs less even as GPUs play hard to get... read more  

Announcing up to 45% price reduction for Amazon EC2 NVIDIA GPU-accelerated instances
Link
@faun shared a link, 5 months, 1 week ago
FAUN.dev()

Scaling Test Time Compute to Multi-Agent Civilizations

Turns out, Reasoning AIs use a single test compute unit to pack the punch of something 1,000 to 10,000 times its size—an acrobatics act impossible before the might of GPT-4.Noam Brown spilled the beans on Ilya's hush-hush 2021 GPT-Zero experiment, which flipped his views on how soon we'd see reasoni.. read more  

Scaling Test Time Compute to Multi-Agent Civilizations
Link
@faun shared a link, 5 months, 1 week ago
FAUN.dev()

Mistral named most privacy-friendly AI, Google ranks low: report

Mistral AI’s “Le Chat” leads in privacy-focused AI, beating out OpenAI’s ChatGPT and xAI’s Grok.Consumer privacy concerns are reshaping the AI landscape, with 68% worried about online privacy.Regional regulations impact privacy practices, with Mistral AI benefiting from Europe’s strict GDPR rules... read more