Lessons from scaling PostgreSQL queues to 100K events
RudderStack crankedPostgreSQLup to100K events/secas a queuing engine. The secret sauce: tight tuning of job partitioning, smarter indexing, tuned VACUUM timing, and compaction that didn't choke. Recursive CTEs stood in for loose index scans. Caching cut I/O repeats. They ditched byte slices to side..