Cloudflare Reclaims 100 TB of RAM by Optimizing Consistent Hashing

T2Covered by 1 source · first reported by InfoQ at 24 Oct, 08:10 UTC

Cloudflare recently documented how it reduced the memory footprint of its internal load-balancing service by more than 100 TB by optimizing the Rust implementation of consistent hashing in pingora-ketama. The changes compacted hash-ring entries and used statistical analysis of hash distribution and…