A technical deep-dive into scaling real-time multiplayer systems. For engineers working on distributed backends, tile processors, and fan-out.
Problem framing: why naive fan-out breaks at scale. An overview of the Black Skies distributed architecture and the constraints that shaped our design decisions.
Node failure detection and cluster membership at 10,000 players. How SWIM gossip protocol enables scalable failure detection without centralized coordination.
Case study of tile processor sharding, backpressure, and delivery guarantees. How Redis sharded pub/sub enables viewport-relevant event delivery.
Command validation, intent collection, and the 500ms tick budget. How client actions flow into tile processors and get validated before execution.
How the world dynamically expands and contracts based on player distribution. The garbage collection model for tile processors and preemptive neighbor spawning.
Why we chose Protobuf over FlatBuffers, heartbeat coalescing, and Zstandard compression. The wire format decisions that saved 40% bandwidth.
Handling thundering herds, passive mode for alt-tabbed clients, and edge caching strategies. The final 20% of performance gains.