● Covered by 1 source · 1 reportMedium impact
DoorDash Launches Entity Cache for 1.5M RPS with 99.99999% Availability
DoorDash has introduced Entity Cache, a proxy caching platform to efficiently manage service requests across its microservices. This system streamlines service communication, achieving over 1.5 million requests per second with 99.99999% availability, reducing backend load and improving response times.
Key points
- Entity Cache supports over 100 endpoints across 50 services.
- Achieves over 1.5 million requests per second.
- Built on Envoy and Valkey, integrating caching with service mesh.
Overview of Entity Cache
DoorDash has developed Entity Cache to enhance request management within its microservices architecture. This platform addresses the issue of redundant service-to-service requests for frequently accessed data, which previously escalated backend load and latency issues.
By deploying a transparent proxy layer, Entity Cache allows services to continue their operations without modification, simplifying the integration of caching into existing applications.
Technical Foundation
Entity Cache relies on Envoy and Valkey, operating within DoorDash’s existing infrastructure. It intercepts both HTTP and gRPC requests, storing responses to reduce the strain on upstream services by serving cached results when available.
This architecture allows centralized control over cache management, making it more efficient than traditional caching solutions.
Performance and Reliability Features
Entity Cache incorporates various features aimed at reliability and performance, such as request coordination and intelligent invalidation methods. The use of Kafka-based event-driven invalidation helps in maintaining cache freshness without necessitating comprehensive distributed cache deletions.
Additionally, the proxy can handle slightly stale responses during outages, ensuring continued availability.
Operational Impact
The new caching mechanism has shown benefits, especially during production challenges, enabling DoorDash to maintain high service availability. The system reduces the overall compute resource burden while improving response latency for frequently requested data.
✨ This summary was generated by AI from the outlets' reporting listed below. It is not independently verified and may contain errors — check the original sources. How BrevFeed works →
The daily brief
One email each morning: the day's tech stories, clustered across outlets and summarized. No account needed.
One email a day. Unsubscribe in one click, any time.
Today's brief
Spend a few minutes, get the whole day. Every topic's top stories in one hands-free rundown — listen, watch, or read the transcript.
▶ Play today's brief
New every morning, and the back catalogue is archived by date.
Reporting from
DoorDash has introduced Entity Cache, a proxy caching platform to efficiently manage service requests across its microservices. This system streamlines service communication, achieving over 1.5 million requests per second with 99.99999% availability, reducing backend load and improving response times.