Zerodha, a trading platform, has developed Blobasaur, a new distributed blob storage server. Blobasaur is built on top of SQLite and is designed to handle high-throughput read and write operations for JSON blobs. It processes thousands of requests per second on commodity hardware, maintaining single-digit millisecond latency.
Previously, Zerodha used CouchDB and then SSDB to store user preferences and metadata, which are primarily JSON blobs ranging from kilobytes to megabytes. SSDB, while initially solving performance issues, became unmaintained, posing an operational risk. Its C++ codebase was outside Zerodha's expertise, making internal maintenance unfeasible.
SSDB's single-node architecture also presented scaling challenges, leading to a 1MB cap on blob sizes to prevent latency degradation. As Zerodha's platform grew with features like Terminal mode, a more robust and scalable solution was required.
The criteria for the new storage solution included a key-value blob store with a simple API, designed for multi-megabyte blob operations and high throughput. It needed to be horizontally scalable, distributed, disk-space efficient, and easily maintainable. The system had to sustain loads of thousands to tens of thousands of requests per second, accommodating unpredictable and bursty traffic.
Blobasaur leverages SQLite as its core, providing a lightweight yet distributed solution for blob storage. This approach allows Zerodha to manage large volumes of user data efficiently while mitigating the risks associated with unmaintained or non-scalable legacy systems.
✨ This summary was generated by AI from the outlets' reporting listed below. It is not independently verified and may contain errors — check the original sources. How BrevFeed works →
One email each morning: the day's tech stories, clustered across outlets and summarized. No account needed.
One email a day. Unsubscribe in one click, any time.
Spend a few minutes, get the whole day. Every topic's top stories in one hands-free rundown — listen, watch, or read the transcript.
▶ Play today's briefNew every morning, and the back catalogue is archived by date.
Zerodha, a trading platform, developed Blobasaur, a sharded and distributed blob storage server built on SQLite. This system handles thousands of JSON blob read/write operations per second with single-digit millisecond latency on commodity hardware. Blobasaur replaces an unmaintained SSDB solution, addressing scaling limitations and operational risks for storing user preferences and metadata.