Valkey Developers Discuss Project Evolution and Technical Advancements at OSS EU

Project Growth and Governance

Valkey, a project forked from Redis over two years ago, is expanding its community and technical leadership. It currently has twelve maintainers and nine technical steering committee members, representing eight different companies including Ericsson, AWS, Apple, and Percona. The project has also hosted multiple community conferences, attracting up to one hundred participants.

8.x Release: Foundational Infrastructure Improvements

The 8.x releases focused on foundational infrastructure enhancements. Asynchronous I/O threading increased throughput from approximately 200,000-250,000 requests per second to around one million per process. This update also allows for runtime configuration changes to thread settings, enabling operators to add cores for burst workloads. Additionally, versions 8.0 and 8.1 included memory efficiency work through key embedding and per-slot dictionaries.

Dual-channel replication was introduced to alleviate pressure on primary nodes during replica synchronization. This new method sends a full dataset copy and subsequent replication changes in parallel, reducing the memory pressure associated with the process.

Version 9: Cluster Mode Enhancements

Version 9 brought significant improvements to Valkey's cluster mode. It introduced support for numbered databases, which were previously unavailable in cluster mode and had prevented some users from migrating from single-instance deployments. This change addresses a key limitation for users requiring namespace separation.

Atomic slot migration was also added to address issues with partial migrations. The new approach pre-stages data before switching over, ensuring that migrations either complete fully or do not take effect at all, preventing inconsistent cluster states. Version 9 also included hash-field expiration.