Original Summary

Hi all,<p>So I have been working on this project KiviDB from February 2026. It started as a project for me to understand rust, having a product with no GC pauses, memory blow up after snapshots and getting OOM on running pods, and that was actually an issue I faced with Dragonfly. I wanted to have something picking the best of Rust, but also picking the best parts of other alternatives like Garnet and Dragonfly. I used AI a lot, but I was the one making the design decisions based on the tests that claude picked from my history of troubleshooting sessions as part of my job. KiviDB supports both RESP2 and RESP3 protocol. I had some founders credits on my AWS account which helped me with the infra, and running instances I could perform benchmark on.<p>Its keyspace is sharded across threads, it is multi-threaded in nature, and performs best on Linux due to io_uring, I used the tokio_uring crate for this. It also has tokio fallback for other OS&#x27;s. I hadn&#x27;t open sourced it until recently as I felt it was not ready yet, the best way to learn it was to build a cloud managed service for it across all three widely used cloud providers i.e AWS, GCP and azure. Since I used to mainly work with cloud, I had some insights on what would be the best ways for the deployments, how to conduct failovers, manage SLAs, etc. And that&#x27;s what I took help from claude to fast pace it. The website does look like AI slop but it works for now, given my limited resources, that&#x27;s all I had. You may check it out at : <a href="https:&#x2F;&#x2F;kividb.io" rel="nofollow">https:&#x2F;&#x2F;kividb.io</a>, I open sourced the core engine under AGPLv3, didn&#x27;t want to have just source available, because that is available with other tools too. It supports apprx 98-99% of the redis 8.10 commands, few have issues and you can find them at <a href="https:&#x2F;&#x2F;github.com&#x2F;kividbio&#x2F;kividb&#x2F;issues" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;kividbio&#x2F;kividb&#x2F;issues</a>, contributors are welcome.<p>Now the numbers, for the final benchmark, I used 2 c7gn.metal servers, in the same placement group in us-east1, and I used memtier-benchmark tool for this. The setting was : 10M keys, 100B each, 32 cores in use with both pipeline and un-pipelined runs.<p>pipeline 16 GET: KiviDB 21.2M ops&#x2F;sec vs Dragonfly 2.0 9.1M, Redis 8.10 2.4M, Redis Cluster 32 shards 4.7M<p>When not pipelined, Dragonfly performed slightly better at 3.35M ops&#x2F;sec vs kividb at 3.07M ops&#x2F;sec. Memory per key was also slightly worse than dragonfly and almost same as Redis, 177B (kividb) vs 134B (dragonfly) vs 178B (redis).<p>With vector ingestion times it was slower but when querying, it was faster than most alternatives at lower ef, however slower than dragonfly at high ef. Most of the technical details are mentioned here so you can check it out: <a href="https:&#x2F;&#x2F;kividb.io&#x2F;benchmarks" rel="nofollow">https:&#x2F;&#x2F;kividb.io&#x2F;benchmarks</a>.<p>easiest way to try it: docker run -d -p 6380:6380 kividb&#x2F;kividb<p>I am looking forward to building a community around this, provide better rust based tools, I am open to constructive criticism and value informed opinion. Thanks

  • 情报分类：工作与职业机会
  • 分类依据：内容涉及招聘、求职或职业发展
  • 信息来源：Hacker News 新项目
  • 发布时间：2026/10/19 21:53:52