dragonfly/README.md

195 lines
3.8 KiB
Markdown
Raw Normal View History

# Dragonfly
2021-11-24 20:17:44 +08:00
2021-12-21 17:07:29 +08:00
[![ci-tests](https://github.com/romange/dragonfly/actions/workflows/ci.yml/badge.svg)](https://github.com/romange/dragonfly/actions/workflows/ci.yml)
2022-03-03 15:34:53 +08:00
A novel memory store that supports Redis and Memcached commands.
For more detailed status of what's implemented - see below.
2021-11-24 20:17:44 +08:00
2022-03-03 15:34:53 +08:00
Features include:
2021-11-30 16:11:59 +08:00
1. High throughput reaching millions of QPS on a single node.
2. TLS support.
3. Pipelining mode.
2022-03-03 15:34:53 +08:00
4. A novel cache design, which does not require specifying eviction policies.
5. Memory efficiency that can save 20-40% for regular workloads and even more for cache like
workloads
2021-11-30 16:11:59 +08:00
## Building from source
I've tested the build on Ubuntu 21.04+.
```
git clone --recursive https://github.com/romange/dragonfly
cd dragonfly && ./helio/blaze.sh -release
cd build-opt && ninja dragonfly
2021-11-30 16:11:59 +08:00
```
## Running
```
./dragonfly --logtostderr
2021-11-30 16:11:59 +08:00
```
for more options, run `./dragonfly --help`
## Milestone Egg 🥚
API 1.0
- [X] String family
- [X] SET
- [ ] SETNX
- [X] GET
- [X] DECR
- [X] INCR
- [X] DECRBY
2022-01-10 02:43:49 +08:00
- [X] GETSET
- [X] INCRBY
- [X] MGET
- [X] MSET
- [ ] MSETNX
- [ ] SUBSTR
- [ ] Generic family
- [X] DEL
- [X] ECHO
- [X] EXISTS
- [X] EXPIRE
2022-01-10 02:43:49 +08:00
- [X] EXPIREAT
- [X] PING
- [X] RENAME
- [X] RENAMENX
- [X] SELECT
2022-01-10 02:43:49 +08:00
- [X] TTL
- [X] TYPE
- [ ] SORT
- [X] Server Family
- [X] QUIT
- [X] DBSIZE
- [ ] BGSAVE
- [X] SAVE
2022-01-10 02:43:49 +08:00
- [X] DBSIZE
- [X] DEBUG
- [X] EXEC
- [X] FLUSHALL
2022-01-10 02:43:49 +08:00
- [X] FLUSHDB
- [X] INFO
2022-01-10 02:43:49 +08:00
- [X] MULTI
- [X] SHUTDOWN
- [X] LASTSAVE
- [X] SLAVEOF/REPLICAOF
- [ ] SYNC
- [ ] Set Family
- [x] SADD
- [x] SCARD
- [X] SDIFF
- [X] SDIFFSTORE
- [X] SINTER
- [X] SINTERSTORE
- [X] SISMEMBER
- [X] SMOVE
- [X] SPOP
- [ ] SRANDMEMBER
- [X] SREM
- [X] SMEMBERS
- [X] SUNION
- [X] SUNIONSTORE
- [X] List Family
- [X] LINDEX
- [X] LLEN
- [X] LPOP
- [X] LPUSH
- [ ] LRANGE
- [ ] LREM
- [ ] LSET
- [ ] LTRIM
- [X] RPOP
- [ ] RPOPLPUSH
- [X] RPUSH
- [ ] SortedSet Family
- [ ] ZADD
- [ ] ZCARD
- [ ] ZINCRBY
- [ ] ZRANGE
- [ ] ZRANGEBYSCORE
- [ ] ZREM
- [ ] ZREMRANGEBYSCORE
- [ ] ZREVRANGE
- [ ] ZSCORE
- [ ] Not sure whether these are required for the initial release.
2022-02-20 19:49:37 +08:00
- [X] AUTH
- [ ] BGREWRITEAOF
- [ ] KEYS
- [ ] MONITOR
- [ ] RANDOMKEY
- [ ] MOVE
In addition, we want to support efficient expiry (TTL) and cache eviction algorithms.
We should implement basic memory management support. For Master/Slave replication we should design
a distributed log format.
2022-02-20 19:49:37 +08:00
### Memchache API
- [X] set
- [X] get
- [X] replace
- [X] add
- [X] stats (partial)
- [x] append
- [x] prepend
- [x] delete
- [ ] flush_all
- [x] incr
- [x] decr
- [x] version
- [x] quit
2022-02-20 19:49:37 +08:00
API 2.0
- [ ] List Family
- [X] BLPOP
- [ ] BRPOP
- [ ] BRPOPLPUSH
2022-03-03 15:34:53 +08:00
- [X] HashSet Family
- [X] HSET
- [X] HDEL
- [X] HEXISTS
- [X] HGET
- [X] HLEN
- [ ] HINCRBY
- [ ] HINCRBYFLOAT
- [ ] HGETALL
- [ ] PubSub family
- [ ] PUBLISH
- [ ] PUBSUB
- [ ] PUBSUB CHANNELS
- [ ] SUBSCRIBE
- [ ] UNSUBSCRIBE
- [ ] Server Family
- [ ] WATCH
- [ ] UNWATCH
- [ ] DISCARD
- [X] Generic Family
- [X] SCAN
- [X] String Family
- [X] APPEND
- [X] PREPEND (dragonfly specific)
2022-01-10 02:43:49 +08:00
Commands that I prefer not implement before launch:
- [ ] PUNSUBSCRIBE
- [ ] PSUBSCRIBE
Also, I would omit keyspace notifications. For that I would like to deep dive and learn
exact use-cases for this API.
### Random commands we implemented along the way
- [X] ROLE (2.8) decorator for for master withour replicas
- [X] UNLINK (4.0) decorator for DEL command
- [X] BGSAVE
## Milestone Nymph
2022-01-10 02:43:49 +08:00
API 2,3,4 without cluster support, without modules, without memory inspection commands.
Without support for keyspace notifications.
2022-01-10 02:43:49 +08:00
2022-01-09 02:36:52 +08:00
Design config support. ~140 commands overall...
## Milestone Molt
2022-01-09 02:36:52 +08:00
API 5,6 - without cluster and modules. Streams support. ~80 commands overall.
## Milestone Adult
2022-01-09 02:36:52 +08:00
TBD.