Google Git
Sign in
apache / kvrocks / refs/tags/v1.1.12
tag8ccf567b4d0a3aa8a84c3d7d003619e4f8584721
taggerkarelrooted <karelrooted@gmail.com>Wed Apr 15 14:15:31 2020 +0800
objectd72c632b101238743c1394b8c792cda24d597949 
commitd72c632b101238743c1394b8c792cda24d597949[log] [tgz]
authorkarelrooted <karelrooted@gmail.com>Wed Apr 15 14:15:15 2020 +0800
committerkarelrooted <karelrooted@gmail.com>Wed Apr 15 14:15:15 2020 +0800
treef11161e48a5d01eff422ee54119d5745fa2ff2ca
parentf1e9542143d9870aefd755b269e78e60fe6e13bb [diff]
Bump v1.1.12

2 files changed
tree: f11161e48a5d01eff422ee54119d5745fa2ff2ca
  1. .github/
  2. cmake/
  3. docs/
  4. external/
  5. src/
  6. systemd/
  7. tests/
  8. tools/
  9. .gitignore
  10. .gitmodules
  11. .travis.yml
  12. build.sh
  13. build_detect_platform
  14. Changelog
  15. CMakeLists.txt
  16. CONTRIBUTING
  17. cppcheck.sh
  18. cpplint.sh
  19. docker_push.sh
  20. Dockerfile
  21. kvrocks.conf
  22. kvrocks2redis.conf
  23. LICENSE
  24. Makefile
  25. package.sh
  26. README.md
README.md
kvrocks  image
kvrocks is an open-source key-value database. which is based on rocksdb and compatible with Redis protocol.  Intention to decrease the cost of memory and increase the capability while compared to Redis. The design of replication and storage was inspired by rocksplicator and blackwidow.
kvrocks has the following key features:
  • Redis protocol, user can use redis client to visit the kvrocks
  • Namespace, similar to redis db but use token per namespace
  • Replication, async replication using binlog like MySQL
  • High Available, supports redis sentinel to failover when master or slave was failed
  • Codis Protocol, the user can use the codis proxy and dashboard to manage the kvrocks
Who uses kvrocks
Build and run
requirements
  • g++ (required by c++11, version >= 4.8)
  • autoconf automake libtool
Build
NOTE: You shoud install the snappy first:
# Centos/Redhat
sudo yum install -y snappy snappy-devel autoconf automake libtool

# Ubuntu
sudo apt-get install libsnappy-dev autoconf automake libtool

# MACOSX
brew install snappy

$ git clone --recursive https://github.com/bitleak/kvrocks.git
$ cd kvrocks
$ make -j4

run
$ ./src/kvrocks -c kvrocks.conf

TEST
NOTE: You shoud install the googletest first
make test

Supported platforms
  • centos 6/7
  • ubuntu
  • macosx
Try kvrocks using Docker
$ docker run -it -p 6666:6666 hulkdev/kvrocks
$ redis-cli -p 6666

127.0.0.1:6666> get a
(nil)

Namspace
namespace was used to isolate data between users. unlike all the redis databases can be visited by requirepass, we use one token per namespace. requirepass was regraded as admin token, only admin token allows to access the namespace command, as well as some commands like config, slaveof, bgave, etc…
# add token
127.0.0.1:6666>  namespace add ns1 mytoken
OK

# update token
127.0.0.1:6666> namespace set ns1 new_token
OK

# list namespace
127.0.0.1:6666> namespace get *
1) "ns1"
2) "new_token"
3) "__namespace"
4) "foobared"

# delete namespace
127.0.0.1:6666> namespace del ns1
OK

DOCs
Migrate Tools
  • migrate from redis to kvrocks, use redis-migrate-tool which developed by vipshop
  • migrate from kvrocks to redis. use kvrocks2redis in build dir
Performance
Hardware
  • CPU: 48 cores Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz
  • Memory: 32 GiB
  • NET:  Intel Corporation I350 Gigabit Network Connection
  • DISK: 2TB NVMe Intel SSD DC P460
Benchmark Client:  multi-thread redis-benchmark(unstable branch)
1. Commands QPS
kvorkcs: workers = 16, benchmark: 8 threads/ 512 conns / 128 payload
latency: 99.9% < 10ms
image
2.  QPS on different payload
kvorkcs: workers = 16, benchmark: 8 threads/ 512 conns
latency: 99.9% < 10ms
image
3. QPS on different workers
kvorkcs: workers = 16, benchmark: 8 threads/ 512 conns / 128 payload
latency: 99.9% < 10ms
image
License
kvrocks is under the MIT license. See the LICENSE file for details.