Find a file
Zhichao Cao fbda25f57a db_stress: generate the key based on Zipfian distribution (hot key) (#6163)
Summary:
In the current db_stress, all the keys are generated randomly and follows the uniform distribution. In order to test some corner cases that some key are always updated or read, we need to generate the key based on other distributions. In this PR, the key is generated based on Zipfian distribution and the skewness can be controlled by setting hot_key_alpha (0.8 to 1.5 is suggested). The larger hot_key_alpha is, the more skewed will be. Not that, usually, if hot_key_alpha is larger than 2, there might be only 1 or 2 keys that are generated. If hot_key_alpha is 0, it generate the key follows uniform distribution (random key)

Testing plan: pass the db_stress and printed the keys to make sure it follows the distribution.
Pull Request resolved: https://github.com/facebook/rocksdb/pull/6163

Differential Revision: D18978480

Pulled By: zhichao-cao

fbshipit-source-id: e123b4865477f7478e83fb581f9576bada334680
2019-12-16 14:01:58 -08:00
buckifier
build_tools
cache
cmake
coverage
db Fix a data race related to memtable trimming (#6187) 2019-12-16 13:16:31 -08:00
db_stress_tool db_stress: generate the key based on Zipfian distribution (hot key) (#6163) 2019-12-16 14:01:58 -08:00
docs
env Fix unity test (#6178) 2019-12-14 15:39:41 -08:00
examples
file Introduce a new storage specific Env API (#5761) 2019-12-13 14:48:41 -08:00
hdfs
include/rocksdb Introduce a new storage specific Env API (#5761) 2019-12-13 14:48:41 -08:00
java Env should also load the native library (#6167) 2019-12-13 16:27:55 -08:00
logging Introduce a new storage specific Env API (#5761) 2019-12-13 14:48:41 -08:00
memory
memtable
monitoring
options Introduce a new storage specific Env API (#5761) 2019-12-13 14:48:41 -08:00
port
table Optimize memory and CPU for building new Bloom filter (#6175) 2019-12-15 21:31:08 -08:00
test_util Introduce a new storage specific Env API (#5761) 2019-12-13 14:48:41 -08:00
third-party
tools Add long-running snapshots to stress tests (#6171) 2019-12-14 15:22:40 -08:00
trace_replay
util Optimize memory and CPU for building new Bloom filter (#6175) 2019-12-15 21:31:08 -08:00
utilities Make it possible to enable periodic compactions for BlobDB (#6172) 2019-12-13 16:13:25 -08:00
.clang-format
.gitignore
.lgtm.yml
.travis.yml
.watchmanconfig
appveyor.yml
AUTHORS
CMakeLists.txt Introduce a new storage specific Env API (#5761) 2019-12-13 14:48:41 -08:00
CODE_OF_CONDUCT.md
CONTRIBUTING.md
COPYING
DEFAULT_OPTIONS_HISTORY.md
defs.bzl
DUMP_FORMAT.md
HISTORY.md Introduce a new storage specific Env API (#5761) 2019-12-13 14:48:41 -08:00
INSTALL.md
issue_template.md
LANGUAGE-BINDINGS.md
LICENSE.Apache
LICENSE.leveldb
Makefile
README.md
ROCKSDB_LITE.md
src.mk Introduce a new storage specific Env API (#5761) 2019-12-13 14:48:41 -08:00
TARGETS Introduce a new storage specific Env API (#5761) 2019-12-13 14:48:41 -08:00
thirdparty.inc
USERS.md
Vagrantfile
WINDOWS_PORT.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

Linux/Mac Build Status Windows Build status PPC64le Build Status

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key-value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it especially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/

License

RocksDB is dual-licensed under both the GPLv2 (found in the COPYING file in the root directory) and Apache 2.0 License (found in the LICENSE.Apache file in the root directory). You may select, at your option, one of the above-listed licenses.