rocksdb/tools
Maysam Yabandeh 9690653db5 Add a verify phase to benchmarks
Summary:
Check the result of the benchmark againt a specified truth_db, which is
expected to be produced using the same benchmark but perhaps on a
different commit or with different configs.

The verification is simple and assumes that key/values are generated
deterministically. This assumption would break if db_bench using rand
variable differently from the benchmark that produced truth_db.
Currently it is checked to work on fillrandom and readwhilewriting.

A param finish_after_writes is added to ensure that the background
writing thread will write the same number of entries between two
benchmarks.

Example:
$ TEST_TMPDIR=/dev/shm/truth_db ./db_bench
--benchmarks="fillrandom,readwhilewriting" --num=200000
--finish_after_writes=true
$ TEST_TMPDIR=/dev/shm/tmpdb ./db_bench
--benchmarks="fillrandom,readwhilewriting,verify" --truth_db
/dev/shm/truth_db/dbbench --num=200000 --finish_after_writes=true
Verifying db <= truth_db...
Verifying db >= truth_db...
...Verified
Closes https://github.com/facebook/rocksdb/pull/2098

Differential Revision: D4839233

Pulled By: maysamyabandeh

fbshipit-source-id: 2f4ed31
2017-04-07 11:39:12 -07:00
..
dump Updated all copyright headers to the new format. 2016-02-09 15:12:00 -08:00
rdb Move auto_roll_logger and filename out of db/ 2017-04-03 18:39:14 -07:00
CMakeLists.txt cmake support for linux and osx (#1358) 2016-09-28 11:53:15 -07:00
Dockerfile adding docker build script and dockerfile 2015-05-22 16:03:39 -07:00
auto_sanity_test.sh fix typos in comments 2015-12-11 01:54:48 +09:00
benchmark.sh remove deleted option from benchmark.sh 2017-03-21 12:54:13 -07:00
benchmark_leveldb.sh Add scripts to run leveldb benchmark 2015-04-27 19:32:56 -07:00
check_format_compatible.sh check_format_compatible.sh to use some branch which allows to run with GCC 4.8 (#1393) 2016-10-13 16:15:55 -07:00
db_bench.cc Initial script for the new regression test 2016-05-09 13:32:57 -07:00
db_bench_tool.cc Add a verify phase to benchmarks 2017-04-07 11:39:12 -07:00
db_bench_tool_test.cc Move some files under util/ to separate dirs 2017-04-05 19:09:16 -07:00
db_crashtest.py Remove disableDataSync option 2017-02-13 11:09:13 -08:00
db_repl_stress.cc Updated all copyright headers to the new format. 2016-02-09 15:12:00 -08:00
db_sanity_test.cc Support ZSTD with finalized format 2016-09-06 12:22:16 -07:00
db_stress.cc Move some files under util/ to separate dirs 2017-04-05 19:09:16 -07:00
dbench_monitor Added simple monitoring script to monitor overusage of memory in db_bench 2015-02-11 18:40:11 -08:00
generate_random_db.sh Script to check whether RocksDB can read DB generated by previous releases and vice versa 2015-04-08 16:04:59 -07:00
ldb.cc Updated all copyright headers to the new format. 2016-02-09 15:12:00 -08:00
ldb_cmd.cc Move auto_roll_logger and filename out of db/ 2017-04-03 18:39:14 -07:00
ldb_cmd_impl.h add checkpoint to ldb 2017-03-21 11:54:11 -07:00
ldb_cmd_test.cc cast to signed char in ldb_cmd_test for ppc64le 2016-12-12 14:39:18 -08:00
ldb_test.py Add ability to search for key prefix in sst_dump tool 2017-03-13 10:39:12 -07:00
ldb_tool.cc Allow Users to change customized ldb tools' header in help printing 2017-03-21 17:39:12 -07:00
pflag Added simple monitoring script to monitor overusage of memory in db_bench 2015-02-11 18:40:11 -08:00
reduce_levels_test.cc Move various string utility functions into string_util 2017-04-06 14:54:12 -07:00
regression_test.sh build db every monday 2017-04-05 12:24:21 -07:00
rocksdb_dump_test.sh Update dump_tool and undump_tool to accept Options 2015-10-05 19:49:48 -07:00
run_flash_bench.sh Update benchmarks used to measure subcompaction performance 2016-03-04 12:32:11 -08:00
run_leveldb.sh Add scripts to run leveldb benchmark 2015-04-27 19:32:56 -07:00
sample-dump.dmp First version of rocksdb_dump and rocksdb_undump. 2015-06-19 16:24:36 -07:00
sst_dump.cc Updated all copyright headers to the new format. 2016-02-09 15:12:00 -08:00
sst_dump_test.cc Add TableBuilderOptions::level and relevant changes (#1335) 2016-09-17 22:30:43 -07:00
sst_dump_tool.cc Move some files under util/ to separate dirs 2017-04-05 19:09:16 -07:00
sst_dump_tool_imp.h Move some files under util/ to separate dirs 2017-04-05 19:09:16 -07:00
verify_random_db.sh Script to check whether RocksDB can read DB generated by previous releases and vice versa 2015-04-08 16:04:59 -07:00
write_stress.cc Move auto_roll_logger and filename out of db/ 2017-04-03 18:39:14 -07:00
write_stress_runner.py Write stress test 2015-10-28 16:15:07 -07:00