dolysis/rocksdb
3
0
Fork 0
mirror of https://github.com/facebook/rocksdb.git synced 2024-11-26 16:30:56 +00:00
Code Issues Packages Projects Releases Wiki Activity
rocksdb/util
History
Ari Ekmekji f0da6977a3 [Parallel L0-L1 Compaction Prep]: Giving Subcompactions Their Own State 
Summary:
In prepration for running multiple threads at the same time during
a compaction job, this patch assigns each subcompaction its own state
(instead of sharing the one global CompactionState). Each subcompaction then
uses this state to update its statistics, keep track of its snapshots, etc.
during the course of execution. Then at the end of all the executions the
statistics are aggregated across the subcompactions so that the final result
is the same as if only one larger compaction had run.

Test Plan: ./db_test  ./db_compaction_test  ./compaction_job_test

Reviewers: sdong, anthony, igor, noetzli, yhchiang

Reviewed By: yhchiang

Subscribers: MarkCallaghan, dhruba, leveldb

Differential Revision: https://reviews.facebook.net/D43239
2015-08-18 11:06:23 -07:00
..
allocator.h
arena.cc Commit both PR and internal code review changes 2015-07-07 16:58:20 -07:00
arena.h
arena_test.cc
auto_roll_logger.cc Fix WinEnv::NowMicrosec 2015-07-22 14:36:43 -07:00
auto_roll_logger.h Windows Port from Microsoft 2015-07-01 16:13:56 -07:00
auto_roll_logger_test.cc Fix when output level is 0 of universal compaction with trivial move 2015-07-27 14:25:57 -07:00
autovector.h "make format" against last 10 commits 2015-07-13 13:50:18 -07:00
autovector_test.cc
bloom.cc
bloom_test.cc
build_version.h
cache.cc
cache_bench.cc
cache_test.cc
channel.h Multithreaded backup and restore in BackupEngineImpl 2015-07-02 11:35:51 -07:00
coding.cc
coding.h
coding_test.cc
compaction_job_stats_impl.cc [Parallel L0-L1 Compaction Prep]: Giving Subcompactions Their Own State 2015-08-18 11:06:23 -07:00
comparator.cc Fixed Segmentation Fault in db_stress on OSX. 2015-08-11 10:55:27 -07:00
compression.h
crc32c.cc Print Fast CRC32 support information in DB LOG 2015-07-10 17:59:36 -07:00
crc32c.h Print Fast CRC32 support information in DB LOG 2015-07-10 17:59:36 -07:00
crc32c_test.cc
db_info_dumper.cc extend temp str buffer size 2015-07-16 13:56:17 +08:00
db_info_dumper.h
db_test_util.cc Update Tests To Enable Subcompactions 2015-08-04 22:19:07 -07:00
db_test_util.h Add two unit tests for SyncWAL() 2015-08-05 14:27:02 -07:00
delete_scheduler_impl.cc Make DeleteScheduler tests more reliable 2015-08-05 19:16:52 -07:00
delete_scheduler_impl.h Support delete rate limiting 2015-08-04 20:45:27 -07:00
delete_scheduler_test.cc More accurate time measurement for delete_scheduler_test 2015-08-07 15:37:56 -07:00
dynamic_bloom.cc
dynamic_bloom.h Commit both PR and internal code review changes 2015-07-07 16:58:20 -07:00
dynamic_bloom_test.cc
env.cc Ensure Windows build w/o port/port.h in public headers 2015-07-16 12:10:16 -07:00
env_hdfs.cc [Cleanup] Remove RandomRWFile 2015-08-12 10:18:59 -07:00
env_posix.cc [Cleanup] Remove RandomRWFile 2015-08-12 10:18:59 -07:00
env_test.cc [Cleanup] Remove RandomRWFile 2015-08-12 10:18:59 -07:00
event_logger.cc
event_logger.h Added JSON manifest dump option to ldb command 2015-07-17 10:07:40 -07:00
event_logger_test.cc
file_reader_writer.cc Measure file read latency histogram per level 2015-08-14 17:32:42 -07:00
file_reader_writer.h Measure file read latency histogram per level 2015-08-14 17:32:42 -07:00
file_reader_writer_test.cc RangeSync not to sync last 1MB of the file 2015-07-21 16:22:40 -07:00
file_util.cc Move rate_limiter, write buffering, most perf context instrumentation and most random kill out of Env 2015-07-17 16:58:18 -07:00
file_util.h
filelock_test.cc
filter_policy.cc
hash.cc
hash.h
hash_cuckoo_rep.cc "make format" against last 10 commits 2015-07-13 13:50:18 -07:00
hash_cuckoo_rep.h
hash_linklist_rep.cc "make format" against last 10 commits 2015-07-13 13:50:18 -07:00
hash_linklist_rep.h
hash_skiplist_rep.cc
hash_skiplist_rep.h
heap.h Replace std::priority_queue in MergingIterator with custom heap, take 2 2015-07-15 03:34:40 -07:00
heap_test.cc Fix compile on Mac 2015-07-16 11:22:21 +02:00
histogram.cc
histogram.h "make format" against last 10 commits 2015-07-13 13:50:18 -07:00
histogram_test.cc
instrumented_mutex.cc
instrumented_mutex.h
iostats_context.cc Add options.compaction_measure_io_stats to print write I/O stats in compactions 2015-08-13 16:52:26 -07:00
iostats_context_imp.h
ldb_cmd.cc dump_manifest supports DB with more number of levels 2015-08-03 11:02:09 -07:00
ldb_cmd.h Added JSON manifest dump option to ldb command 2015-07-17 10:07:40 -07:00
ldb_cmd_execute_result.h Windows Port from Microsoft 2015-07-01 16:13:56 -07:00
ldb_tool.cc
log_buffer.cc Commit both PR and internal code review changes 2015-07-07 16:58:20 -07:00
log_buffer.h Windows Port from Microsoft 2015-07-01 16:13:56 -07:00
log_write_bench.cc
logging.cc
logging.h
manual_compaction_test.cc Ensure Windows build w/o port/port.h in public headers 2015-07-16 12:10:16 -07:00
memenv.cc Improved FileExists API 2015-07-20 17:20:40 -07:00
memenv_test.cc Improved FileExists API 2015-07-20 17:20:40 -07:00
mock_env.cc [Cleanup] Remove RandomRWFile 2015-08-12 10:18:59 -07:00
mock_env.h [Cleanup] Remove RandomRWFile 2015-08-12 10:18:59 -07:00
mock_env_test.cc Improved FileExists API 2015-07-20 17:20:40 -07:00
murmurhash.cc
murmurhash.h
mutable_cf_options.cc Don't let flushes preempt compactions 2015-07-17 12:02:52 -07:00
mutable_cf_options.h Add options.compaction_measure_io_stats to print write I/O stats in compactions 2015-08-13 16:52:26 -07:00
mutexlock.h
options.cc Add options.compaction_measure_io_stats to print write I/O stats in compactions 2015-08-13 16:52:26 -07:00
options_builder.cc
options_helper.cc Add options.compaction_measure_io_stats to print write I/O stats in compactions 2015-08-13 16:52:26 -07:00
options_helper.h
options_test.cc Add options.compaction_measure_io_stats to print write I/O stats in compactions 2015-08-13 16:52:26 -07:00
perf_context.cc Ensure Windows build w/o port/port.h in public headers 2015-07-16 12:10:16 -07:00
perf_context_imp.h
perf_level.cc Windows Port from Microsoft 2015-07-01 16:13:56 -07:00
perf_level_imp.h Windows Port from Microsoft 2015-07-01 16:13:56 -07:00
perf_step_timer.h
posix_logger.h Commit both PR and internal code review changes 2015-07-07 16:58:20 -07:00
random.h
rate_limiter.cc Windows Port from Microsoft 2015-07-01 16:13:56 -07:00
rate_limiter.h Windows Port from Microsoft 2015-07-01 16:13:56 -07:00
rate_limiter_test.cc
scoped_arena_iterator.h
skiplistrep.cc
slice.cc "make format" against last 10 commits 2015-07-13 13:50:18 -07:00
slice_transform_test.cc
sst_dump_test.cc Compression sizes option for sst_dump_tool 2015-07-29 17:42:13 -07:00
sst_dump_tool.cc Merge branch 'master' of github.com:facebook/rocksdb 2015-08-04 10:56:49 -07:00
sst_dump_tool_imp.h Compression sizes option for sst_dump_tool 2015-07-29 17:42:13 -07:00
statistics.cc Add Statistics.getHistogramString() to print more detailed outputs of a histogram 2015-08-05 20:05:56 -07:00
statistics.h Add Statistics.getHistogramString() to print more detailed outputs of a histogram 2015-08-05 20:05:56 -07:00
status.cc Transaction error statuses 2015-08-11 17:52:56 -07:00
stl_wrappers.h
stop_watch.h
string_util.cc
string_util.h Windows Port from Microsoft 2015-07-01 16:13:56 -07:00
sync_point.cc Move rate_limiter, write buffering, most perf context instrumentation and most random kill out of Env 2015-07-17 16:58:18 -07:00
sync_point.h Move rate_limiter, write buffering, most perf context instrumentation and most random kill out of Env 2015-07-17 16:58:18 -07:00
testharness.cc
testharness.h
testutil.cc Simplify querying of merge results 2015-08-17 17:34:38 -07:00
testutil.h Simplify querying of merge results 2015-08-17 17:34:38 -07:00
thread_list_test.cc
thread_local.cc Fixed clang-build error in util/thread_local.cc 2015-08-11 13:30:49 -07:00
thread_local.h Fixed clang-build error in util/thread_local.cc 2015-08-11 13:30:49 -07:00
thread_local_test.cc Windows Port from Microsoft 2015-07-01 16:13:56 -07:00
thread_operation.h Deprecate CompactionFilterV2 2015-07-17 18:59:11 +02:00
thread_status_impl.cc Windows Port from Microsoft 2015-07-01 16:13:56 -07:00
thread_status_updater.cc Windows Port from Microsoft 2015-07-01 16:13:56 -07:00
thread_status_updater.h Windows Port from Microsoft 2015-07-01 16:13:56 -07:00
thread_status_updater_debug.cc
thread_status_util.cc
thread_status_util.h
thread_status_util_debug.cc
vectorrep.cc Windows Port from Microsoft 2015-07-01 16:13:56 -07:00
xfunc.cc Merge the latest changes from github/master 2015-07-02 17:23:41 -07:00
xfunc.h Merge the latest changes from github/master 2015-07-02 17:23:41 -07:00
xxhash.cc
xxhash.h