mirror of https://github.com/facebook/rocksdb.git
7632fdb5cb
Summary: The compaction process takes some files from LevelK and merges it into LevelK+1. The number of files it picks from LevelK was capped such a way that the total amount of data picked does not exceed the maxfilesize of that level. This essentially meant that only one file from LevelK is picked for a single compaction. For bulkloads, we would like to take many many file from LevelK and compact them using a single compaction run. This patch introduces a option called the 'source_compaction_factor' (similar to expanded_compaction_factor). It is a multiplier that is multiplied by the maxfilesize of that level to arrive at the limit that is used to throttle the number of source files from LevelK. For bulk loads, set source_compaction_factor to a very high number so that multiple files from the same level are picked for compaction in a single compaction. The default value of source_compaction_factor is 1, so that we can keep backward compatibilty with existing compaction semantics. Test Plan: make clean check Reviewers: emayanke, sheki Reviewed By: emayanke CC: leveldb Differential Revision: https://reviews.facebook.net/D6867 |
||
|---|---|---|
| .. | ||
| arena.cc | ||
| arena.h | ||
| arena_test.cc | ||
| auto_split_logger.h | ||
| bloom.cc | ||
| bloom_test.cc | ||
| build_version.h | ||
| cache.cc | ||
| cache_test.cc | ||
| coding.cc | ||
| coding.h | ||
| coding_test.cc | ||
| comparator.cc | ||
| crc32c.cc | ||
| crc32c.h | ||
| crc32c_test.cc | ||
| env.cc | ||
| env_hdfs.cc | ||
| env_posix.cc | ||
| env_test.cc | ||
| filelock_test.cc | ||
| filter_policy.cc | ||
| hash.cc | ||
| hash.h | ||
| histogram.cc | ||
| histogram.h | ||
| ldb_cmd.cc | ||
| ldb_cmd.h | ||
| logging.cc | ||
| logging.h | ||
| murmurhash.cc | ||
| murmurhash.h | ||
| mutexlock.h | ||
| options.cc | ||
| posix_logger.h | ||
| random.h | ||
| stats_logger.h | ||
| status.cc | ||
| testharness.cc | ||
| testharness.h | ||
| testutil.cc | ||
| testutil.h | ||