Go to file
Yueh-Hsuan Chiang 6c66918645 Speed up DB::Open() and Version creation by limiting the number of FileMetaData initialization.
Summary:
This diff speeds up DB::Open() and Version creation by limiting the number of FileMetaData initialization. The behavior of Version::UpdateAccumulatedStats() is changed as follows:

* It only initializes the first 20 uninitialized FileMetaData from file.  This guarantees the size of the latest 20 files will always be compensated when they have any deletion entries.  Previously it may initialize all FileMetaData by loading all files at DB::Open().
* In case none the first 20 files has any data entry, UpdateAccumulatedStats() will initialize the FileMetaData of the oldest file.

Test Plan: db_test

Reviewers: igor, sdong, ljin

Reviewed By: ljin

Subscribers: leveldb

Differential Revision: https://reviews.facebook.net/D24255
2014-10-17 14:58:30 -07:00
build_tools Cross-platform fix version.sh 2014-10-04 11:17:06 +02:00
coverage Disable the html-based coverage report by default 2014-02-06 12:58:13 -08:00
db Speed up DB::Open() and Version creation by limiting the number of FileMetaData initialization. 2014-10-17 14:58:30 -07:00
doc Remove seek compaction 2014-06-20 10:23:02 +02:00
examples Make it easier to start using RocksDB 2014-05-10 10:49:33 -07:00
hdfs hdfs cleanup and compile test against CDH 4.4. 2014-05-20 17:22:12 -04:00
helpers/memenv Expose in memory Env to the world 2014-04-14 12:28:15 -07:00
include WriteBatchWithIndex supports an iterator that merge its change with a base iterator. 2014-10-10 19:02:58 -07:00
java Filters getting disposed by System.gc before EOL 2014-10-15 20:59:25 +02:00
linters Removed code which prevents `arc lint` from working properly. 2014-10-07 17:40:19 +02:00
port Avoid off-by-one error when using readlink 2014-09-05 20:50:29 -07:00
table Merge pull request #327 from dalgaaf/wip-da-SCA-20141001 2014-10-02 10:59:52 -07:00
third-party/rapidjson Fix a rapidjson compile error in mac. 2014-06-23 17:09:24 -06:00
tools minor update to benchmark script 2014-10-10 09:55:40 -07:00
util Fix mac compile, second try 2014-10-17 12:09:45 -04:00
utilities WriteBatchWithIndex's Iterator bug of SeekToFirst() and SeekToLast() 2014-10-15 07:33:32 -07:00
.arcconfig Improve/fix bugs for the cpp linter 2014-02-13 17:48:11 -08:00
.clang-format A script that automatically reformat affected lines 2014-01-14 12:21:24 -08:00
.gitignore fix java doc directory in git ignore 2014-10-06 08:23:31 -07:00
.travis.yml Only run make unity on travis instead of make check 2014-09-18 09:53:13 -07:00
AUTHORS Add AUTHORS file. Fix #203 2014-09-29 10:52:18 -07:00
CONTRIBUTING.md facebook accounts are not required for CLA signers 2014-07-08 05:57:54 -04:00
HISTORY.md WriteBatchWithIndex to support an option to overwrite rows when operating the same key 2014-10-10 15:19:21 -07:00
INSTALL.md Update INSTALL.md 2014-10-01 11:15:42 -07:00
LICENSE Fix copyright year 2014-03-12 12:06:58 -07:00
Makefile merge master to resolve merge conflicts 2014-10-06 08:22:55 -07:00
PATENTS Fix the patent format 2013-10-16 15:37:32 -07:00
README.md Replaced "built on on earlier work" by "built on earlier work" in README.md 2014-09-17 01:16:17 -07:00
ROCKSDB_LITE.md RocksDBLite 2014-04-15 13:39:26 -07:00
Vagrantfile Package generation for Ubuntu and CentOS 2014-09-29 16:09:46 -07:00

README.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

Build Status

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/