Go to file
Venkatesh Radhakrishnan 04251e1e3a Add wal files to Checkpoint for multiple column families.
Summary:
When there are multiple column families, the flush in
GetLiveFiles is not atomic, so that there are entries in the wal files
which are needed to get a consisten RocksDB. We now add the log files to
the checkpoint.

Test Plan:
CheckpointCF - This test forces more data to be written to
the other column families after the flush of the first column family but
before the second.

Reviewers: igor, yhchiang, IslamAbdelRahman, anthony, kradhakrishnan, sdong

Reviewed By: sdong

Subscribers: dhruba, leveldb

Differential Revision: https://reviews.facebook.net/D40323
2015-06-19 16:08:31 -07:00
arcanist_util Integrate Jenkins with Phabricator 2015-04-07 11:56:29 -07:00
build_tools Move dockerbuild.sh to build_tools/ 2015-06-17 14:09:12 -07:00
coverage Fix coverage script 2014-11-03 14:53:00 -08:00
db Add wal files to Checkpoint for multiple column families. 2015-06-19 16:08:31 -07:00
doc Remove seek compaction 2014-06-20 10:23:02 +02:00
examples [API Change] Improve EventListener::OnFlushCompleted interface 2015-06-05 12:28:51 -07:00
hdfs Add Env::GetThreadID(), which returns the ID of the current thread. 2015-06-11 14:18:02 -07:00
include Block utilities/write_batch_with_index in ROCKSDB_LITE 2015-06-18 15:54:05 -07:00
java Use CompactRangeOptions for CompactRange 2015-06-17 14:36:14 -07:00
port Build for CYGWIN 2015-04-23 21:33:44 -07:00
table Add TablePropertiesCollector::NeedCompact() to suggest DB to further compact output files 2015-06-05 20:18:21 -07:00
third-party Update COMMIT.md 2015-03-30 17:48:16 -07:00
tools [API Change] Improve EventListener::OnFlushCompleted interface 2015-06-05 12:28:51 -07:00
util Fix memory leaks in PinnedUsageTest 2015-06-19 09:43:08 -07:00
utilities Add wal files to Checkpoint for multiple column families. 2015-06-19 16:08:31 -07:00
.arcconfig Integrate Jenkins with Phabricator 2015-04-07 11:56:29 -07:00
.clang-format A script that automatically reformat affected lines 2014-01-14 12:21:24 -08:00
.gitignore run 'make check's rules (and even subtests) in parallel 2015-04-06 12:35:25 -07:00
.travis.yml Don't preinstall jemalloc in Travis 2015-04-24 18:43:07 -07:00
AUTHORS Add AUTHORS file. Fix #203 2014-09-29 10:52:18 -07:00
CONTRIBUTING.md facebook accounts are not required for CLA signers 2014-07-08 05:57:54 -04:00
HISTORY.md Fail DB::Open() when the requested compression is not available 2015-06-18 14:55:05 -07:00
INSTALL.md Updated OS X instructions, replace homebrew/dupes with homebrew/versions 2015-06-10 21:52:42 +02:00
LICENSE Fix copyright year 2014-03-12 12:06:58 -07:00
Makefile Add wal files to Checkpoint for multiple column families. 2015-06-19 16:08:31 -07:00
PATENTS Update Patent Grant. 2015-04-13 10:33:43 +01:00
README.md Replaced "built on on earlier work" by "built on earlier work" in README.md 2014-09-17 01:16:17 -07:00
ROCKSDB_LITE.md Optimistic Transactions 2015-05-29 14:36:35 -07:00
USERS.md Add Yahoo's blog post about Sherpa to USERS.md 2015-06-09 12:55:58 -07:00
Vagrantfile RocksDB on FreeBSD support 2015-02-26 15:19:17 -08:00
src.mk Add wal files to Checkpoint for multiple column families. 2015-06-19 16:08:31 -07:00

README.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

Build Status

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/