Go to file
Mike Kolupaev d18dd2c41f Abort compactions more reliably when closing DB
Summary:
DB shutdown aborts running compactions by setting an atomic shutting_down=true that CompactionJob periodically checks. Without this PR it checks it before processing every _output_ value. If compaction filter filters everything out, the compaction is uninterruptible. This PR adds checks for shutting_down on every _input_ value (in CompactionIterator and MergeHelper).

There's also some minor code cleanup along the way.
Closes https://github.com/facebook/rocksdb/pull/1639

Differential Revision: D4306571

Pulled By: yiwu-arbug

fbshipit-source-id: f050890
2017-01-11 15:09:21 -08:00
arcanist_util Show sandcastle URL in phabricator 2016-12-20 11:09:12 -08:00
build_tools Fix the directory path for RocksDB repo 2016-12-27 22:24:16 -08:00
cmake/modules cmake support for linux and osx (#1358) 2016-09-28 11:53:15 -07:00
coverage Fix coverage script 2014-11-03 14:53:00 -08:00
db Abort compactions more reliably when closing DB 2017-01-11 15:09:21 -08:00
docs 5.0.1 release blog post 2017-01-06 15:24:15 -08:00
examples examples: Add options_file_example to target all 2016-12-28 19:09:16 -08:00
hdfs Fix bug in UnScSigned-off-by: xh931076284 <931076284@qq.com> (#1336) 2016-09-14 10:17:34 -07:00
include/rocksdb Abort compactions more reliably when closing DB 2017-01-11 15:09:21 -08:00
java Fix rocksdb::Status::getState 2017-01-03 18:39:14 -08:00
memtable Unified InlineSkipList::Insert algorithm with hinting 2016-11-22 14:09:13 -08:00
port Fix Windows environment issues 2017-01-09 15:54:12 -08:00
table Revert "PinnableSlice" 2017-01-08 14:24:12 -08:00
third-party Kill flashcache code in RocksDB 2016-12-01 10:09:22 -08:00
tools Revert "PinnableSlice" 2017-01-08 14:24:12 -08:00
util Guarding extra fallocate call with TRAVIS because its not working pro… 2017-01-11 14:24:13 -08:00
utilities Allow incrementing refcount on cache handles 2017-01-10 16:54:20 -08:00
.arcconfig Make rocksdb work with internal repo 2016-10-28 14:59:50 -07:00
.clang-format A script that automatically reformat affected lines 2014-01-14 12:21:24 -08:00
.gitignore Less linear search in DBIter::Seek() when keys are overwritten a lot 2016-11-28 10:24:11 -08:00
.travis.yml Update travis to ubuntu trusty 2017-01-09 13:54:19 -08:00
AUTHORS Add AUTHORS file. Fix #203 2014-09-29 10:52:18 -07:00
CMakeLists.txt Iterator should be in corrupted status if merge operator return false 2016-12-16 11:09:16 -08:00
CONTRIBUTING.md facebook accounts are not required for CLA signers 2014-07-08 05:57:54 -04:00
DEFAULT_OPTIONS_HISTORY.md Release RocksDB 4.8.0 2016-05-02 14:38:04 -07:00
DUMP_FORMAT.md First version of rocksdb_dump and rocksdb_undump. 2015-06-19 16:24:36 -07:00
HISTORY.md Always fsync the file after file copying 2016-12-28 19:09:16 -08:00
INSTALL.md Update documentation to point at gcc 4.8 2016-10-29 12:09:17 -07:00
LANGUAGE-BINDINGS.md Update LANGUAGE-BINDINGS.md 2016-07-15 13:09:30 +02:00
LICENSE Updated all copyright headers to the new format. 2016-02-09 15:12:00 -08:00
Makefile Delegate Cleanables 2016-12-29 15:54:19 -08:00
PATENTS Update Patent Grant. 2015-04-13 10:33:43 +01:00
README.md Appveyor badge to show master branch 2016-07-26 13:54:08 -07:00
ROCKSDB_LITE.md Optimistic Transactions 2015-05-29 14:36:35 -07:00
USERS.md Update Netflix section of USERS.md 2016-12-19 12:09:12 -08:00
Vagrantfile Update Vagrant file (test internal phabricator workflow) 2016-10-28 15:39:19 -07:00
WINDOWS_PORT.md Commit both PR and internal code review changes 2015-07-07 16:58:20 -07:00
appveyor.yml fix vs generator (#1269) 2016-08-10 09:08:13 -07:00
src.mk Iterator should be in corrupted status if merge operator return false 2016-12-16 11:09:16 -08:00
thirdparty.inc Introduce XPRESS compresssion on Windows. (#1081) 2016-04-19 22:54:24 -07:00

README.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

Build Status Build status

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/