Find a file
Yi Wu 1ea79a78c9 Optimize sequential insert into memtable - Part 1: Interface
Summary:
Currently our skip-list have an optimization to speedup sequential
inserts from a single stream, by remembering the last insert position.
We extend the idea to support sequential inserts from multiple streams,
and even tolerate small reordering wihtin each stream.

This PR is the interface part adding the following:
- Add `memtable_insert_prefix_extractor` to allow specifying prefix for each key.
- Add `InsertWithHint()` interface to memtable, to allow underlying
  implementation to return a hint of insert position, which can be later
  pass back to optimize inserts.
- Memtable will maintain a map from prefix to hints and pass the hint
  via `InsertWithHint()` if `memtable_insert_prefix_extractor` is non-null.
Closes https://github.com/facebook/rocksdb/pull/1419

Differential Revision: D4079367

Pulled By: yiwu-arbug

fbshipit-source-id: 3555326
2016-11-13 19:09:18 -08:00
arcanist_util Rocksdb contruns to new Sandcastle API 2016-11-10 10:54:20 -08:00
build_tools Update documentation to point at gcc 4.8 2016-10-29 12:09:17 -07:00
cmake/modules cmake support for linux and osx (#1358) 2016-09-28 11:53:15 -07:00
coverage Fix coverage script 2014-11-03 14:53:00 -08:00
db Optimize sequential insert into memtable - Part 1: Interface 2016-11-13 19:09:18 -08:00
docs Use relative Urls for stylesheets 2016-11-10 14:54:55 -08:00
examples Fix typo (#903) 2016-09-14 14:12:31 -07:00
hdfs Fix bug in UnScSigned-off-by: xh931076284 <931076284@qq.com> (#1336) 2016-09-14 10:17:34 -07:00
include/rocksdb Optimize sequential insert into memtable - Part 1: Interface 2016-11-13 19:09:18 -08:00
java Java API - Implement GetFromBatch and GetFromBatchAndDB in WBWI 2016-11-06 02:44:07 -08:00
memtable Optimize sequential insert into memtable - Part 1: Interface 2016-11-13 19:09:18 -08:00
port Fix integer overflow in GetL0ThresholdSpeedupCompaction (#1378) 2016-10-23 18:43:29 -07:00
table Fix SstFileWriter destructor 2016-11-12 20:11:19 -08:00
third-party Fix clang analyzer errors 2016-07-08 17:50:51 -07:00
tools Allowed delayed_write_rate option to be dynamically set. 2016-11-12 15:54:11 -08:00
util Optimize sequential insert into memtable - Part 1: Interface 2016-11-13 19:09:18 -08:00
utilities Fix 2PC Recovery SeqId Miscount 2016-11-10 11:09:22 -08:00
.arcconfig Make rocksdb work with internal repo 2016-10-28 14:59:50 -07:00
.clang-format A script that automatically reformat affected lines 2014-01-14 12:21:24 -08:00
.gitignore Make rocksdb work with internal repo 2016-10-28 14:59:50 -07:00
.travis.yml Fix travis 2016-08-31 00:10:49 -07:00
appveyor.yml fix vs generator (#1269) 2016-08-10 09:08:13 -07:00
AUTHORS Add AUTHORS file. Fix #203 2014-09-29 10:52:18 -07:00
CMakeLists.txt Optimize sequential insert into memtable - Part 1: Interface 2016-11-13 19:09:18 -08:00
CONTRIBUTING.md facebook accounts are not required for CLA signers 2014-07-08 05:57:54 -04:00
DEFAULT_OPTIONS_HISTORY.md Release RocksDB 4.8.0 2016-05-02 14:38:04 -07:00
DUMP_FORMAT.md First version of rocksdb_dump and rocksdb_undump. 2015-06-19 16:24:36 -07:00
HISTORY.md Optimize sequential insert into memtable - Part 1: Interface 2016-11-13 19:09:18 -08:00
INSTALL.md Update documentation to point at gcc 4.8 2016-10-29 12:09:17 -07:00
LANGUAGE-BINDINGS.md Update LANGUAGE-BINDINGS.md 2016-07-15 13:09:30 +02:00
LICENSE Updated all copyright headers to the new format. 2016-02-09 15:12:00 -08:00
Makefile Optimize sequential insert into memtable - Part 1: Interface 2016-11-13 19:09:18 -08:00
PATENTS Update Patent Grant. 2015-04-13 10:33:43 +01:00
README.md Appveyor badge to show master branch 2016-07-26 13:54:08 -07:00
ROCKSDB_LITE.md Optimistic Transactions 2015-05-29 14:36:35 -07:00
src.mk Support IngestExternalFile (remove AddFile restrictions) 2016-10-20 17:05:32 -07:00
thirdparty.inc Introduce XPRESS compresssion on Windows. (#1081) 2016-04-19 22:54:24 -07:00
USERS.md Adding Dgraph to list of Users (#1291) 2016-09-12 17:33:44 -07:00
Vagrantfile Update Vagrant file (test internal phabricator workflow) 2016-10-28 15:39:19 -07:00
WINDOWS_PORT.md Commit both PR and internal code review changes 2015-07-07 16:58:20 -07:00

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

Build Status Build status

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See the github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/