dolysis/rocksdb
3
0
Fork 0
mirror of https://github.com/facebook/rocksdb.git synced 2024-11-29 09:36:17 +00:00
Code Issues Packages Projects Releases Wiki Activity
1788 commits 196 branches 277 tags 394 MiB
C++ 84.3%
Java 9.6%
C 1.6%
Python 1.5%
Perl 0.9%
Other 2%
Find a file
sdong df9069d23f In DB::NewIterator(), try to allocate the whole iterator tree in an arena 
Summary:
In this patch, try to allocate the whole iterator tree starting from DBIter from an arena
1. ArenaWrappedDBIter is created when serves as the entry point of an iterator tree, with an arena in it.
2. Add an option to create iterator from arena for following iterators: DBIter, MergingIterator, MemtableIterator, all mem table's iterators, all table reader's iterators and two level iterator.
3. MergeIteratorBuilder is created to incrementally build the tree of internal iterators. It is passed to mem table list and version set and add iterators to it.

Limitations:
(1) Only DB::NewIterator() without tailing uses the arena. Other cases, including readonly DB and compactions are still from malloc
(2) Two level iterator itself is allocated in arena, but not iterators inside it.

Test Plan: make all check

Reviewers: ljin, haobo

Reviewed By: haobo

Subscribers: leveldb, dhruba, yhchiang, igor

Differential Revision: https://reviews.facebook.net/D18513
2014-06-02 17:44:57 -07:00
build_tools hdfs cleanup and compile test against CDH 4.4. 2014-05-20 17:22:12 -04:00
coverage
db In DB::NewIterator(), try to allocate the whole iterator tree in an arena 2014-06-02 17:44:57 -07:00
doc
examples Make it easier to start using RocksDB 2014-05-10 10:49:33 -07:00
hdfs hdfs cleanup and compile test against CDH 4.4. 2014-05-20 17:22:12 -04:00
helpers/memenv
include In DB::NewIterator(), try to allocate the whole iterator tree in an arena 2014-06-02 17:44:57 -07:00
java [Java] Generalize dis-own native handle and refine dispose framework. 2014-05-28 18:16:29 -07:00
linters
port
table In DB::NewIterator(), try to allocate the whole iterator tree in an arena 2014-06-02 17:44:57 -07:00
third-party/rapidjson Add rapidjson to RocksDB 2014-05-15 16:07:05 -07:00
tools db_stress to add an option to periodically change background thread pool size. 2014-06-02 10:32:09 -07:00
util In DB::NewIterator(), try to allocate the whole iterator tree in an arena 2014-06-02 17:44:57 -07:00
utilities Make RateLimiting unit test less flakey 2014-05-20 17:09:38 -07:00
.arcconfig
.clang-format
.gitignore Add .swp to gitignore 2014-05-16 13:17:29 -07:00
.travis.yml Turn off travis notifications 2014-05-14 16:08:02 -07:00
CONTRIBUTING.md
HISTORY.md Update HISTORY.md 2014-05-21 15:25:05 -07:00
INSTALL.md Better INSTALL.md and Makefile rules 2014-05-07 16:51:30 -07:00
LICENSE
Makefile Move master version to 3.2 2014-05-23 10:27:56 -07:00
PATENTS
README.md Add build status to README.md 2014-05-15 10:16:58 -07:00
ROCKSDB_LITE.md

README.md

RocksDB: A Persistent Key-Value Store for Flash and RAM Storage

Build Status

RocksDB is developed and maintained by Facebook Database Engineering Team. It is built on on earlier work on LevelDB by Sanjay Ghemawat (sanjay@google.com) and Jeff Dean (jeff@google.com)

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has an Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

Start with example usage here: https://github.com/facebook/rocksdb/tree/master/examples

See doc/index.html and github wiki for more explanation.

The public interface is in include/. Callers should not include or rely on the details of any other header files in this package. Those internal APIs may be changed without warning.

Design discussions are conducted in https://www.facebook.com/groups/rocksdb.dev/