rocksdb/unreleased_history/new_features/ingest-fill-cache.md at 787730c859d83fd82b3087ae2edf189f8f2e698f

mirror of https://github.com/facebook/rocksdb.git synced 2024-11-27 20:43:57 +00:00

Changyu Bi 787730c859 Add an ingestion option to not fill block cache (#13067 )

Summary:
add `IngestExternalFileOptions::fill_cache` to allow users to ingest files without loading index/filter/data and other blocks into block cache during file ingestion. This can be useful when users are ingesting files into a CF that is not available to readers yet.

Pull Request resolved: https://github.com/facebook/rocksdb/pull/13067

Test Plan:
* unit test: `ExternalSSTFileTest.NoBlockCache`
* ran one round of crash test with fill_cache disabled: `python3 ./tools/db_crashtest.py --simple blackbox --ops_per_thread=1000000 --interval=30 --ingest_external_file_one_in=200 --level0_stop_writes_trigger=200 --level0_slowdown_writes_trigger=100 --sync_fault_injection=0 --disable_wal=0 --manual_wal_flush_one_in=0`

Reviewed By: jowlyzhang

Differential Revision: D64356424

Pulled By: cbi42

fbshipit-source-id: b380c26f5987238e1ed7d42ceef0390cfaa0b8e2

2024-10-16 14:11:22 -07:00

166 B

Raw Blame History

Add a new file ingestion option IngestExternalFileOptions::fill_cache to support not adding blocks from ingested files into block cache during file ingestion.

166 B Raw Blame History

166 B

Raw Blame History