rocksdb

History

Andrew Kryczka b7fbcefda8 Add API to limit blast radius of merge operator failure (#11092 ) Summary: Prior to this PR, `FullMergeV2()` can only return `false` to indicate failure, which causes any operation invoking it to fail. During a compaction, such a failure causes the compaction to fail and causes the DB to irreversibly enter read-only mode. Some users asked for a way to allow the merge operator to fail without such widespread damage. To limit the blast radius of merge operator failures, this PR introduces the `MergeOperationOutput::op_failure_scope` API. When unpopulated (`kDefault`) or set to `kTryMerge`, the merge operator failure handling is the same as before. When set to `kMustMerge`, merge operator failure still causes failure to operations that must merge (`Get()`, iterator, `MultiGet()`, etc.). However, under `kMustMerge`, flushes/compactions can survive merge operator failures by outputting the unmerged input operands. Pull Request resolved: https://github.com/facebook/rocksdb/pull/11092 Reviewed By: siying Differential Revision: D42525673 Pulled By: ajkr fbshipit-source-id: 951dc3bf190f86347dccf3381be967565cda52ee		2023-01-20 14:40:30 -08:00
..
agg_merge	Print stack traces on frozen tests in CI (#10828 )	2022-10-18 00:35:35 -07:00
backup	Fix BackupEngineTest.ExcludeFiles memory leak (#11066 )	2022-12-31 10:56:55 -08:00
blob_db	Run clang-format on utilities/ (except utilities/transactions/) (#10853 )	2022-10-24 16:38:09 -07:00
cassandra	Run clang-format on utilities/ (except utilities/transactions/) (#10853 )	2022-10-24 16:38:09 -07:00
checkpoint	Sort L0 files by newly introduced epoch_num (#10922 )	2022-12-13 13:29:37 -08:00
compaction_filters	Run clang-format on utilities/ (except utilities/transactions/) (#10853 )	2022-10-24 16:38:09 -07:00
convenience	Run clang-format on utilities/ (except utilities/transactions/) (#10853 )	2022-10-24 16:38:09 -07:00
leveldb_options	Run clang-format on utilities/ (except utilities/transactions/) (#10853 )	2022-10-24 16:38:09 -07:00
memory	Print stack traces on frozen tests in CI (#10828 )	2022-10-18 00:35:35 -07:00
merge_operators	Run clang-format on utilities/ (except utilities/transactions/) (#10853 )	2022-10-24 16:38:09 -07:00
option_change_migration	Option migration tool to break down files for FIFO compaction (#10600 )	2022-08-31 12:08:23 -07:00
options	Run clang-format on utilities/ (except utilities/transactions/) (#10853 )	2022-10-24 16:38:09 -07:00
persistent_cache	Run clang-format on utilities/ (except utilities/transactions/) (#10853 )	2022-10-24 16:38:09 -07:00
simulator_cache	Major Cache refactoring, CPU efficiency improvement (#10975 )	2023-01-11 14:20:40 -08:00
table_properties_collectors	Run clang-format on utilities/ (except utilities/transactions/) (#10853 )	2022-10-24 16:38:09 -07:00
trace	Add rate limiter priority to ReadOptions (#9424 )	2022-02-16 23:18:14 -08:00
transactions	support loongarch64 for rocksdb (#10036 )	2023-01-13 08:42:44 -08:00
ttl	Add API to limit blast radius of merge operator failure (#11092 )	2023-01-20 14:40:30 -08:00
write_batch_with_index	Add API to limit blast radius of merge operator failure (#11092 )	2023-01-20 14:40:30 -08:00
cache_dump_load.cc	Introduce a mechanism to dump out blocks from block cache and re-insert to secondary cache (#8912 )	2021-10-07 11:42:31 -07:00
cache_dump_load_impl.cc	Major Cache refactoring, CPU efficiency improvement (#10975 )	2023-01-11 14:20:40 -08:00
cache_dump_load_impl.h	Major Cache refactoring, CPU efficiency improvement (#10975 )	2023-01-11 14:20:40 -08:00
compaction_filters.cc	Restore Regex support for ObjectLibrary::Register, rename new APIs to allow old one to be deprecated in the future (#9362 )	2022-01-11 06:33:48 -08:00
counted_fs.cc	Fix serious FSDirectory use-after-Close bug (missing fsync) (#10460 )	2022-08-02 10:54:32 -07:00
counted_fs.h	Explicitly closing all directory file descriptors (#10049 )	2022-06-01 18:03:34 -07:00
debug.cc	Skip swaths of range tombstone covered keys in merging iterator (2022 edition) (#10449 )	2022-09-02 09:51:19 -07:00
env_mirror.cc	Fix clang13 build error (#9374 )	2022-01-11 10:36:22 -08:00
env_mirror_test.cc	Run clang-format on utilities/ (except utilities/transactions/) (#10853 )	2022-10-24 16:38:09 -07:00
env_timed.cc	Make FileSystem a Customizable Class (#8649 )	2021-11-02 09:07:11 -07:00
env_timed.h	Make FileSystem a Customizable Class (#8649 )	2021-11-02 09:07:11 -07:00
env_timed_test.cc	Run clang-format on utilities/ (except utilities/transactions/) (#10853 )	2022-10-24 16:38:09 -07:00
fault_injection_env.cc	Explicitly closing all directory file descriptors (#10049 )	2022-06-01 18:03:34 -07:00
fault_injection_env.h	Run clang-format on utilities/ (except utilities/transactions/) (#10853 )	2022-10-24 16:38:09 -07:00
fault_injection_fs.cc	Enable ReadAsync testing and fault injection in db_stress (#11037 )	2022-12-15 15:48:50 -08:00
fault_injection_fs.h	Enable ReadAsync testing and fault injection in db_stress (#11037 )	2022-12-15 15:48:50 -08:00
fault_injection_secondary_cache.cc	Major Cache refactoring, CPU efficiency improvement (#10975 )	2023-01-11 14:20:40 -08:00
fault_injection_secondary_cache.h	Major Cache refactoring, CPU efficiency improvement (#10975 )	2023-01-11 14:20:40 -08:00
memory_allocators.h	Major Cache refactoring, CPU efficiency improvement (#10975 )	2023-01-11 14:20:40 -08:00
merge_operators.cc	Restore Regex support for ObjectLibrary::Register, rename new APIs to allow old one to be deprecated in the future (#9362 )	2022-01-11 06:33:48 -08:00
merge_operators.h	Run clang-format on utilities/ (except utilities/transactions/) (#10853 )	2022-10-24 16:38:09 -07:00
object_registry.cc	Added GetFactoryCount/Names/Types to ObjectRegistry (#9358 )	2022-05-16 09:44:43 -07:00
object_registry_test.cc	Print stack traces on frozen tests in CI (#10828 )	2022-10-18 00:35:35 -07:00
util_merge_operators_test.cc	Print stack traces on frozen tests in CI (#10828 )	2022-10-18 00:35:35 -07:00
wal_filter.cc	Make WalFilter, SstPartitionerFactory, FileChecksumGenFactory, and TableProperties Customizable (#8638 )	2021-09-28 05:32:02 -07:00