rocksdb/utilities/persistent_cache
Andrew Kryczka b00761eea6 Fix block cache ID uniqueness for Windows builds (#5844)
Summary:
Since we do not evict a file's blocks from block cache before that file
is deleted, we require a file's cache ID prefix is both unique and
non-reusable. However, the Windows functionality we were relying on only
guaranteed uniqueness. That meant a newly created file could be assigned
the same cache ID prefix as a deleted file. If the newly created file
had block offsets matching the deleted file, full cache keys could be
exactly the same, resulting in obsolete data blocks returned from cache
when trying to read from the new file.

We noticed this when running on FAT32 where compaction was writing out
of order keys due to reading obsolete blocks from its input files. The
functionality is documented as behaving the same on NTFS, although I
wasn't able to repro it there.
Pull Request resolved: https://github.com/facebook/rocksdb/pull/5844

Test Plan:
we had a reliable repro of out-of-order keys on FAT32 that
was fixed by this change

Differential Revision: D17752442

fbshipit-source-id: 95d983f9196cf415f269e19293b97341edbf7e00
2019-10-11 18:19:31 -07:00
..
block_cache_tier.cc Move some logging related files to logging/ (#5387) 2019-05-31 17:23:59 -07:00
block_cache_tier.h Move some memory related files from util/ to memory/ (#5382) 2019-05-30 17:44:09 -07:00
block_cache_tier_file.cc Make clang-analyzer happy (#5821) 2019-09-18 15:25:48 -07:00
block_cache_tier_file.h Divide file_reader_writer.h and .cc (#5803) 2019-09-16 10:33:51 -07:00
block_cache_tier_file_buffer.h Move some memory related files from util/ to memory/ (#5382) 2019-05-30 17:44:09 -07:00
block_cache_tier_metadata.cc Fix unused var warnings in Release mode 2017-10-23 14:27:04 -07:00
block_cache_tier_metadata.h Change RocksDB License 2017-07-15 16:11:23 -07:00
hash_table.h Change RocksDB License 2017-07-15 16:11:23 -07:00
hash_table_bench.cc Fix build for linux 2017-12-18 12:28:03 -08:00
hash_table_evictable.h Enable MSVC W4 with a few exceptions. Fix warnings and bugs 2017-10-19 10:57:12 -07:00
hash_table_test.cc Move some memory related files from util/ to memory/ (#5382) 2019-05-30 17:44:09 -07:00
lrulist.h Change RocksDB License 2017-07-15 16:11:23 -07:00
persistent_cache_bench.cc Organizing rocksdb/table directory by format 2019-05-30 14:51:11 -07:00
persistent_cache_test.cc Fix block cache ID uniqueness for Windows builds (#5844) 2019-10-11 18:19:31 -07:00
persistent_cache_test.h Move some memory related files from util/ to memory/ (#5382) 2019-05-30 17:44:09 -07:00
persistent_cache_tier.cc Apply formatter to recent 200+ commits. (#5830) 2019-09-20 12:04:26 -07:00
persistent_cache_tier.h fix compilation with g++ option -Wsuggest-override (#4272) 2018-08-14 15:13:10 -07:00
persistent_cache_util.h Fix MyRocks compile warnings-treated-as-errors on Fedora 30, gcc 9.1.1 (#5553) 2019-07-12 17:30:51 -07:00
volatile_tier_impl.cc Comment out unused variables 2018-03-05 13:13:41 -08:00
volatile_tier_impl.h Change RocksDB License 2017-07-15 16:11:23 -07:00