mirror of
https://github.com/facebook/rocksdb.git
synced 2024-11-30 04:41:49 +00:00
99ec2412e5
Summary: This makes run_flash_bench.sh configurable. Previously it was hardwired for 1B keys and tests ran for 12 hours each. That kept me from using it. This makes it configuable, adds more tests, makes the duration per-test configurable and refactors the test scripts. Adds the seekrandomwhilemerging test to db_bench which is the same as seekrandomwhilewriting except the writer thread does Merge rather than Put. Forces the stall-time column in compaction IO stats to use a fixed format (H:M:S) which makes it easier to scrape and parse. Also adds an option to AppendHumanMicros to force a fixed format. Sometimes automation and humans want different format. Calls thread->stats.AddBytes(bytes); in db_bench for more tests to get the MB/sec summary stats in the output at test end. Adds the average ingest rate to compaction IO stats. Output now looks like: https://gist.github.com/mdcallag/2bd64d18be1b93adc494 More information on the benchmark output is at https://gist.github.com/mdcallag/db43a58bd5ac624f01e1 For benchmark.sh changes default RocksDB configuration to reduce stalls: * min_level_to_compress from 2 to 3 * hard_rate_limit from 2 to 3 * max_grandparent_overlap_factor and max_bytes_for_level_multiplier from 10 to 8 * L0 file count triggers from 4,8,12 to 4,12,20 for (start,stall,stop) Task ID: #6596829 Blame Rev: Test Plan: run tools/run_flash_bench.sh Revert Plan: Database Impact: Memcache Impact: Other Notes: EImportant: - begin *PUBLIC* platform impact section - Bugzilla: # - end platform impact - Reviewers: igor Reviewed By: igor Subscribers: dhruba Differential Revision: https://reviews.facebook.net/D36075
57 lines
2 KiB
C++
57 lines
2 KiB
C++
// Copyright (c) 2013, Facebook, Inc. All rights reserved.
|
|
// This source code is licensed under the BSD-style license found in the
|
|
// LICENSE file in the root directory of this source tree. An additional grant
|
|
// of patent rights can be found in the PATENTS file in the same directory.
|
|
//
|
|
// Copyright (c) 2011 The LevelDB Authors. All rights reserved.
|
|
// Use of this source code is governed by a BSD-style license that can be
|
|
// found in the LICENSE file. See the AUTHORS file for names of contributors.
|
|
//
|
|
// Must not be included from any .h files to avoid polluting the namespace
|
|
// with macros.
|
|
|
|
#pragma once
|
|
#include <stdio.h>
|
|
#include <stdint.h>
|
|
#include <string>
|
|
#include "port/port.h"
|
|
|
|
namespace rocksdb {
|
|
|
|
class Slice;
|
|
|
|
// Append a human-readable time in micros.
|
|
int AppendHumanMicros(uint64_t micros, char* output, int len,
|
|
bool fixed_format);
|
|
|
|
// Append a human-readable size in bytes
|
|
int AppendHumanBytes(uint64_t bytes, char* output, int len);
|
|
|
|
// Append a human-readable printout of "num" to *str
|
|
extern void AppendNumberTo(std::string* str, uint64_t num);
|
|
|
|
// Append a human-readable printout of "value" to *str.
|
|
// Escapes any non-printable characters found in "value".
|
|
extern void AppendEscapedStringTo(std::string* str, const Slice& value);
|
|
|
|
// Return a string printout of "num"
|
|
extern std::string NumberToString(uint64_t num);
|
|
|
|
// Return a human-readable version of num.
|
|
// for num >= 10.000, prints "xxK"
|
|
// for num >= 10.000.000, prints "xxM"
|
|
// for num >= 10.000.000.000, prints "xxG"
|
|
extern std::string NumberToHumanString(int64_t num);
|
|
|
|
// Return a human-readable version of "value".
|
|
// Escapes any non-printable characters found in "value".
|
|
extern std::string EscapeString(const Slice& value);
|
|
|
|
// Parse a human-readable number from "*in" into *value. On success,
|
|
// advances "*in" past the consumed number and sets "*val" to the
|
|
// numeric value. Otherwise, returns false and leaves *in in an
|
|
// unspecified state.
|
|
extern bool ConsumeDecimalNumber(Slice* in, uint64_t* val);
|
|
|
|
} // namespace rocksdb
|