Add tests to verify assembler output -- Fix DoNotOptimize. (#530)
* Add tests to verify assembler output -- Fix DoNotOptimize.
For things like `DoNotOptimize`, `ClobberMemory`, and even `KeepRunning()`,
it is important exactly what assembly they generate. However, we currently
have no way to test this. Instead it must be manually validated every
time a change occurs -- including a change in compiler version.
This patch attempts to introduce a way to test the assembled output automatically.
It's mirrors how LLVM verifies compiler output, and it uses LLVM FileCheck to run
the tests in a similar way.
The tests function by generating the assembly for a test in CMake, and then
using FileCheck to verify the // CHECK lines in the source file are found
in the generated assembly.
Currently, the tests only run on 64-bit x86 systems under GCC and Clang,
and when FileCheck is found on the system.
Additionally, this patch tries to improve the code gen from DoNotOptimize.
This should probably be a separate change, but I needed something to test.
* Disable assembly tests on Bazel for now
* Link FIXME to github issue
* Fix Tests on OS X
* fix strip_asm.py to work on both Linux and OS X like targets
2018-03-23 22:10:47 +00:00
|
|
|
#include <benchmark/benchmark.h>
|
|
|
|
|
|
|
|
#ifdef __clang__
|
|
|
|
#pragma clang diagnostic ignored "-Wreturn-type"
|
|
|
|
#endif
|
|
|
|
|
2018-06-01 10:14:19 +00:00
|
|
|
// clang-format off
|
Add tests to verify assembler output -- Fix DoNotOptimize. (#530)
* Add tests to verify assembler output -- Fix DoNotOptimize.
For things like `DoNotOptimize`, `ClobberMemory`, and even `KeepRunning()`,
it is important exactly what assembly they generate. However, we currently
have no way to test this. Instead it must be manually validated every
time a change occurs -- including a change in compiler version.
This patch attempts to introduce a way to test the assembled output automatically.
It's mirrors how LLVM verifies compiler output, and it uses LLVM FileCheck to run
the tests in a similar way.
The tests function by generating the assembly for a test in CMake, and then
using FileCheck to verify the // CHECK lines in the source file are found
in the generated assembly.
Currently, the tests only run on 64-bit x86 systems under GCC and Clang,
and when FileCheck is found on the system.
Additionally, this patch tries to improve the code gen from DoNotOptimize.
This should probably be a separate change, but I needed something to test.
* Disable assembly tests on Bazel for now
* Link FIXME to github issue
* Fix Tests on OS X
* fix strip_asm.py to work on both Linux and OS X like targets
2018-03-23 22:10:47 +00:00
|
|
|
extern "C" {
|
|
|
|
extern int ExternInt;
|
|
|
|
benchmark::State& GetState();
|
|
|
|
void Fn();
|
|
|
|
}
|
2018-06-01 10:14:19 +00:00
|
|
|
// clang-format on
|
Add tests to verify assembler output -- Fix DoNotOptimize. (#530)
* Add tests to verify assembler output -- Fix DoNotOptimize.
For things like `DoNotOptimize`, `ClobberMemory`, and even `KeepRunning()`,
it is important exactly what assembly they generate. However, we currently
have no way to test this. Instead it must be manually validated every
time a change occurs -- including a change in compiler version.
This patch attempts to introduce a way to test the assembled output automatically.
It's mirrors how LLVM verifies compiler output, and it uses LLVM FileCheck to run
the tests in a similar way.
The tests function by generating the assembly for a test in CMake, and then
using FileCheck to verify the // CHECK lines in the source file are found
in the generated assembly.
Currently, the tests only run on 64-bit x86 systems under GCC and Clang,
and when FileCheck is found on the system.
Additionally, this patch tries to improve the code gen from DoNotOptimize.
This should probably be a separate change, but I needed something to test.
* Disable assembly tests on Bazel for now
* Link FIXME to github issue
* Fix Tests on OS X
* fix strip_asm.py to work on both Linux and OS X like targets
2018-03-23 22:10:47 +00:00
|
|
|
|
|
|
|
using benchmark::State;
|
|
|
|
|
|
|
|
// CHECK-LABEL: test_for_auto_loop:
|
|
|
|
extern "C" int test_for_auto_loop() {
|
|
|
|
State& S = GetState();
|
|
|
|
int x = 42;
|
|
|
|
// CHECK: [[CALL:call(q)*]] _ZN9benchmark5State16StartKeepRunningEv
|
|
|
|
// CHECK-NEXT: testq %rbx, %rbx
|
|
|
|
// CHECK-NEXT: je [[LOOP_END:.*]]
|
|
|
|
|
|
|
|
for (auto _ : S) {
|
|
|
|
// CHECK: .L[[LOOP_HEAD:[a-zA-Z0-9_]+]]:
|
|
|
|
// CHECK-GNU-NEXT: subq $1, %rbx
|
|
|
|
// CHECK-CLANG-NEXT: {{(addq \$1,|incq)}} %rax
|
|
|
|
// CHECK-NEXT: jne .L[[LOOP_HEAD]]
|
|
|
|
benchmark::DoNotOptimize(x);
|
|
|
|
}
|
|
|
|
// CHECK: [[LOOP_END]]:
|
|
|
|
// CHECK: [[CALL]] _ZN9benchmark5State17FinishKeepRunningEv
|
|
|
|
|
|
|
|
// CHECK: movl $101, %eax
|
|
|
|
// CHECK: ret
|
|
|
|
return 101;
|
|
|
|
}
|
|
|
|
|
|
|
|
// CHECK-LABEL: test_while_loop:
|
|
|
|
extern "C" int test_while_loop() {
|
|
|
|
State& S = GetState();
|
|
|
|
int x = 42;
|
|
|
|
|
|
|
|
// CHECK: j{{(e|mp)}} .L[[LOOP_HEADER:[a-zA-Z0-9_]+]]
|
|
|
|
// CHECK-NEXT: .L[[LOOP_BODY:[a-zA-Z0-9_]+]]:
|
|
|
|
while (S.KeepRunning()) {
|
|
|
|
// CHECK-GNU-NEXT: subq $1, %[[IREG:[a-z]+]]
|
|
|
|
// CHECK-CLANG-NEXT: {{(addq \$-1,|decq)}} %[[IREG:[a-z]+]]
|
|
|
|
// CHECK: movq %[[IREG]], [[DEST:.*]]
|
|
|
|
benchmark::DoNotOptimize(x);
|
|
|
|
}
|
|
|
|
// CHECK-DAG: movq [[DEST]], %[[IREG]]
|
|
|
|
// CHECK-DAG: testq %[[IREG]], %[[IREG]]
|
|
|
|
// CHECK-DAG: jne .L[[LOOP_BODY]]
|
|
|
|
// CHECK-DAG: .L[[LOOP_HEADER]]:
|
|
|
|
|
|
|
|
// CHECK: cmpb $0
|
|
|
|
// CHECK-NEXT: jne .L[[LOOP_END:[a-zA-Z0-9_]+]]
|
|
|
|
// CHECK: [[CALL:call(q)*]] _ZN9benchmark5State16StartKeepRunningEv
|
|
|
|
|
|
|
|
// CHECK: .L[[LOOP_END]]:
|
|
|
|
// CHECK: [[CALL]] _ZN9benchmark5State17FinishKeepRunningEv
|
|
|
|
|
|
|
|
// CHECK: movl $101, %eax
|
|
|
|
// CHECK: ret
|
|
|
|
return 101;
|
|
|
|
}
|