Benchmarks on Travis #14

clintfred · 2018-10-17T22:25:02Z

@clintfred commented on Mon Oct 08 2018

Now that we have #4 we should have benchmarks running consistently, somewhere. It looks like there has been some success in running benchmarks on Travis, even though it's not ideal. Hopefully criterion's statistical analysis will make the results somewhat reasonable.

https://beachape.com/blog/2016/11/02/rust-performance-testing-on-travis-ci/
https://sunjay.ca/2017/04/27/rust-benchmark-comparison-travis

* add script for travis to run benchmarks and compare them * disable libtest benchmarks

* filter out benchmark changes < 2% * return sample size to 20

* try `sudo false` to see if containerized build is faster

* `sudo false` seems to give more erratic performance, so removing * testing skip ci command

clintfred added a commit that referenced this issue Oct 17, 2018

[#14]

68fee71

* add script for travis to run benchmarks and compare them * disable libtest benchmarks

clintfred added a commit that referenced this issue Oct 18, 2018

[#14]

c5bb1fd

* filter out benchmark changes < 2% * return sample size to 20

clintfred added a commit that referenced this issue Oct 18, 2018

[#14]

8885ce9

* try `sudo false` to see if containerized build is faster

clintfred added a commit that referenced this issue Oct 18, 2018

[#14] [skip ci]

836f3de

* `sudo false` seems to give more erratic performance, so removing * testing skip ci command

clintfred added a commit that referenced this issue Oct 18, 2018

[#14] Add benchmarking on Travis (#15)

ea27950

ernieturner closed this as completed Oct 22, 2018

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Benchmarks on Travis #14

Benchmarks on Travis #14

clintfred commented Oct 17, 2018

Benchmarks on Travis #14

Benchmarks on Travis #14

Comments

clintfred commented Oct 17, 2018