- Force GC before collecting
RTSStats
, otherwise measurements are inaccurate. - Restore locale encoding after
defaultMain
.
- Switch
nf
,nfIO
andnfAppIO
to evaluate outputs to a normal form withrnf
instead offorce
. It means that parts of the output, which have already been forced, can be garbage collected early, without waiting for the entire output to be allocated at the same time. This decreases benchmarking overhead in many scenarios and brings the behaviour in line withcriterion
. See #39 for discussion. - Drop support of
tasty < 1.4
. - Make
IO
benchmarks immune to-fspec-constr-count
limit. - Decomission
debug
build flag. - Decomission warning when
--timeout
is absent. - Add
instance {Eq,Ord,Num,Fractional} {RelStDev,FailIfSlower,FailIfFaster}
. - Add
instance {Eq,Ord} {CsvPath,SvgPath,BaselinePath}
.
- Support
tasty-1.5
. - Report benchmarking progress.
- Force single-threaded execution in
defaultMain
. - Expose
measureCpuTimeAndStDev
helper to analyse benchmarks manually.
- Drop support of
tasty < 1.2.3
. - Make benchmarks immune to
-fspec-constr-count
limit.
- Add
locateBenchmark
andmapLeafBenchmarks
. - Support measuring of wall-clock time.
- Make messages for baseline comparison less ambiguous.
- Graceful degradation on non-Unicode terminals.
- Add
bcompareWithin
for portable performance tests. - Add
tasty
anddebug
build flags.
- Report mean time with 3 significant digits.
- Report peak memory usage, when run with
+RTS -T
. - Run benchmarks only once, if
RelStDev
is infinite. - Make
Benchmarkable
constructor public. - Expose
measureCpuTime
helper to run benchmarks manually. - Expose
CsvPath
,BaselinePath
,SvgPath
.
- Fix comparison against baseline.
- Add a simplistic SVG reporter.
- Add
bcompare
to compare between benchmarks. - Throw a warning, if benchmarks take too long.
- Prohibit duplicated benchmark names in CSV reports.
- Remove
NFData
constraint fromwhnfIO
.
- Fix integer overflow in stdev computations.
- Add
env
andenvWithCleanup
. - Run console and CSV reporters in parallel.
- Extend console reporter and export it as
consoleBenchReporter
. - Add comparison against baseline and relevant options.
- Export
RelStDev
option. - Export
benchIngredients
.
- Initial release.