Skip to content

Commit

Permalink
Merge pull request #804 from explorable-viz/benchmarking
Browse files Browse the repository at this point in the history
Benchmarking Python Changes
  • Loading branch information
JosephBond authored Oct 24, 2023
2 parents 5fe7f45 + c095dea commit 711244d
Show file tree
Hide file tree
Showing 7 changed files with 279 additions and 97 deletions.
67 changes: 67 additions & 0 deletions Benchmarks/benchmarks(1).csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,67 @@
Test-Name,Graph-Bwd,Graph-BwdAll,Graph-BwdDual,Graph-Eval,Graph-Fwd,Graph-FwdAsDeMorgan,Graph-FwdDual,Trace-Bwd,Trace-Eval,Trace-Fwd
arithmetic,1.0,1.0,0.0,14.0,0.0,5.0,0.0,12.0,13.0,2.0
array,2.0,1.0,0.0,8.0,0.0,4.0,0.0,11.0,14.0,6.0
compose,0.0,1.0,0.0,7.0,0.0,2.0,0.0,9.0,7.0,1.0
dicts,1.0,2.0,1.0,9.0,2.0,3.0,0.0,12.0,7.0,2.0
div-mod-quot-rem,0.0,4.0,0.0,17.0,1.0,5.0,0.0,8.0,13.0,1.0
factorial,1.0,35.0,0.0,19.0,0.0,146.0,0.0,14.0,18.0,5.0
filter,1.0,1.0,0.0,9.0,0.0,2.0,0.0,8.0,13.0,4.0
first-class-constr,0.0,1.0,1.0,13.0,0.0,3.0,0.0,8.0,12.0,3.0
flatten,2.0,2.0,0.0,17.0,0.0,3.0,0.0,10.0,16.0,7.0
foldr_sumSquares,1.0,1.0,0.0,10.0,0.0,3.0,0.0,8.0,12.0,4.0
lexicalScoping,1.0,1.0,0.0,2.0,0.0,3.0,0.0,23.0,17.0,1.0
length,3.0,0.0,0.0,3.0,0.0,3.0,0.0,7.0,6.0,1.0
lookup,2.0,1.0,0.0,26.0,0.0,4.0,0.0,20.0,40.0,6.0
map,1.0,3.0,1.0,27.0,1.0,5.0,1.0,8.0,12.0,2.0
mergeSort,1.0,1.0,0.0,43.0,0.0,6.0,0.0,23.0,32.0,22.0
normalise,1.0,1.0,0.0,5.0,0.0,3.0,0.0,6.0,6.0,4.0
pattern-match,1.0,2.0,0.0,17.0,0.0,5.0,0.0,8.0,13.0,5.0
range,2.0,2.0,0.0,53.0,0.0,12.0,0.0,24.0,32.0,11.0
records,1.0,1.0,0.0,22.0,0.0,4.0,0.0,11.0,14.0,10.0
reverse,2.0,1.0,0.0,6.0,0.0,3.0,0.0,8.0,20.0,3.0
dtw/next-indices,2.0,143.0,0.0,206.0,6.0,741.0,1.0,50.0,130.0,51.0
dtw/cost-matrix,2.0,7.0,1.0,196.0,2.0,118.0,1.0,46.0,119.0,33.0
dtw/matrix-update,0.0,1.0,0.0,7.0,1.0,3.0,0.0,9.0,8.0,2.0
desugar/list-comp-1,1.0,2.0,0.0,51.0,0.0,7.0,0.0,23.0,37.0,15.0
desugar/list-comp-2,1.0,10.0,0.0,208.0,1.0,28.0,0.0,38.0,111.0,44.0
desugar/list-comp-3,1.0,2.0,0.0,47.0,0.0,7.0,0.0,14.0,32.0,10.0
desugar/list-comp-4,1.0,1.0,0.0,20.0,0.0,3.0,0.0,9.0,16.0,3.0
desugar/list-comp-5,0.0,1.0,0.0,15.0,0.0,3.0,0.0,8.0,17.0,3.0
desugar/list-comp-6,1.0,0.0,0.0,1.0,0.0,9.0,0.0,11.0,11.0,1.0
desugar/list-comp-7,1.0,1.0,0.0,16.0,0.0,3.0,0.0,11.0,19.0,3.0
desugar/list-enum,1.0,6.0,0.0,13.0,0.0,7.0,0.0,8.0,15.0,2.0
add,0.0,1.0,0.0,2.0,1.0,1.0,0.0,6.0,6.0,0.0
array/lookup,0.0,1.0,0.0,69.0,0.0,16.0,0.0,15.0,44.0,18.0
array/dims,0.0,1.0,0.0,7.0,0.0,3.0,0.0,9.0,10.0,3.0
convolution/edgeDetect,31.0,44.0,1.0,6144.0,9.0,4437.0,341.0,1144.0,3552.0,1402.0
convolution/emboss,24.0,35.0,0.0,5347.0,2.0,4085.0,334.0,890.0,3084.0,1182.0
convolution/gaussian,26.0,36.0,1.0,4913.0,1.0,3813.0,360.0,828.0,2827.0,1306.0
dict/create,2.0,5.0,0.0,5.0,1.0,6.0,0.0,11.0,30.0,0.0
dict/difference,1.0,1.0,0.0,3.0,0.0,7.0,0.0,6.0,7.0,1.0
dict/disjointUnion,1.0,1.0,0.0,2.0,0.0,3.0,0.0,10.0,6.0,0.0
dict/foldl,2.0,2.0,0.0,46.0,0.0,13.0,0.0,15.0,18.0,5.0
dict/intersectionWith,2.0,1.0,2.0,28.0,1.0,4.0,0.0,26.0,17.0,18.0
dict/fromRecord,0.0,1.0,0.0,1.0,1.0,2.0,0.0,9.0,7.0,0.0
dict/get,0.0,2.0,0.0,3.0,0.0,2.0,0.0,8.0,7.0,1.0
dict/map,1.0,1.0,0.0,11.0,0.0,4.0,0.0,10.0,10.0,3.0
divide,0.0,0.0,0.0,2.0,0.0,4.0,0.0,5.0,13.0,0.0
filter,1.0,1.0,0.0,15.0,0.0,3.0,0.0,13.0,16.0,2.0
intersperse,1.0,1.0,0.0,10.0,1.0,3.0,0.0,8.0,7.0,2.0
intersperse,1.0,2.0,0.0,7.0,0.0,2.0,1.0,7.0,10.0,4.0
length,1.0,1.0,0.0,8.0,0.0,2.0,0.0,6.0,15.0,1.0
list-comp,1.0,2.0,1.0,94.0,2.0,13.0,3.0,28.0,67.0,29.0
list-comp,1.0,1.0,0.0,77.0,1.0,7.0,2.0,24.0,65.0,24.0
lookup,0.0,0.0,1.0,14.0,0.0,3.0,1.0,10.0,14.0,4.0
map,0.0,0.0,0.0,8.0,0.0,3.0,0.0,10.0,8.0,1.0
multiply,1.0,2.0,0.0,1.0,0.0,1.0,0.0,8.0,15.0,0.0
nth,0.0,0.0,0.0,4.0,1.0,3.0,0.0,7.0,18.0,1.0
section-5-example,1.0,3.0,1.0,87.0,1.0,7.0,4.0,25.0,71.0,30.0
section-5-example,1.0,2.0,0.0,83.0,1.0,10.0,2.0,23.0,58.0,25.0
section-5-example,2.0,2.0,0.0,111.0,1.0,9.0,3.0,21.0,62.0,28.0
zeros,1.0,1.0,0.0,4.0,1.0,2.0,0.0,10.0,7.0,2.0
zeros,0.0,0.0,0.0,3.0,0.0,2.0,0.0,5.0,8.0,5.0
zipWith,1.0,2.0,0.0,13.0,0.0,2.0,1.0,9.0,14.0,6.0
graphics/background,2.0,4.0,0.0,12.0,2.0,20.0,0.0,9.0,12.0,3.0
graphics/grouped-bar-chart,6.0,853.0,1.0,526.0,250.0,2585.0,0.0,107.0,294.0,134.0
graphics/line-chart,9.0,1953.0,1.0,799.0,856.0,3744.0,0.0,139.0,443.0,191.0
graphics/stacked-bar-chart,4.0,228.0,0.0,288.0,143.0,189.0,0.0,64.0,173.0,70.0
67 changes: 67 additions & 0 deletions Benchmarks/benchmarks(2).csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,67 @@
Test-Name,Graph-Bwd,Graph-BwdAll,Graph-BwdDual,Graph-Eval,Graph-Fwd,Graph-FwdAsDeMorgan,Graph-FwdDual,Trace-Bwd,Trace-Eval,Trace-Fwd
arithmetic,1.0,1.0,0.0,14.0,0.0,5.0,0.0,12.0,13.0,2.0
array,2.0,1.0,0.0,8.0,0.0,4.0,0.0,11.0,14.0,6.0
compose,0.0,1.0,0.0,7.0,0.0,2.0,0.0,9.0,7.0,1.0
dicts,1.0,2.0,1.0,9.0,2.0,3.0,0.0,12.0,7.0,2.0
div-mod-quot-rem,0.0,4.0,0.0,17.0,1.0,5.0,0.0,8.0,13.0,1.0
factorial,1.0,35.0,0.0,19.0,0.0,146.0,0.0,14.0,18.0,5.0
filter,1.0,1.0,0.0,9.0,0.0,2.0,0.0,8.0,13.0,4.0
first-class-constr,0.0,1.0,1.0,13.0,0.0,3.0,0.0,8.0,12.0,3.0
flatten,2.0,2.0,0.0,17.0,0.0,3.0,0.0,10.0,16.0,7.0
foldr_sumSquares,1.0,1.0,0.0,10.0,0.0,3.0,0.0,8.0,12.0,4.0
lexicalScoping,1.0,1.0,0.0,2.0,0.0,3.0,0.0,23.0,17.0,1.0
length,3.0,0.0,0.0,3.0,0.0,3.0,0.0,7.0,6.0,1.0
lookup,2.0,1.0,0.0,26.0,0.0,4.0,0.0,20.0,40.0,6.0
map,1.0,3.0,1.0,27.0,1.0,5.0,1.0,8.0,12.0,2.0
mergeSort,1.0,1.0,0.0,43.0,0.0,6.0,0.0,23.0,32.0,22.0
normalise,1.0,1.0,0.0,5.0,0.0,3.0,0.0,6.0,6.0,4.0
pattern-match,1.0,2.0,0.0,17.0,0.0,5.0,0.0,8.0,13.0,5.0
range,2.0,2.0,0.0,53.0,0.0,12.0,0.0,24.0,32.0,11.0
records,1.0,1.0,0.0,22.0,0.0,4.0,0.0,11.0,14.0,10.0
reverse,2.0,1.0,0.0,6.0,0.0,3.0,0.0,8.0,20.0,3.0
dtw/next-indices,2.0,143.0,0.0,206.0,6.0,741.0,1.0,50.0,130.0,51.0
dtw/cost-matrix,2.0,7.0,1.0,196.0,2.0,118.0,1.0,46.0,119.0,33.0
dtw/matrix-update,0.0,1.0,0.0,7.0,1.0,3.0,0.0,9.0,8.0,2.0
desugar/list-comp-1,1.0,2.0,0.0,51.0,0.0,7.0,0.0,23.0,37.0,15.0
desugar/list-comp-2,1.0,10.0,0.0,208.0,1.0,28.0,0.0,38.0,111.0,44.0
desugar/list-comp-3,1.0,2.0,0.0,47.0,0.0,7.0,0.0,14.0,32.0,10.0
desugar/list-comp-4,1.0,1.0,0.0,20.0,0.0,3.0,0.0,9.0,16.0,3.0
desugar/list-comp-5,0.0,1.0,0.0,15.0,0.0,3.0,0.0,8.0,17.0,3.0
desugar/list-comp-6,1.0,0.0,0.0,1.0,0.0,9.0,0.0,11.0,11.0,1.0
desugar/list-comp-7,1.0,1.0,0.0,16.0,0.0,3.0,0.0,11.0,19.0,3.0
desugar/list-enum,1.0,6.0,0.0,13.0,0.0,7.0,0.0,8.0,15.0,2.0
add,0.0,1.0,0.0,2.0,1.0,1.0,0.0,6.0,6.0,0.0
array/lookup,0.0,1.0,0.0,69.0,0.0,16.0,0.0,15.0,44.0,18.0
array/dims,0.0,1.0,0.0,7.0,0.0,3.0,0.0,9.0,10.0,3.0
convolution/edgeDetect,31.0,44.0,1.0,6144.0,9.0,4437.0,341.0,1144.0,3552.0,1402.0
convolution/emboss,24.0,35.0,0.0,5347.0,2.0,4085.0,334.0,890.0,3084.0,1182.0
convolution/gaussian,26.0,36.0,1.0,4913.0,1.0,3813.0,360.0,828.0,2827.0,1306.0
dict/create,2.0,5.0,0.0,5.0,1.0,6.0,0.0,11.0,30.0,0.0
dict/difference,1.0,1.0,0.0,3.0,0.0,7.0,0.0,6.0,7.0,1.0
dict/disjointUnion,1.0,1.0,0.0,2.0,0.0,3.0,0.0,10.0,6.0,0.0
dict/foldl,2.0,2.0,0.0,46.0,0.0,13.0,0.0,15.0,18.0,5.0
dict/intersectionWith,2.0,1.0,2.0,28.0,1.0,4.0,0.0,26.0,17.0,18.0
dict/fromRecord,0.0,1.0,0.0,1.0,1.0,2.0,0.0,9.0,7.0,0.0
dict/get,0.0,2.0,0.0,3.0,0.0,2.0,0.0,8.0,7.0,1.0
dict/map,1.0,1.0,0.0,11.0,0.0,4.0,0.0,10.0,10.0,3.0
divide,0.0,0.0,0.0,2.0,0.0,4.0,0.0,5.0,13.0,0.0
filter,1.0,1.0,0.0,15.0,0.0,3.0,0.0,13.0,16.0,2.0
intersperse,1.0,1.0,0.0,10.0,1.0,3.0,0.0,8.0,7.0,2.0
intersperse,1.0,2.0,0.0,7.0,0.0,2.0,1.0,7.0,10.0,4.0
length,1.0,1.0,0.0,8.0,0.0,2.0,0.0,6.0,15.0,1.0
list-comp,1.0,2.0,1.0,94.0,2.0,13.0,3.0,28.0,67.0,29.0
list-comp,1.0,1.0,0.0,77.0,1.0,7.0,2.0,24.0,65.0,24.0
lookup,0.0,0.0,1.0,14.0,0.0,3.0,1.0,10.0,14.0,4.0
map,0.0,0.0,0.0,8.0,0.0,3.0,0.0,10.0,8.0,1.0
multiply,1.0,2.0,0.0,1.0,0.0,1.0,0.0,8.0,15.0,0.0
nth,0.0,0.0,0.0,4.0,1.0,3.0,0.0,7.0,18.0,1.0
section-5-example,1.0,3.0,1.0,87.0,1.0,7.0,4.0,25.0,71.0,30.0
section-5-example,1.0,2.0,0.0,83.0,1.0,10.0,2.0,23.0,58.0,25.0
section-5-example,2.0,2.0,0.0,111.0,1.0,9.0,3.0,21.0,62.0,28.0
zeros,1.0,1.0,0.0,4.0,1.0,2.0,0.0,10.0,7.0,2.0
zeros,0.0,0.0,0.0,3.0,0.0,2.0,0.0,5.0,8.0,5.0
zipWith,1.0,2.0,0.0,13.0,0.0,2.0,1.0,9.0,14.0,6.0
graphics/background,2.0,4.0,0.0,12.0,2.0,20.0,0.0,9.0,12.0,3.0
graphics/grouped-bar-chart,6.0,853.0,1.0,526.0,250.0,2585.0,0.0,107.0,294.0,134.0
graphics/line-chart,9.0,1953.0,1.0,799.0,856.0,3744.0,0.0,139.0,443.0,191.0
graphics/stacked-bar-chart,4.0,228.0,0.0,288.0,143.0,189.0,0.0,64.0,173.0,70.0
Loading

0 comments on commit 711244d

Please sign in to comment.