Skip to content
This repository has been archived by the owner on Mar 20, 2024. It is now read-only.

Commit

Permalink
[MXAPPS-809] Benchmark.AI Reporting (#9)
Browse files Browse the repository at this point in the history 
* [MXAPPS-809] Benchmark.AI E-mail reporting.

Initial version of reporting CLI tool to generate a basic report of benchmarks.
* Functionality to retrieve metrics from Cloudwatch.
* Configuration for all benchmarks that should be part of the report.
* Support for XLSX output in this version.

* Benchmark.AI e-mail functionality.

* Added a command-line flag and functionality to e-mail reports in HTML.
* Minor code clean-up.

* Some Benchmark.AI formatting and clean-up for metrics.

* Correcting column names for Framework/Model/Benchmark.

* Update comments in benchmark reporting config.

* Clean up benchmark configuration.

* Update benchmark configuration comments.

* Remove default keys.

* Re-order configuration so that MXNet benchmarks appear together.

Additionally, correct 'cpu_memory_usage' metric key.

* Make report daily instead of weekly.
  • Loading branch information
@vishaalkapoor @indhub
vishaalkapoor authored and indhub committed Oct 19, 2018
1 parent e8c217c commit 4119e12
Show file tree
Hide file tree
Showing 7 changed files with 665 additions and 304 deletions.
1 change: 1 addition & 0 deletions reporting/.gitignore
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
*.pyc
Loading

0 comments on commit 4119e12

Please sign in to comment.