Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Time Preprocessing #185

Closed
wants to merge 2 commits into from
Closed

Time Preprocessing #185

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
2b6bd64
Time Preprocessing
tjablin Oct 27, 2020
b85e77b
Datacenter only
tjablin Oct 27, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 10 additions & 9 deletions inference_rules.adoc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -444,32 +444,33 @@ using a checksum. The dataset must be unchanged at the start of each run.

As input, before preprocessing:

* all imaging benchmarks take uncropped uncompressed bitmap
* all imaging benchmarks take uncropped compressed images in for Datacenter submission and uncompressed images otherwise

* BERT takes text

* RNN-T takes a waveform

* DLRM takes a variable sized set of items, each a sequence of embedding indices

Sample-independent pre-processing that matches the reference model is
untimed. However, it must be pre-approved and added to the following list:
Sample-independent pre-processing that matches the reference model is
timed Datacenter submissions and untimed otherwise. Untimed preprocessing
must be pre-approved and added to the following list:

* May resize to processed size (e.g. SSD-large)

* May reorder channels / do arbitrary transpositions
* May reorder channels / do arbitrary transpositions

* May pad to arbitrary size (don’t be creative)
* May pad to arbitrary size (don’t be creative)

* May do a single, consistent crop

* Mean subtraction and normalization provided reference model expect those to be
* Mean subtraction and normalization provided reference model expect those to be
done

* May convert data among numerical formats
* May convert data among numerical formats

Any other pre- and post-processing time is included in the wall-clock time for a
run result.
Any other pre- and post-processing time is included in the wall-clock time for a
run result.

=== Test Data Traversal Order

Expand Down