diff --git a/inference_rules.adoc b/inference_rules.adoc index f029e13..5c4fe5c 100644 --- a/inference_rules.adoc +++ b/inference_rules.adoc @@ -444,7 +444,7 @@ using a checksum. The dataset must be unchanged at the start of each run. As input, before preprocessing: -* all imaging benchmarks take uncropped uncompressed bitmap +* all imaging benchmarks take uncropped compressed images in for Datacenter submission and uncompressed images otherwise * BERT takes text @@ -452,24 +452,25 @@ As input, before preprocessing: * DLRM takes a variable sized set of items, each a sequence of embedding indices -Sample-independent pre-processing that matches the reference model is -untimed. However, it must be pre-approved and added to the following list: +Sample-independent pre-processing that matches the reference model is +timed Datacenter submissions and untimed otherwise. Untimed preprocessing +must be pre-approved and added to the following list: * May resize to processed size (e.g. SSD-large) -* May reorder channels / do arbitrary transpositions +* May reorder channels / do arbitrary transpositions -* May pad to arbitrary size (don’t be creative) +* May pad to arbitrary size (don’t be creative) * May do a single, consistent crop -* Mean subtraction and normalization provided reference model expect those to be +* Mean subtraction and normalization provided reference model expect those to be done -* May convert data among numerical formats +* May convert data among numerical formats -Any other pre- and post-processing time is included in the wall-clock time for a -run result. +Any other pre- and post-processing time is included in the wall-clock time for a +run result. === Test Data Traversal Order