Add driver time command

[pfultz2]

This will time the model in a loop without synchronization until after the loop. This should get much closer to actual device time, and its useful when doing timing on small subgraphs(since they usually run less then 100 microseconds).

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 92.16%. Comparing base (c3a5367) to head (76812a5).
Report is 8 commits behind head on develop.

Additional details and impacted files

@@           Coverage Diff            @@
##           develop    #3554   +/-   ##
========================================
  Coverage    92.16%   92.16%           
========================================
  Files          512      512           
  Lines        21401    21401           
========================================
  Hits         19724    19724           
  Misses        1677     1677           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[migraphx-bot]

Test	Batch	Rate new 76812a	Rate old 71fd27	Diff	Compare
torchvision-resnet50	64	3,256.57	3,257.89	-0.04%	✅
torchvision-resnet50_fp16	64	6,992.90	6,970.17	0.33%	✅
torchvision-densenet121	32	2,433.77	2,434.31	-0.02%	✅
torchvision-densenet121_fp16	32	4,087.53	4,075.92	0.28%	✅
torchvision-inceptionv3	32	1,636.70	1,638.52	-0.11%	✅
torchvision-inceptionv3_fp16	32	2,764.24	2,764.44	-0.01%	✅
cadene-inceptionv4	16	777.00	775.75	0.16%	✅
cadene-resnext64x4	16	811.62	808.04	0.44%	✅
slim-mobilenet	64	7,535.36	7,535.82	-0.01%	✅
slim-nasnetalarge	64	211.42	211.48	-0.03%	✅
slim-resnet50v2	64	3,504.08	3,506.62	-0.07%	✅
bert-mrpc-onnx	8	1,150.10	1,150.10	0.00%	✅
bert-mrpc-tf	1	463.87	473.40	-2.01%	✅
pytorch-examples-wlang-gru	1	415.42	416.64	-0.29%	✅
pytorch-examples-wlang-lstm	1	399.13	401.17	-0.51%	✅
torchvision-resnet50_1	1	777.41	751.90	3.39%	🔆
cadene-dpn92_1	1	399.55	397.07	0.63%	✅
cadene-resnext101_1	1	374.03	383.71	-2.52%	✅
onnx-taau-downsample	1	343.48	343.32	0.05%	✅
dlrm-criteoterabyte	1	33.35	33.32	0.11%	✅
dlrm-criteoterabyte_fp16	1	52.69	52.76	-0.13%	✅
agentmodel	1	8,300.13	8,370.16	-0.84%	✅
unet_fp16	2	59.00	58.90	0.16%	✅
resnet50v1_fp16	1	939.06	941.27	-0.23%	✅
resnet50v1_int8	1	1,003.48	1,005.65	-0.22%	✅
bert_base_cased_fp16	64	1,171.94	1,171.62	0.03%	✅
bert_large_uncased_fp16	32	363.41	363.80	-0.11%	✅
bert_large_fp16	1	198.61	198.85	-0.12%	✅
distilgpt2_fp16	16	2,204.23	2,203.72	0.02%	✅
yolov5s	1	531.50	533.95	-0.46%	✅
tinyllama	1	43.51	43.43	0.18%	✅
vicuna-fastchat	1	177.40	176.68	0.40%	✅
whisper-tiny-encoder	1	418.09	418.65	-0.13%	✅
whisper-tiny-decoder	1	428.40	437.27	-2.03%	✅

Check results before merge 🔆

[migraphx-bot]

     ✅ bert-mrpc-onnx: PASSED: MIGraphX meets tolerance

     ✅ bert-mrpc-tf: PASSED: MIGraphX meets tolerance

     ✅ pytorch-examples-wlang-gru: PASSED: MIGraphX meets tolerance

     ✅ pytorch-examples-wlang-lstm: PASSED: MIGraphX meets tolerance

     ✅ torchvision-resnet50_1: PASSED: MIGraphX meets tolerance

     ✅ cadene-dpn92_1: PASSED: MIGraphX meets tolerance

     ✅ cadene-resnext101_1: PASSED: MIGraphX meets tolerance

     ✅ dlrm-criteoterabyte: PASSED: MIGraphX meets tolerance

     ✅ agentmodel: PASSED: MIGraphX meets tolerance

     ✅ unet: PASSED: MIGraphX meets tolerance

     ✅ resnet50v1: PASSED: MIGraphX meets tolerance

     ✅ bert_base_cased_fp16: PASSED: MIGraphX meets tolerance

🔴bert_large_uncased_fp16: FAILED: MIGraphX is not within tolerance - check verbose output

     ✅ bert_large: PASSED: MIGraphX meets tolerance

     ✅ yolov5s: PASSED: MIGraphX meets tolerance

     ✅ tinyllama: PASSED: MIGraphX meets tolerance

     ✅ vicuna-fastchat: PASSED: MIGraphX meets tolerance

     ✅ whisper-tiny-encoder: PASSED: MIGraphX meets tolerance

     ✅ whisper-tiny-decoder: PASSED: MIGraphX meets tolerance

     ✅ distilgpt2_fp16: PASSED: MIGraphX meets tolerance