Skip to content

Commit

Permalink
raise tolerance for squeezenet1_1 (#130165)
Browse files Browse the repository at this point in the history
Summary:
The training accuracy for this model starts to regress. It does not show up on the weekly run yet but
1. it shows up in my MA runs [here](https://hud.pytorch.org/benchmark/torchbench/inductor_max_autotune?dashboard=torchinductor&startTime=Fri,%2028%20Jun%202024%2006:53:45%20GMT&stopTime=Fri,%2005%20Jul%202024%2006:53:45%20GMT&granularity=hour&mode=training&dtype=amp&lBranch=gh/shunting314/162/head&lCommit=cb236e8c198b54901e4fb19698f91be786f72e25&rBranch=main&rCommit=4ee1cb9b955fcc5d75a421b19393998122136f2c)
2. I can repro it locally

Command:
```
TORCHINDUCTOR_MAX_AUTOTUNE=1 time python benchmarks/dynamo/torchbench.py --accuracy --training --amp --backend
 inductor --device cuda --only squeezenet1_1
```

Raise the tolerance to fix.

X-link: pytorch/pytorch#130165
Approved by: https://github.com/jansel
ghstack dependencies: #129996, #129941, #130005, #130163

Reviewed By: izaitsevfb

Differential Revision: D59432165

Pulled By: shunting314

fbshipit-source-id: 9c21b16d6ce1f5fe72f7e1ec5e9c45c4a5d783c2
  • Loading branch information
shunting314 authored and facebook-github-bot committed Jul 7, 2024
1 parent 4b434db commit 36f880d
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions userbenchmark/dynamo/dynamobench/torchbench.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -42,6 +42,7 @@ tolerance:
- tacotron2
- yolov3
- timm_efficientdet
- squeezenet1_1

higher_fp16:
- doctr_reco_predictor
Expand Down

0 comments on commit 36f880d

Please sign in to comment.