fix Unable to find data type for weight_name='/encoder/layer.0/attention/output/dense/MatMul_output_0'

[VTrngNghia]

What does this PR do?

Adds a keyword argument to allow passing extra_options to ORTQuantizer.quantize()

To fix RuntimeError:

Unable to find data type for weight_name='/encoder/layer.0/attention/output/dense/MatMul_output_0'. shape_inference failed to return a type probably this node is from a different domain or using an input produced by such an operator. This may happen if you quantize a model already quantized. You may use extra_options DefaultTensorType to indicate the default weight type, usually onnx.TensorProto.FLOAT.

Maybe it can be added to AutoQuantizationConfig, but there any many @staticmethod for that, so maybe this quick fix is simpler.

Who can review?

It's very simple. Anyone can review.

• ONNX / ONNX Runtime : @fxmarty, @echarlaix, @JingyaHuang, @michaelbenayoun
• ONNX Runtime Training: @JingyaHuang
• BetterTransformer: @fxmarty
• GPTQ, quantization: @fxmarty, @SunMarc
• TFLite export: @michaelbenayoun

[severinsimmler]

+1

Thanks for fixing this @VTrngNghia