-
when I am using the code for bert in https://github.com/dmlc/gluon-nlp/tree/master/scripts/bert, |
Beta Was this translation helpful? Give feedback.
Replies: 3 comments
-
@Gpwner currently it requires a small amount of manual process, where you may need to use the utility classes to construct a HybridBlock-based BERT model. The guide can be found here: http://gluon-nlp.mxnet.io/model_zoo/bert/index.html#example-usage-of-exporting-hybridizable-bert We know this is not perfect, as it would be better to have an export API to automate this for all model classes in BERT model zoo. I created an issue to track this here: #659 |
Beta Was this translation helpful? Give feedback.
-
Thanks I will have a try. |
Beta Was this translation helpful? Give feedback.
-
@Gpwner we now have a single script for exporting BERT for inference thanks to @eric-haibin-lin (#705). Feel free to give it a try and let us know how you like it :) |
Beta Was this translation helpful? Give feedback.
@Gpwner currently it requires a small amount of manual process, where you may need to use the utility classes to construct a HybridBlock-based BERT model. The guide can be found here: http://gluon-nlp.mxnet.io/model_zoo/bert/index.html#example-usage-of-exporting-hybridizable-bert
We know this is not perfect, as it would be better to have an export API to automate this for all model classes in BERT model zoo. I created an issue to track this here: #659