Adjusting DenseForSparse layer size #8751
Labels
area:rasa-oss 🎡
Anything related to the open source Rasa framework
area:rasa-oss/ml 👁
All issues related to machine learning
research:incremental-training
type:enhancement ✨
Additions of new features or changes to existing ones, should be doable in a single PR
After completing #8749 and #8750, in order to dynamically change sparse layers during fine-tuning, we will need to adjust the
DenseForSparse
layer size in case there are any new sparse features.This functionality will be implemented in the
DIET
class. We will compare persistedfeature_sizes
to the currentfeature_sizes
to find out if there are anyDenseForSparse
layers to be updated. After updating the layers, we will compile the whole model, update data signatures, create aRasaModelData
object from a data example and activate new layers by fitting the model on theRasaModelData
object.Things to be done:
adjust_layers
fromDIETClassifier
during fine-tuningDenseForSparse
layers should be updatedThe text was updated successfully, but these errors were encountered: