In our first setup, we trained the models for each property individually.
./setup_1/bert/
contains the data for BERT model and ./setup_1/prolocal/
for ProLocal model.
Along with individual models for each property, we also train a combined BERT-based classifier to predict property values for each property type. Here, we train a single model on multiple properties, with each property trained on respective training rows.
./setup_2/bert/
contains the data for this setup.
To give BERT model context of previous steps while training, we extend embeddings by training BERT with first n steps for every nth step in the procedure. We do this only for state-type properties, since for event-type properties, only that particular step for which the prediction is being made is causing the state change. Model is trained to predict the actual state of entity at every step, individually for each property.
./setup_3/bert/
contains the data for this setup.
All the files for the desired setup has to be placed in data/Inputs
. This can be done manually or use the scripts provided in the root. For more info, see the root REAMDE.