how to use ORD datasets into the model?

[ALR-alr]

ORD datasets have two parts: scene-graph and region-description,. How can you use it to complete a I2T or T2I task? Do you rewrite the region descriptions to a whole sentence as a text input?

[shizhediao]

Yes, we did some data augmentation based on the original data. You can find the details in Appendix A.3 https://arxiv.org/pdf/2206.07699

[ALR-alr]

Thanks for your rapid reply! Whether the prompt template only consider the objects, but ignore the attributions and relations?

[shizhediao]

Yes, but you could explore it if you think it is beneficial.
Thanks!

[ALR-alr]

Thank you very much, your reply is crucial to me!