Code for Grad-CAM visualization

[qiaomu-miao]

Hi,

Thanks for the great work.

In Figure 3 of your paper, you showed the Grad-CAM visualizations of your model on RefCOCO+ from text descriptions. Could you share the code for using Grad-CAM on your model?

Thanks!

[fizahkhalid]

Have you figured out how to generate the heatmaps?

I tried using torchcam, but I'm only getting a point and not a 2D grid for the activate map.

[zengyan-97]

Hi,
I have not used grad-cam for a long time.
You can refer to this code: https://github.com/salesforce/ALBEF/blob/main/visualization.ipynb for grad-cam.