Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ask for visualizing colorful vector #8

Open
jkstyle2 opened this issue Jun 21, 2024 · 1 comment
Open

Ask for visualizing colorful vector #8

jkstyle2 opened this issue Jun 21, 2024 · 1 comment

Comments

@jkstyle2
Copy link

jkstyle2 commented Jun 21, 2024

Dear authors,
Thanks for sharing your great work :)
I was impressed how you depicts the eight-head attention values with colorful vectors as below.
Could you share how we can visualize these vectors, if it is not manually done?
image

Thanks for your help in advance!

@heng-hw
Copy link
Owner

heng-hw commented Sep 21, 2024

Hi @jkstyle2! Thanks for your interest in our work. We follow this approach https://github.com/jessevig/bertviz to visualize the attention. Hope it helps!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants