You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
At the following line, the relavant_docs dictionary is overridden instead of getting updated. This causes relavant_docs to only contain the last seen query. This is problematic in datasets with duplicate queries (e.g. DocVQA) as the output score is not correctly computed.
Description
At the following line, the
relavant_docs
dictionary is overridden instead of getting updated. This causesrelavant_docs
to only contain the last seen query. This is problematic in datasets with duplicate queries (e.g. DocVQA) as the output score is not correctly computed.vidore-benchmark/src/vidore_benchmark/retrievers/vision_retriever.py
Line 122 in b860971
The text was updated successfully, but these errors were encountered: