Retrieval and Inference

[kiucho]

Thank you for sharing your research.

Regarding the ODQA task, I understand that there is only one inference without stride, so there is no need for retrieval again. However, in the case of language modeling, I had assumed that retrieval would occur during inference for a specific stride. I would be grateful if you could explain why retrieval and evaluation are not aligned in the implementation.