Ask Twice, Look Twice: Prompt Echoing Resolves the Question-First Paradox in Vision-Language Models
Updated
Updated · arxiv.org · Jul 17
Ask Twice, Look Twice: Prompt Echoing Resolves the Question-First Paradox in Vision-Language Models
1 articles · Updated · arxiv.org · Jul 17
Summary
Researchers have identified a 'question-first paradox' in vision-language models, where placing the question before the image reduces accuracy.
Analysis shows that while a question-first prompt improves perception, it hinders the model's ability to access the question when generating answers.
A prompt design fix called 'question echoing'—repeating the question before and after the image—significantly improves performance without retraining or architectural changes.