In the article, "Exposure Bias versus Self-Recovery: Are Distortions Really Incremental…
- User
In the article, "Exposure Bias versus Self-Recovery: Are Distortions Really Incremental for Autoregressive Text Generation"?
Do we exclude the Prompt C like in EB-C (Gap) for EB-M (Gap)?
- Assistant
In the context of the article "Exposure Bias versus Self-Recovery: Are Distortions Really Incremental for Autoregressive Text Generation," Prompt C is excluded in both EB-C (Gap) and EB-M (Gap). The acronyms EB-C and EB-M stand for Exposure Bias in the context of continuous (EB-C) and mixed (EB-M) decoding methods, respectively. The term "Gap" indicates that a certain portion of the prompt is intentionally omitted or skipped to evaluate the model's performance in generating text given incomplete input information.
Therefore, the article asserts that both EB-C (Gap) and EB-M (Gap) involve an identical setup regarding the exclusion of the initial prompt segment, ensuring consistency in the evaluation of exposure bias and self-recovery mechanisms across different generation strategies.