Skip to content
TheChatArchiveThe Chat Archive
gpt-4o-2024-05-13· OpenAIAi2 WildChat-4.8M (AI2)

In the article, "Exposure Bias versus Self-Recovery: Are Distortions Really Incremental…

  1. User

    In the article, "Exposure Bias versus Self-Recovery: Are Distortions Really Incremental for Autoregressive Text Generation"?

    Do we exclude the Prompt C like in EB-C (Gap) for EB-M (Gap)?

  2. Assistant

    In the context of the article "Exposure Bias versus Self-Recovery: Are Distortions Really Incremental for Autoregressive Text Generation," Prompt C is excluded in both EB-C (Gap) and EB-M (Gap). The acronyms EB-C and EB-M stand for Exposure Bias in the context of continuous (EB-C) and mixed (EB-M) decoding methods, respectively. The term "Gap" indicates that a certain portion of the prompt is intentionally omitted or skipped to evaluate the model's performance in generating text given incomplete input information.

    Therefore, the article asserts that both EB-C (Gap) and EB-M (Gap) involve an identical setup regarding the exclusion of the initial prompt segment, ensuring consistency in the evaluation of exposure bias and self-recovery mechanisms across different generation strategies.