Skip to content
TheChatArchiveThe Chat Archive
Human-written demonstration (OpenAssistant volunteers)· OpenAssistant (human-written)Hugging Face OpenAssistant Conversations (oasst2)

who invented the transformer architecture

In OpenAssistant data, “assistant” turns were written by human volunteers as demonstrations. They are not model outputs.
  1. User

    who invented the transformer architecture

  2. Assistant

    The Transformer architecture was introduced in a 2017 paper by Vaswani et al. from Google Brain. The credited authors of the paper are Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser and Illia Polosukhin.

    Let me know if you need anything else concerning the subject.

Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.