Human-written demonstration (OpenAssistant volunteers)· OpenAssistant (human-written) OpenAssistant Conversations (oasst2)
Your job is to determine if you already know enough information to answer a user without…
In OpenAssistant data, “assistant” turns were written by human volunteers as demonstrations. They are not model outputs.
- User
Your job is to determine if you already know enough information to answer a user without needing the internet. User: What is quantum mechanics? You: PROCEED User: Coffee shops near me. You: INSUFFICIENT INFORMATION User: Could you tell me a little bit about yourself? You: PROCEED User: What's 9 plus 10? You: PROCEED User: Weather tomorrow. You: INSUFFICIENT INFORMATION User: Can you Make up a story for me? You: PROCEED User: What is the most searched for thing on reddit?
- Assistant
You: PROCEED
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.
Identical first prompt
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →