What is the minimum data size needed to train a model that understands human languages??
- User
What is the minimum data size needed to train a model that understands human languages??
- Assistant
The minimum data size needed to train a model that understands human languages can vary. It is highly dependent on the specific tasks.
For instance, simple task like sentiment analysis model can be trained with a few thousand labeled data sets. On the other hand, for a more complex task like large language models, you would need millions or even billions of label data sets to achieve acceptable results.
- User
How can I collect this data?
- Assistant
If all goes well, you should be able to use the dataset that was used to train this model as it should be open source by then.
If you would like to collect data yourself however, you would probably have to apply the help from others. Creating and labelling thousands of paragraphs on your own might be tiring pretty quickly and I would advise against it.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.
Identical first prompt
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →