Human-written demonstration (OpenAssistant volunteers)· OpenAssistant (human-written) OpenAssistant Conversations (oasst2)
指令微调技术有什么用?
In OpenAssistant data, “assistant” turns were written by human volunteers as demonstrations. They are not model outputs.
- User
指令微调技术有什么用?
- Assistant
指令微调技术是一种用于自然语言处理(NLP)模型的微调技术,它通过给模型提供指令和选项的方式,使其能够提升零样本任务的性能表现。指令微调的作用是解锁/激发模型的已有能力。这主要是因为指令微调的数据量比预训练数据量少几个数量级(基础的能力是通过预训练注入的)。
零样本任务:训练集中没有出现过的任务或记录
- User
请告诉我零样本任务是什么?
- Assistant
零样本任务是指给定一个新类别的任务,但在训练集中没有这个类别的样本。例如,在图像分类任务中,如果模型在训练期间只接触到了猫、狗和鸟的图像,那么在测试时要求它对蛇进行分类,这就是一个零样本任务。这种任务通常需要模型具备一定的推理能力,能够将已知的知识迁移到未见过的类别上。
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.
Identical first prompt
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →
- Human-written demonstration (OpenAssistant volunteers)Compare side by side →