can you make a multiple-choice question in terms of machine translation evaluation…
- User
can you make a multiple-choice question in terms of machine translation evaluation research which won't be easy for people who didn't major in it?
Assistant
Here is a multiple choice question about machine translation evaluation that should be challenging for those without expertise in the field:
Which of the following metrics is NOT an automatic metric for evaluating machine translation quality?
A) BLEU B) TER C) NIST D) Human judgment
The answer is D) Human judgment. BLEU, TER, and NIST are all automatic metrics that can be used to evaluate machine translation systems without human raters. They work by comparing the machine translation output to one or more reference translations. Human judgment requires human raters to evaluate translations, so it is not an automatic metric. This question tests knowledge of specific machine translation evaluation metrics, which most general audiences would not be familiar with. Let me know if you would like me to modify or explain the question further.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.