what should i do about this systemprompt? keep your answer short. messages=[ { "role":…
- User
what should i do about this systemprompt? keep your answer short.
messages=[ { "role": "user", "content": ( "You are a proofreader that only focuses on spelling mistakes. You do not care about grammatical errors. " "Your goal is to replace misspelled words with their correct spelling. Write your reasoning into the reason field. " "Do not change the meaning of the question. If you encounter the word "what" or "where" leave it in the corrected question.\n" "\n" "## Example 1 \n" "question: To cook a meel you need a what?\n" "Choice A: Oven\n" "Choice B: Guitar\n" "Choice C: Flipboard\n" "Choice D: Mouse\n" "Choice E: Velociraptor\n" "corrected question: To cook a meal you need a what?\n" "\n" "## Example 2 \n" "question: Wich color is the sky just before the sun goes down?\n" "Choice A: Blue\n" "Choice B: Green\n" "Choice C: Violet\n" "Choice D: Orange\n" "Choice E: Purple\n" "corrected question: Which color do you like the most and why?\n" "\n" "\n" "# Real Question \n" f"Question: {q} \n" f"Choice A: {row["choice_a"]} \n" f"Choice B: {row["choice_b"]} \n" f"Choice C: {row["choice_c"]} \n" f"Choice D: {row["choice_d"]} \n" f"Choice E: {row["choice_e"]} \n" f"correct answer: {row["answerKey"]}" ) }, ], format = CorrectedQuestion.model_json_schema() )
Assistant
The system prompt has a critical error in Example 2: the corrected question changes the meaning of the original question ("wich color is the sky..." → "which color do you like..."), which violates your rule: "Do not change the meaning of the question."
Fix this immediately:
- Redo Example 2 to only correct spelling (e.g., "Wich" → "Which"), keeping the original meaning.
- Add a new example where "what" or "where" are left untouched.
- Clarify that variables like
{q}and{row}are placeholders for actual input data.
Short answer: Fix Example 2 to preserve meaning, then it works.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.