please look for papers (conference or journals) that talk about how humans follow…
- User
please look for papers (conference or journals) that talk about how humans follow specific task instructions, for example, whether the following sentence is grammatical correct or not
Assistant
Here's a research plan for that topic. If you need to update it, let me know! Human Instruction Following Research Research Websites(1) Search for academic papers (journals or conference proceedings) in cognitive science and human factors discussing the general cognitive processes involved in humans encoding and executing explicit task instructions. (2) Find research in psycholinguistics or cognitive neuroscience specifically examining how humans perform linguistic judgment tasks, such as assessing grammatical correctness, based on task instructions. (3) Investigate studies that analyze how the complexity, ambiguity, or framing of instructions affects human adherence, task performance, and decision-making in rule-based contexts. (4) Look for literature that explores the role of cognitive resources, such as working memory and attention, in the ability of humans to follow multi-step or conditional instructions. (5) Identify papers that contrast human performance in rule-based tasks when instructions are explicitly provided versus when rules are implicitly learned or inferred. (6) Search for comprehensive review papers or meta-analyses that synthesize current understanding and models of human instruction-following behavior across different experimental paradigms. (7) Examine research that analyzes common types of errors, deviations, or biases that arise when humans execute a repetitive task according to detailed, specific instructions. (8) Find theoretical frameworks or computational models that propose mechanisms to explain how humans encode, maintain, and execute specified task instructions in cognitive architecture.MoreAnalyze ResultsCreate ReportReady in a few mins Edit plan Start research
- User
Start research
Assistant
I've completed your research. Feel free to ask me follow-up questions or request changes.Human Instruction Following ResearchCompleted21 Nov, 10:57
- User
could focus more on psychology work and whether we see the same effects in language models?
Assistant
Here's a research plan for that topic. If you need to update it, let me know! LLM Instruction Following vs. Psychology Research Websites(1) Identify recent academic papers in cognitive psychology and behavioral science that isolate and detail specific human cognitive biases (e.g., framing, ambiguity effect, recency bias) during explicit instruction following. (2) Find comparative studies that explicitly analyze and contrast human and Large Language Model (LLM) adherence to task instructions, focusing on systematic deviations and error patterns. (3) Investigate research on LLM instruction following, focusing on how prompt complexity, length, and specificity affect model output and adherence to the desired format or goal. (4) Search for papers that map human cognitive constraints, such as working memory load or executive control failures, to analogous phenomena observed in LLM performance (e.g., context window limits, instruction tuning failure). (5) Specifically look for academic literature detailing cognitive biases in LLMs (e.g., priming, anchoring, order effects) that mirror human instruction-following biases. (6) Find theoretical frameworks or papers discussing the architectural similarities or differences between human cognitive models (like ACT-R/Soar) and transformer-based LLMs in terms of translating natural language instructions into executable steps.MoreAnalyze ResultsCreate ReportReady in a few mins Edit plan Start research
- User
Start research
Assistant
I've completed your research. Feel free to ask me follow-up questions or request changes.
- User
is there evidence that instructions make humans look on task specific properties. for example when we ask whether given sentence is grammatical correct, humans compute more information about the grammatical correctness when reading the specific sentence
Assistant
Yes, there is clear evidence within psycholinguistics research that the explicit instructions given for a task like a Grammaticality Judgment Task (GJT) fundamentally change the type and depth of cognitive processing applied to the sentence stimulus.When humans are instructed to determine whether a given sentence is "grammatically correct," they are forced to shift from relying on their natural, implicit linguistic knowledge (competence) to engaging their conscious, rule-based metalinguistic ability.Here is how instructions affect task-specific processing:1. Shift from Intuition to Conscious AnalysisThe primary impact of the instruction is the shift in cognitive strategy. The goal of a GJT is typically to measure a native speaker's unconscious linguistic competence. However, when explicit instructions or rules regarding the relevant grammatical structures are provided, participants often utilize this information as an "efficient shortcut".Instead of accessing their deeply ingrained linguistic intuition, they rely on the explicit
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.
Identical first prompt
Gemini (model unspecified)Compare side by side →
Gemini (model unspecified)Compare side by side →
Gemini (model unspecified)Compare side by side →
Gemini (model unspecified)Compare side by side →
Gemini (model unspecified)Compare side by side →
Gemini (model unspecified)Compare side by side →
Gemini (model unspecified)Compare side by side →
Gemini (model unspecified)Compare side by side →
Gemini (model unspecified)Compare side by side →
Gemini (model unspecified)Compare side by side →
Gemini (model unspecified)Compare side by side →