AI Attention Deficits in the Stroop Task

ArtificialIntelligence GPT-5 CognitiveScience StroopTask MachineLearning ResearchAnalysis

摘要

心智圖封面圖片
AI 生成的封面圖片

A recent study published in PNAS Nexus on June 14, 2026, reveals that advanced large language models (LLMs) like GPT-5, Claude 3.5 Sonnet, and Gemini 2.5 struggle with sustained attention when subjected to the classic Stroop task. While these models perform well on short, simple sequences, their accuracy collapses significantly as task complexity and list length increase, indicating a fundamental difference between AI processing and human executive control. The researchers, led by Suketu Patel, argue that AI systems lack the biological capacity to suppress automatic responses—such as reading a word instead of identifying its ink color—over extended periods. This dissociation between task recognition and execution suggests that current transformer-based architectures do not replicate the human brain's ability to maintain goal-oriented focus under cognitive conflict. The study highlights a critical limitation in modern AI: the inability to maintain long-term instruction adherence when faced with competing information. As task length grows, these models revert to their training biases, prioritizing word recognition over the specific task instructions, leading to near-zero accuracy in complex, mismatched scenarios. For users and developers, this research serves as a warning that impressive performance in reasoning or coding does not equate to human-like cognitive stability. Future AI applications requiring sustained focus and inhibition of automatic responses may need architectural improvements to overcome these inherent attention deficits.

關鍵點

01

🔹 The Stroop Task Experiment

The Stroop task is a psychological test measuring executive control by requiring participants to identify the color of ink used to write a word, while ignoring the word's meaning. It creates a mental conflict between automatic reading instincts and the goal-oriented task of color identification. Humans typically maintain high accuracy despite this conflict, whereas AI models show a breakdown in performance as the task duration increases.

02

🔸 Performance Collapse in LLMs

【📌 Initial Success】Models like GPT-4o achieved 91% accuracy on short 5-word lists. 【🔸 Rapid Decline】As lists expanded to 10 words, GPT-4o accuracy dropped to 57%. 【⭐ Critical Failure】At 40 words, accuracy plummeted to 15% for GPT-4o and 24% for Claude 3.5 Sonnet. When matching and mismatched words were mixed, accuracy on mismatched items approached zero.

03

⭐ Biological vs. Artificial Attention

The study suggests a fundamental difference in attention mechanisms. Humans utilize executive control to override automatic responses (reading the word) to focus on the goal (naming the color). AI models, trained heavily on text, revert to their dominant training bias (reading) because they lack the biological capacity to maintain goal-oriented inhibition over long sequences.

04

📊 Models Tested and Findings

The research evaluated several leading models including GPT-4o, GPT-5, Claude 3.5 Sonnet, Claude Opus 4.1, and Gemini 2.5. All models exhibited similar patterns of failure. The researchers concluded that recognizing the task structure is insufficient for accurate execution, as the models fail to engage the necessary conflict-resolution mechanisms required for sustained, accurate performance.

05

💡 Implications for AI Development

This research highlights that current transformer-based AI systems have hidden weaknesses in sustained focus and inhibition. While these models excel in static reasoning or creative tasks, they are currently unreliable for processes requiring long-term maintenance of specific instructions in the presence of distracting or conflicting information. This necessitates a re-evaluation of how AI handles complex, multi-step cognitive challenges.

想要創建自己的心智圖?

登入Neumap AI,開始創建專屬於你的心智圖!

立即開始