Photo by Don Mr on Pexels

The rapid advancement of AI models like Grok 4 and Gemini 3 on standard benchmarks like ARC-AGI and HLE is prompting a critical re-evaluation of what these tests actually measure. While AI is mastering these established assessments, some experts are debating whether such performance translates to genuine intelligence, including the ability to conduct original research and demonstrate profound understanding. Demis Hassabis’s recent AGI timeline prediction of 5-10 years, coupled with his assertion that AGI shouldn’t be benchmarked against a “PhD level” of proficiency, has intensified the discussion. This debate gained traction on platforms like Reddit’s r/artificial intelligence forum, where users are questioning the efficacy of current benchmarks as true indicators of Artificial General Intelligence. The original Reddit post sparking the debate can be found here: [https://old.reddit.com/r/artificial/comments/1paa4sf/is_humanitys_last_exam_a_benchmark_that_measures/]