Measuring progress toward AGI: A cognitive framework

Google DeepMind introduces a cognitive taxonomy framework for measuring progress toward AGI, accompanied by a Kaggle hackathon with a $200,000 prize pool.

• •The framework draws on psychology, neuroscience, and cognitive science to identify 10 key cognitive abilities: perception, generation, attention, learning, memory, reasoning, metacognition, executive functions, problem solving, and social cognition.
• •A three-stage evaluation protocol is proposed: testing AI across cognitive tasks, collecting human baselines from a demographically representative sample, and mapping AI performance relative to human performance distribution.
• •The Kaggle hackathon focuses on five cognitive abilities with the largest evaluation gaps: learning, metacognition, attention, executive functions, and social cognition.
• •Participants can use Kaggle's Community Benchmarks platform to build and test evaluations against frontier models.