PhD Knowledge Not Required: A Reasoning Challenge for Large Language Models

A new benchmark based on NPR Sunday Puzzle Challenge evaluates AI models' reasoning capabilities using general knowledge rather than specialized expertise. OpenAI o1 shows superior performance in this benchmark, while analysis reveals interesting failure patterns in models like DeepSeek R1 and identifies optimal reasoning lengths for different systems.