OpenAI Researchers Find That Even the Best AI Is "Unable To Solve the Majority" of Coding Problems

OpenAI researchers found that advanced AI models, including GPT-4 and Claude 3.5, still fail to solve most coding tasks when tested against real-world software engineering challenges. While AI models can work quickly on surface-level issues, they struggle with understanding bug context and providing comprehensive solutions, performing significantly worse than human engineers.