Every mathematician has a story that goes something like this. You’re at a party, and someone asks what you do for a living. “I’m a mathematician,” you say. “You must be a genius!” they reply. Or ...
Large language models struggle to solve research-level math questions. It takes a human to assess just how poorly they perform.