“The USA Math Olympiad is an extremely challenging math competition for the top US high school students… Hours after it was completed…a team of scientists gave the problems to some of the top large language models, whose mathematical and reasoning abilities have been loudly proclaimed… The results were dismal: None of the AIs scored higher than 5% overall”
—Ernest Davis & Gary Marcus, Reports of LLMs mastering math have been greatly exaggerated
https://garymarcus.substack.com/p/reports-of-llms-mastering-math-have
#mathematics #llms #llm #ai