Advertisement
Maths test stumps AI models: which number is bigger, 9.90 or 9.11?
- Large language models, the technology underpinning generative AI services like ChatGPT, struggle with basic maths knowledge
Reading Time:2 minutes
Why you can trust SCMP
2
![Generative artificial intelligence technology does not inherently possess mathematical capabilities. Illustration: Shutterstock](https://cdn.i-scmp.com/sites/default/files/styles/1020x680/public/d8/images/canvas/2024/07/17/1270ef9b-ea25-43ab-ad14-b9319faa75c1_6240a53b.jpg?itok=gWaRHPzQ&v=1721223607)
Wency Chenin Shanghai
The wave of artificial intelligence (AI) chatbots allowed for public use in mainland China enables many users to create new content – including audio, code, images, simulations, videos and grammatically correct text – to entertain and help with everyday tasks.
Advertisement
That demand has led to the local development of more than 200 large language models (LLMs), the technology underpinning generative AI (GenAI) services like ChatGPT. LLMs are deep-learning AI algorithms that can recognise, summarise, translate, predict and generate content using very large data sets.
In spite of such resources behind chatbots, AI models have been proven to struggle with basic maths knowledge this past weekend on the Chinese reality show Singer 2024, a singing competition produced by Hunan Television.
Mainland artist Sun Nan received 13.8 per cent of online votes to edge out US singer Chanté Moore, who received 13.11 per cent of votes. Some local netizens poked fun at the ranking, claiming that the latter number was larger. Ask AI, one commenter suggested. The results they got were mixed.
![](https://assets-v2.i-scmp.com/production/_next/static/media/wheel-on-gray.af4a55f9.gif)
Advertisement