This article was brought to you by Must Share Good Things. Check us out and follow us on our Tiktok, Facebook, Instagram or Telegram for more content!
–
In January 2023, ChatGPT crossed 100 million users, making it the fastest-growing consumer application in a short period of time. However, one question that seems to be prominent would be ” how intelligent is this AI chatbot?”
During an experiment in February, ChatGPT was asked by the Singaporean news outlet The Straits Times to answer questions from the Primary School Leaving Exam(PSLE) paper. PSLE is an exam that all 12-year-olds in Singapore must take, and determines which secondary school or academic stream they will enter.
ChatGPT was given questions from the PSLE’s the year 2020- 2022 papers on Mathematics, Science, and English.
The scores definitely astonishes many individuals when ChatGPT scored an average of 16 out of 100 marks for the three mathematics papers it took. ChatGPT fared a little better at the science papers, getting an average of 21 out of 100 marks. The chatbot managed to pass the English tests and scored an average of 11 out of 20 marks across the three papers it took.
Reaction towards the results:
A linkedin post by Yuanto Kusnadi ( Associate Professor of Accounting ) on 20 February, he stated :
These non-structured questions/jobs are the ones that are typically cannot be handled by AI as what I explained to my SMU Accounting Masters Online Data Camp on Digital Transformation & Financial Analytics using Python. I am glad it continues to be so and reemphasizes the role that human judgement in decision making process, which cannot totally be replaced by AI or robots!
Kusnadi’s post on the forum had conflicting comments regarding the PSLE papers.
As seen in the image above, a user that goes by Alydandra Toh mentioned that PSLE papers tend to be illogical. While Kusnadi replied that it could be due to the difficulty training an AI bot mathematical models.
Another user ‘Ryan Chua’ then begin stating that it was a fault on both end. ChatGPT has no concept of truth therefore resulting in their strange inputs. He also mentioned that a higher level of accuracy needed for a question , the worse the bot will fare.
In conclusion, with a low average IQ, the chatbot definitely lack logical reasoning. Its ability to understand context is limited. Hence, the model fails to answer questions that any human mostly can. As for now, the reach of ChatGPT is very limited by computing power, however, once this is ramped up, the opportunities and potential dangers will grow exponentially. And much like the ever imminent arrival of self-driving cars that never quite happens, experts disagree on whether that is a question of months or years.
–
Since you have made it to the end of the article, follow Wake Up Singapore on Telegram!
