I got generative AI to attempt an undergraduate law exam. It struggled with complex questions

Wed, 23 Oct 2024 11:37:04 +1100

Andrew Pam <xanni [at] glasswings.com.au>

Andrew Pam
<https://theconversation.com/i-got-generative-ai-to-attempt-an-undergraduate-law-exam-it-struggled-with-complex-questions-240021>

"It’s been nearly two years since generative artificial intelligence was made
widely available to the public. Some models showed great promise by passing
academic and professional exams.

For instance, GPT-4 scored higher than 90% of the United States bar exam test
takers. These successes led to concerns AI systems might also breeze through
university-level assessments. However, my recent study paints a different
picture, showing it isn’t quite the academic powerhouse some might think it
is."

Cheers,
       *** Xanni ***
--
mailto:xanni@xanadu.net               Andrew Pam
http://xanadu.com.au/                 Chief Scientist, Xanadu
https://glasswings.com.au/            Partner, Glass Wings
https://sericyb.com.au/               Manager, Serious Cybernetics

Comment via email

Home E-Mail Sponsors Index Search About Us