<
https://theconversation.com/the-decades-old-ai-alignment-problem-has-finally-become-a-reality-solving-it-wont-be-easy-289812>
"Human beings have long told versions of the same warning: be careful what you
wish for.
In Greek mythology, King Midas got exactly what he asked for, but at the cost
of everything else he valued. In the famous story of
The Monkey’s Paw, a
man’s wishes are granted through terrible and unforeseen routes.
These stories feel newly relevant with the rise of artificial intelligence (AI)
agents: systems to which we can give a goal, then leave it to work out how to
get there.
As AI systems become more autonomous, they are coming to resemble wish-granting
genies: finding routes and using methods we did not imagine from incomplete
instructions.
This problem, known as AI alignment, was foreseen in theory as early as 1960.
It has hovered in the background of AI research ever since – but as recent
events have shown, the alignment problem is now both real and urgent."
Cheers,
*** Xanni ***
--
mailto:xanni@xanadu.net Andrew Pam
http://xanadu.com.au/ Chief Scientist, Xanadu
https://glasswings.com.au/ Partner, Glass Wings
https://sericyb.com.au/ Manager, Serious Cybernetics
