A way to consider the reach of AI.
Stephen Fry Explains Why Artificial Intelligence Has a “70% Risk of Killing Us All”
Steven Fry seems to have his doubts about certain big-tech projects in the works today: take the “$100 billion plan with a 70 percent risk of killing us all” described in the video above.
This plan, of course, has to do with artificial intelligence in general, and “the logical AI subgoals to survive, deceive, and gain power” in particular. Even in this relatively early stage of development, we’ve witnessed AI systems that seem to be altogether too good at their jobs, to the point of engaging in what would count as deceptive and unethical behavior were the subject a human being. (Fry cites the example of a stock market-investing AI that engaged in insider trading, then lied about having done so.) What’s more, “as AI agents take on more complex tasks, they create strategies and subgoals which we can’t see, because they’re hidden among billions of parameters,” and quasi-evolutionary “selection pressures also cause AI to evade safety measures.”
Today's quote:
