Makes no sense to me, how would you ever be able to figure out a way to make something safe before it even exists?
Someone who has never built a nuclear reactor most likely could not think of a way to prevent the Chernobyl disaster.
(OK, maybe this is a wrong example as someone who did couldn't do this either, but the point should be clear)
https://intelligence.org/2016/12/28/ai-alignment-why-its-har...
https://news.ycombinator.com/newsguidelines.html
Makes no sense to me, how would you ever be able to figure out a way to make something safe before it even exists?
Someone who has never built a nuclear reactor most likely could not think of a way to prevent the Chernobyl disaster.
(OK, maybe this is a wrong example as someone who did couldn't do this either, but the point should be clear)