IS THE DEFAULT OUTCOME DOOM? Chapter 8 Is the default outcome doom? We found the link between intelligence and final values to be extremely loose. We also found an ominous convergence in instrumental values. For weak agents, these things do not matter muc
education
Description
IS THE DEFAULT OUTCOME DOOM? Chapter 8 Is the default outcome doom? We found the link between intelligence and final values to be extremely loose. We also found an ominous convergence in instrumental values. For weak agents, these things do not matter much because weak agents are easy to control and can do little damage. But in Chapter 6 we argued that the first superintelligence might well get a decisive strategic advantage. Its goals would then determine how humanity’s cosmic endowment will be used. Now we can begin to see how menacing this prospect is.
