Many of the people racing to build AGI believed it could be dangerous, and they kept building it.
This is the puzzle at the centre of the book. Some builders hoped the technology would cure diseases, some feared a catastrophe, and plenty held both views at once. Roose's reporting tries to explain how people who took the risk seriously still ended up speeding the race along.