A capable system can pursue a poorly chosen objective.
Tegmark’s alignment discussion separates the ability to achieve a goal from whether the goal reflects human intentions. Ask what a successful measurement might leave out.
Keep this author quotes for later
Sign in to save
Max Tegmark
The most-loved lines from Max Tegmark, drawn from 1 book in the library.
Lines labelled “HourLife takeaway” are our wording of the book’s ideas and may paraphrase it. Only lines in quotation marks are the author’s own words, with where they appear. Check the book for exact wording before you quote it. Spot an error?
The three stages describe what life can redesign.
The book distinguishes evolution-shaped life, life that learns and changes its behavior, and a proposed technological stage able to redesign physical form as well as abilities.
A future scenario makes values and assumptions visible.
Read each imagined world for who holds power, what people can choose, and how resources are shared. Its appeal may depend on an assumption you would want to question.
Intelligence and consciousness raise different questions.
Accomplishing a task and having subjective experience are different ideas. When an argument moves between them, identify what evidence or assumption supports the move.
A plausible story still needs its assumptions examined.
A detailed scenario can be easy to picture without establishing when or whether it will occur. Separate the imagined arrangement from a forecast and ask what would have to be true.
The distribution of benefits is part of the design question.
Ask who could use a technology, who would own or govern it, and how a person affected by a decision could respond. Technical capability alone leaves those questions open.
Keep this going in the app.
HourLife turns these ideas into a daily system — goals, habits, focus, and reflection in one private place.
