Book Summary · HourLife Original · 2024
The Social Experiment Lab: Summary
You are the most relevant sample size of one. The study was done on someone else.
Key takeaways from The Social Experiment Lab
The ideas readers on HourLife upvote the most, in order.
-
1
You are the most relevant sample size of one. The study was done on someone else.
Population research gives you priors, not conclusions. Your experiment gives you a verdict that no study ever could: how this specific intervention lands in your specific biology, life context, and psychology. That data is irreplaceable.
-
2
A baseline is not prep work. It is the most important data you will collect.
Without knowing where you started, you cannot know where you landed. Seven days of honest measurement — before anything changes — transforms your experiment from anecdote to evidence. Most people skip this step. Don't.
-
3
Compliance rate is your experimental variable. If you did not follow the protocol, you did not run the experiment.
A 70% compliance rate means you spent 30% of the experiment doing something else. The results tell you how your irregular, partial version of the intervention affected you — not whether the original protocol works. Track adherence first.
-
4
Effect size is not a success metric. It is a truth metric.
A small effect size does not mean the experiment failed. It means the intervention has a small effect on you. That is precisely the answer you came for. A clear 'this doesn't move me' is more valuable than a blurry 'might be working.'
-
5
The goal is not to prove the book right. The goal is to know the truth about yourself.
Many people run self-experiments hoping to confirm what they already believe. Honest science requires equal willingness to get a null result. A null result is not failure — it is calibration. You are removing a false belief from your operating system.
-
6
Archive, adopt, or retest — three verdicts that replace 'I should probably do this someday.'
The lab closes when you render a verdict. Archive means: this intervention is real and interesting, but not for you right now. Adopt means: the evidence is strong enough to make this permanent. Retest means: promising signal, different conditions needed.
How to apply The Social Experiment Lab
Turn the ideas into something you can do this week.
Write your hypothesis before you start any experiment
A hypothesis has three parts: the protocol ('I will write three specific things I am grateful for each morning'), the metric ('my end-of-day mood rating on a 1–10 scale'), and the duration ('for 21 consecutive days'). Writing it forces clarity and prevents goalpost-moving after you see the results.
Run a 7-day baseline before changing anything
Measure your target metric daily for one full week without making any behavior changes. This establishes your personal baseline — the most relevant control condition available, because it is your normal. Calculate your average and variance before starting the experimental phase.
Build a compliance log alongside your outcome metric
Each day, record whether you followed the protocol (yes/no or a 0–100% score for partial completion). At the end of the experiment, calculate your overall compliance rate before you analyze results. Results from a 60%-compliance experiment require a different interpretation than results from a 95%-compliance experiment.
Calculate your effect size as a percentage change from baseline
Effect size = ((experiment average – baseline average) / baseline average) × 100. This single number answers 'how much did this move me?' Compare it against the effect-size scale: under 5% is noise, 5–15% is small, 15–35% is medium, 35%+ is strong. Your threshold for adoption should be at least medium.
Render a formal verdict within 72 hours of completing your experiment
Write a one-paragraph verdict covering: your effect size, your compliance rate, and your conclusion (Adopt / Archive / Retest). Date it and file it. Reading your own past experiments one year later is one of the most useful knowledge resources you can build about yourself.
The personal playbook you build from your own experiments is worth more than a thousand books, because it was written in the only laboratory that matters: your life.