Outliers are not outliers because they escaped context. They are outliers because context became unusually useful to them.
Gladwell shifts the question from moral deserving to historical diagnosis. The person still matters, but the conditions around the person finally get counted.