AI’s abilities form a jagged frontier, so how it does on one task tells you little about the next.
The line between what AI does well and what it does badly is uneven, and tasks that feel equally hard to us can land on opposite sides of it. Mollick describes a study with Boston Consulting Group consultants: on tasks inside the frontier, those using GPT-4 did better work, and on a task chosen to sit just outside it, they did worse than colleagues working without it.