Study Finds Obvious Truth Everybody Knows

Researchers at Anthropic published their findings around how AI assistance impacts the formation of coding skills:

We found that using AI assistance led to a statistically significant decrease in mastery […] Using AI sped up the task slightly, but this didn’t reach the threshold of statistical significance.

Wait, what? Let me read that again:

using AI assistance led to a statistically significant decrease in mastery

Ouch.

Honestly, the entire articles reads like those pieces you find on the internet with titles such as “Study Finds Exercise Is Good for Your Health” or “Being Kind to Others Makes People Happier”.

Here’s another headline for you: Study Finds Doing Hard Things Leads to Mastery.

Cognitive effort—and even getting painfully stuck—is likely important for fostering mastery.

We already know this. Do we really need a study for this?

So what are their recommendations? Here’s one:

Managers should think intentionally about how to deploy AI tools at scale

Lol, yeah that’s gonna happen. You know what’s gonna happen instead? What always happens when organizational pressures and incentives are aligned to deskill workers.

Oh wait, they already came to that conclusion in the article:

Given time constraints and organizational pressures, junior developers or other professionals may rely on AI to complete tasks as fast as possible at the cost of skill development

AI is like a creditor: they give you a bunch of money and don’t talk about the trade-offs, just the fact that you’ll be more “rich” after they get involved.

Or maybe a better analogy is Rumpelstilskin: the promise is gold, but beware the hidden cost might be your first-born child.