Don't Blame the AI


I learned the true meaning of accountability on a Sunday morning, many years ago, when I had to go into the office to fix a calculation mistake made by a member of my team.

I was an insurance pricing manager at the time. My team performed premium calculations that brought in $2 billion of revenue. It was complex work, spread across multiple staff, and the margin for error was incredibly low.

When my boss spotted an error in a table my team had produced, it was all I could do not to say: "Don't blame me, she's the one who stuffed up."

But that's not how accountability works. I was the manager, so the error was mine.

And that's how I came to be the one sitting in a stuffy office at 9:30am on a Sunday, to ensure the numbers that went out first thing on Monday could be guaranteed to be correct.

Working with AI is exactly the same.

You can delegate responsibility for a task, but you can never delegate the accountability.

If the AI gets it wrong and your stakeholders act on that AI output, you're the one who has to answer for it. Not the tool.

So, the obvious lesson here is to always check AI outputs.

Yeah, we all get that.

However, here's something most conversations about checking AI outputs miss. Something I learned in the aftermath of that Sunday morning.

I never wanted to have to go into the office on a Sunday ever again, so I built a checklist for reviewing my team's work - but I also built my intuition.

I knew our total premiums should come in at around $2 billion. I could recite our top 10 policyholders by heart.

If a number looked off, or an unfamiliar name appeared in the top 10, I knew immediately that something was wrong - before even reviewing the calculation.

That intuition didn't come from the checklist. The checklist was just the record of what I already knew. It came from deep familiarity with the problem: years of working in the domain, understanding what the numbers meant and knowing what "right" felt like.

This is what I think about when I hear people saying they're reviewing AI-created work.

Because if you don't have that internal alarm bell - if you don't know what a correct answer looks like - how will you know there's something off when AI hands you the wrong answer and calls it done?

The accountability doesn't transfer. Neither does the expertise that makes accountability meaningful.

If you don't have that expertise yet, now is the time to start building it.

Talk again soon,

Dr Genevieve Hayes

Data Science Impact Algorithm

Twice weekly, I share proven strategies to help data scientists get noticed, promoted, and valued. No theory — just practical steps to transform your technical expertise into business impact and the freedom to call your own shots.

Read more from Data Science Impact Algorithm

“AI destroys jobs but creates businesses.” That one statement crystallised what I’ve long believed about building a data science career. The statement was made by best-selling author and futurist Peter H. Diamandis in a recent post. Diamandis argues that while AI will lead to the destruction of white-collar jobs, as organisations replace human workers with AI, AI has made it easier than ever for entrepreneurs to launch one-person companies. The jobs that AI creates, therefore, won’t look like...

Quick quiz: If you randomly sampled just 5 people from a population of 20,000 or more, could you use that data to tell your stakeholders anything useful? For most data scientists, the answer is probably no. But according to Douglas Hubbard, author of How to Measure Anything, “you need far less data than you think.” Here’s the proof: If you randomly sample just five people from an organisation of any size and record the lowest and highest values of whatever you’re measuring, there’s a 93.75%...

Machine learning excels at automating routine decisions. But the decisions that matter most are far from routine. The decisions that truly make or break an organisation are the high-stakes, one-off decisions where data is scarce, machine learning falls apart, and executive stakeholders are left relying on their gut. These are also the situations where data scientists have the potential to add the greatest value - if they know how. As a data scientist with a background in actuarial science and...