|
Quick quiz: If you randomly sampled just 5 people from a population of 20,000 or more, could you use that data to tell your stakeholders anything useful? For most data scientists, the answer is probably no. But according to Douglas Hubbard, author of How to Measure Anything, “you need far less data than you think.” Here’s the proof: If you randomly sample just five people from an organisation of any size and record the lowest and highest values of whatever you’re measuring, there’s a 93.75% chance that the true median of the entire organisation falls somewhere between those two numbers. It’s not a trick. It’s statistics. And it’s one of several techniques Doug has spent over 35 years applying to some of the highest-stakes decisions in business and government. In the latest Value Boost episode of Value Driven Data Science, Doug joins me to share more of these techniques, which you can use to support high-stakes decision-making when data is scarce and every observation counts. In just 16 minutes, you’ll learn:
You don’t need more data. You just need to know what to do with what you have. Listen now on Apple Podcasts or Spotify, or click the link below: Episode 110: Why You Need Less Data Than You Think Talk again soon, Dr Genevieve Hayes |
Twice weekly, I share proven strategies to help data scientists get noticed, promoted, and valued. No theory — just practical steps to transform your technical expertise into business impact and the freedom to call your own shots.
“AI destroys jobs but creates businesses.” That one statement crystallised what I’ve long believed about building a data science career. The statement was made by best-selling author and futurist Peter H. Diamandis in a recent post. Diamandis argues that while AI will lead to the destruction of white-collar jobs, as organisations replace human workers with AI, AI has made it easier than ever for entrepreneurs to launch one-person companies. The jobs that AI creates, therefore, won’t look like...
I learned the true meaning of accountability on a Sunday morning, many years ago, when I had to go into the office to fix a calculation mistake made by a member of my team. I was an insurance pricing manager at the time. My team performed premium calculations that brought in $2 billion of revenue. It was complex work, spread across multiple staff, and the margin for error was incredibly low. When my boss spotted an error in a table my team had produced, it was all I could do not to say:...
Machine learning excels at automating routine decisions. But the decisions that matter most are far from routine. The decisions that truly make or break an organisation are the high-stakes, one-off decisions where data is scarce, machine learning falls apart, and executive stakeholders are left relying on their gut. These are also the situations where data scientists have the potential to add the greatest value - if they know how. As a data scientist with a background in actuarial science and...