|
Root canals and machine learning models have more in common than you think. A few weeks back, I went to the dentist because of a mysterious pain in my jaw. I wasn’t sure what the cause was, but after mentioning it to family and friends, the term “abscess” came up a few times. By the time of my appointment, I was convinced I was going to need a root canal. It took my dentist all of 5 minutes to conclude that the pain was purely muscular and everything would be fine in a week or so. That 5 minute diagnostic check was far more valuable to me than the root canal I expected to need - and at a fraction of the cost. Here’s the thing… Many businesses hire data scientists believing they need fancy ML models to solve their business problems. Yet, fancy ML models are a lot like root canals. Invaluable, if you need one, but if not, you can be setting yourself up for a whole world of pain. How can you tell the difference? By diagnosing your stakeholders’ business problems first. Before jumping into fitting algorithms, ask questions like:
Sometimes the answer is a sophisticated ML model. However, it might be that a cheaper solution, like a set of business rules or even just better communication would suffice. Just like my dentist saved me from an unnecessary (and painful) procedure, the right diagnosis can save your stakeholders from expensive solutions they don’t really need. That’s why the real value lies in the diagnosis, not the cure. Talk again soon, Dr Genevieve Hayes |
Twice weekly, I share proven strategies to help data scientists get noticed, promoted, and valued. No theory — just practical steps to transform your technical expertise into business impact and the freedom to call your own shots.
Most data scientists think the hardest part of experimentation is the statistics. It’s not. It’s telling people their ideas didn’t work. Here’s a reality check about experimentation: Even at companies like Google and Netflix, 70-90% of experiments don’t show positive results. That means if you’re running A/B tests, you’ll be delivering “bad news” far more often than good news. Now imagine being the data scientist who constantly tells people their ideas didn’t work. How long before...
"The show doesn't go on because it's ready; it goes on because it's 11:30." - Lorne Michaels, creator of Saturday Night Live. Data scientists can learn a lot from Saturday Night Live. SNL has a rule: The show goes on at 11:30. Not when it’s perfect. Not when everyone’s happy with it. At 11:30. Many years ago, I was responsible for performing the annual workcover premium rate calculation for the whole of Victoria. It was a calculation of the utmost importance - $2b in revenue depended on it...
For the 4 1/2 years of my PhD, I worked with a de-identified dataset that felt like nothing more than numbers on a page. Cold. Abstract. Disconnected from any real human experience. Each “person” was just a line in an Excel spreadsheet, with an ID in place of a name. When I started my first role in insurance pricing, my mindset initially remained the same. That was until my boss took me along to speak to a policyholder - putting me face-to-face with one of the people my data actually...