The Fatal Flaw of AI Implementation

There is no question that artificial intelligence (AI) is presenting huge opportunities for companies to automate business processes. However, as you prepare to insert machine learning applications into your business processes, I’d recommend that you not fantasize about how a computer that can win at Go or poker can surely help you win in the marketplace. A better reference point will be your experience implementing your enterprise resource planning (ERP) or another enterprise system. Yes, effective ERP implementations enhanced the competitiveness of many companies, but a greater number of companies found the experience more of a nightmare. The promised opportunity never came to fruition.

Why am I raining on the AI parade? Because, as with enterprise systems, AI inserted into businesses drives value by improving processes through automation. But eventually, the outputs of most automated processes require people to do something. As most managers have learned the hard way, computers can process data just fine, but that processing isn’t worth much if people are feeding them bad data in the first place or don’t know what to do with information or analysis once it’s provided.

With Cynthia Beath, Monideepa Tarafdar, and Kate Moloney, I’ve been studying how companies insert value-adding AI algorithms into their processes. As other researchers and practitioners have observed, we are finding that most machine learning applications augment, rather than replace, human efforts. In doing so, they demand changes in what people are doing. And in the case of AI — even more than was true with ERPs — those changes eliminate many nonspecialized tasks and create skilled tasks that require good judgment and domain expertise.

For example, fraud detection applications will reduce the time that people spend looking for anomalies, but increase requirements for deciding what to do about those anomalies. An AI application might allow financial analysts to spend less time extracting data on financial performance, but it adds value only if someone spends more time considering the implications of that performance. Augmented with AI applications, customer service staff can spend fewer hours resolving routine problems, but they are more likely to improve the company if at least some of that saved time is reallocated to better understanding the problems customers are experiencing with the company’s most recent offerings.

Many leaders suspect that they will generate value from AI by recruiting more data scientists. Of course, there’s a shortage of data scientists — and some of them are more attracted to the challenge of building an application that wins at poker than solving a business need. Others will be inspired to find a cure for cancer or to stop global warming. So financial services and insurance companies attempting to uncover fraud and tech companies hoping to improve customer satisfaction will be fighting over the remaining talent.

But securing data scientists is not your biggest challenge. Data scientists can develop useful algorithms, but domain experts are needed to help train the machine to recognize important patterns and understand new data. Domain experts include top analysts, contract managers, salespeople, recruiters, and other specialists who are not only experts at their jobs but who are acutely aware of how they deliver excellence. That may involve just a few key people for a given application, but they’d better be good. And we still haven’t gotten to the really hard part!

Ultimately, you need people who can use probabilistic output to guide actions that make your company more effective. Probabilistic outputs are no problem when Inc.’s AI tool Einstein indicates that one lead has a 95% chance of converting into a sale, while another has a 60% chance. The salesperson knows what to do with that information. But when a recruiter learns from an AI application that a job candidate has a 50% likelihood of being a good fit for a particular opening, what’s the next step?

Source From: MITSloan Management Review