Human-In-The-Loop AI: What It Takes To Find The Right Balance

InnovationHuman-In-The-Loop AI: What It Takes To Find The Right BalanceByRyan Johnson,Forbes Councils Member.for Forbes Technology CouncilCOUNCIL POSTExpertise from Forbes Councils members, operated under license. Opinions expressed are those of the author. | Membership (fee-based)May 13, 2026, 06:45am EDTRyan Johnson is the chief product officer at CallRail, an AI-powered lead engagement platform that serves over 225,000 businesses worldwide. getty​Every new wave of technology promises speed, efficiency and cost savings. AI does, too. As an example, for many overloaded companies, it can help triage incoming requests, separating what’s urgent from what can wait.​Still, history has shown that adopting new technology does not guarantee immediate returns. Those lessons are not lost with AI. Despite 88% of organizations citing regular use of AI in McKinsey’s research, less than 20% have seen AI make a tangible impact on enterprise-level EBIT. This dichotomy isn’t new. Prior tech implementations, such as ERPs and CRMs, also had high failure rates. Just like with those implementations, the disconnect with AI often stems from a misunderstanding of how it changes the way a business runs. In the case of AI, one of the most important concepts to understand is how to architect a system that augments rather than replaces human judgment. Human-In-The-Loop AI: The Missing PieceAI typically performs best when tasks are structured, clearly defined and predictable. Its strength lies in analyzing vast datasets within a confined set of rules and providing recommendations based on observed patterns. That’s why it’s effective in generating reports, routing calls or identifying duplicates in a spreadsheet. However, AI falls short when it lacks the context and specificity to be truly intelligent and effective. Without domain or market knowledge that usually resides in a person's mind, the output becomes unreliable. In a business setting, this lack of accuracy can cause negative downs...