Business leaders find AI bias and fairness monitoring "very" or "moderately" difficult 67% of the time, according to Gartner's 2026 AI Governance Survey of 697 AI leaders published this year. The report reveals that traditional auditing frameworks can't keep pace with artificial intelligence systems that produce different answers to identical questions, leaving CIOs unable to defend their AI decision-making when auditors demand explanations. AI agents now score loan applications, assess inventory, and shape financial statements, yet current audit models don't account for the technology's built-in unpredictability.
The governance challenges extend beyond bias monitoring, the survey found. Output accuracy mechanisms ranked as difficult 66% of the time, while responsible AI policy implementation hit 64%. The friction points don't typically originate with the models themselves but emerge when work passes between teams—technology groups understand system operations while finance teams grasp what numbers mean, but no documented connection exists between the two. This creates unclear ownership that undermines oversight and leaves monitoring tools flagging exceptions that go unresolved because no team claims full responsibility.
"There's still a bit of a disconnect on how to audit AI, because AI is moving faster than frameworks are catching up—and auditors like repetition," Lauren Kornutick, a senior director analyst in the analytics and AI group at Gartner, told the publication. The report notes that conventional audit trails track defined activities and assume a human approved each step, but large language models work differently. Prompt logs and model outputs show what entered a system and what emerged, yet they don't reveal the process between input and output or whether results can be trusted. According to Jennifer Kosar, AI assurance leader at PwC US, organizations "should be thinking about how they create and retain that record as the system operates—rather than trying to reconstruct it later."
The problem runs deeper than insufficient effort, the report explains. No established playbook exists for AI audits, unlike cybersecurity and other auditing frameworks built on years of accumulated expertise. Controls specific to AI—drift, bias monitoring, output accuracy—lack that foundation, forcing auditors to squeeze AI into governance, risk, and compliance processes designed for predictable systems. With generative AI, no step-by-step path connects prompt to output, making it impossible to describe how responses form. Organizations can control every input variable and still end up with unpredictable output and unverifiable results. Real-time inference logs cost too much for most companies to deploy universally, so many use continuous monitoring only for highest-risk systems and rely on point-in-time audits for everything else, which lowers visibility and may violate external regulations.
The report recommends that enterprises stop treating auditing as a point-in-time exercise and instead build frameworks around three layers of protection: designing AI systems with risk assessments and controls, periodically reviewing those decisions as risks evolve, and independently assessing whether the first two layers performed correctly. CIOs who can clearly answer four key questions—what data was used, how output was evaluated, who reviewed it, and how it influenced the final decision—are better equipped to support AI-enabled decision-making. The technology presents an opportunity for CIOs to claim ownership of AI governance and move faster with greater confidence, particularly since AI features increasingly appear in enterprise software that business teams already use, making existing controls potentially inadequate without audits to detect problems. Organizations that adopt frameworks linking technology use cases and agent design to process management for validating AI judgment will minimize costly forensic audits and govern AI proactively rather than reactively. The stakes for CIOs have never been clearer, and their involvement will determine whether AI auditing initiatives succeed or collapse under regulatory pressure. Vendors are beginning to fill the gap with tools that track bias, accuracy, and drift, though adoption remains a strategic choice rather than an operational afterthought for leadership willing to treat transparency as competitive advantage rather than compliance burden.

