Nearly a third of organisations report that AI is not on the board agenda. Two-thirds say boards still have limited-to-no knowledge or experience with AI. At the same time, AI is already shaping how strategy is executed: approving loans, pricing risk, allocating resources, and influencing decisions at scale.
That is the disconnect.
Boards are accountable for outcomes yet increasingly removed from the systems producing them. And where oversight is absent, delegation quietly becomes abdication.
This gap is not theoretical. It is widening. The Stanford AI Index (2025) shows documented AI incidents rising to 362, up from 233 in 2024, continuing a clear upward trajectory as adoption accelerates. Failure is not slowing down. It is compounding.
The real question facing boards is no longer about AI’s potential to create value; it is whether the organisation retains control over how that value is created, delivered, and sustained at scale.
Consider Australia’s Robodebt scheme. Designed as an automated system to identify welfare overpayments, it operated at scale, issuing debt notices based on income-averaging assumptions embedded within the system. Over time, those outputs were treated as valid by default, with limited interrogation of underlying assumptions and insufficient early challenge.
What followed was not an isolated systems failure but a breakdown in governance – decisions were generated at scale, acted upon with institutional authority, and allowed to persist without effective oversight or escalation until the consequences became unavoidable.
This is the board’s blind spot.
AI is often framed as a tool. In practice, it is a system of decisions embedded into operations. Once deployed, it does not simply support strategy; it executes it.
Which raises a fundamental governance question:
What exactly is the board overseeing?
If oversight remains focused on strategy approval while execution is delegated to systems that are not fully visible, interrogated, or governed, then the board is no longer overseeing outcomes; it is operating at a distance from them.
The shift required is not technical. It is structural. Boards must move from viewing AI as a capability to recognising it as a decision system that must be governed in operation.
This requires a different lens.
First, boards must ensure visibility into how systems behave in the real world. Performance metrics in controlled environments are not enough. Systems must be evaluated based on how they function under real conditions when data shifts, scale increases, and edge cases emerge. Without this, performance is assumed, not understood.
Second, boards must consider the experience of those affected by AI decisions. Outputs may appear accurate internally, but outcomes can still be inconsistent, unfair, or incomprehensible externally. Customer, user, or citizen experience is not peripheral; it is a direct reflection of how the system operates in practice.
Third, boards must demand that systems be defensible under scrutiny. This means decisions can be explained, outcomes can be justified, and controls can be demonstrated. If an organisation cannot stand behind how a system operates when questioned by regulators, customers, or the public, then control is already compromised.
These are not technical requirements. They are governance imperatives. The risk is not that AI makes decisions. It is those decisions that are made without oversight, without challenge, and without accountability at the level required to govern them.
For boards across emerging markets and globally, this moment is defining. AI presents an undeniable opportunity – expanding access, improving efficiency, and enabling growth at scale. But growth without control is not sustainable. It destabilises.
The organisations that will lead are not those that deploy AI most aggressively. They are those that understand, monitor, and govern how their systems behave – consistently, in real-world conditions, and under scrutiny.
Because once AI is making decisions, governance is no longer about what was approved. It is about what is actually happening.
Amaka Ibeji, Founder of DPO Africa Network, is a Boardroom Qualified Technology Expert and Digital Trust Visionary. She advises boards, regulators, and organizations on privacy, AI governance, and data trust, while coaching and fostering leadership across industries. Connect: LinkedIn amakai | [email protected]
Join BusinessDay whatsapp Channel, to stay up to date
Open In Whatsapp
