AI Incident
A failure of an AI tool in use, such as an assistant sending wrong information to a client or surfacing something it should not. Who is told, and in what order, should be agreed before it happens rather than worked out under pressure.
What it means in practice
The ownership article gives the example of an assistant that sends wrong information to a client, or surfaces something it should not. Its point is that unowned AI rarely fails loudly, and incidents end up with no reporting route. For a deployer of a high-risk system, the article says the EU AI Act adds a duty to inform the provider and the authorities of a serious incident. The running cost article counts incident response as part of governance, and says governance is cheaper to design in than to bolt on after an incident.
How we use it
The ownership article’s thirty day plan ends by setting the route: agree who is told, and in what order, before anything goes wrong. The all-staff briefing on responsible and compliant use covers how to report an incident, and the banning article explains why reporting only works when it is safe.
FAQ
Questions about AI Incident
What should happen when an AI Tool gets something wrong?
The ownership article says the route should be agreed before anything goes wrong: who is told, and in what order. Without it, the questions of who hears first and whether the event is reportable start from nothing, under pressure. The article also says the tool's owner needs the authority to pause it.
Why does a ban on AI Tools make incidents harder to catch?
The banning article says that when use is prohibited, nobody says when it goes wrong, because the honest report becomes the riskiest thing an employee can do. Incident reporting only works when reporting is safe. That is how a small mistake becomes a serious one.
What it means for a Business
The site's ownership article lists incidents with no reporting route as one of the slow failures of AI that nobody owns. It also says that under the EU AI Act a business deploying a high-risk system must inform the provider and the authorities of a serious incident.
Ready to Put This to Work?
Tell us where your team is with AI and we will tell you honestly what would make the biggest difference.