Now online the largest database of AI-caused incidents

Broken robot

This summer I was one of the lucky few to get a sneak preview of researcher Sean McGregor‘s work on incidents caused by artificial intelligence systems.

Because of a book I’m helping to write (I’ll tell you about it next year) I needed access to a database containing a collection of incidents – understood in a generic way, i.e. failures, errors, aberrant results – caused by artificial intelligence algorithms over the years. Through a number of researchers I came across Sean’s project, who works for the XPRIZE Foundation and Partnership on AI, an organisation set up by the world’s leading technology companies to promote AI development and research.

The AI Incident Database (AIID), now available to all, contains over a thousand articles and references to incidents caused by automated systems, from the ‘flash crash‘ that shocked the markets in 2010 to the killing of a pedestrian by a self-driving car in 2018, from the many facial recognition errors around the world to the multiple ‘rebellions’ of chatbots that refuse to behave as they should.

This work is inspired, as the author explains, by similar databases that already exist in other sectors, such as aviation or cybersecurity, trying to combine their strengths. Obviously, the aim is not to hinder the march (unstoppable) of artificial intelligence, but to help its positive development by highlighting and cataloguing the problems to improve research.

For further information, I recommend the presentation article written by the author: When AI Systems Fail: Introducing the AI Incident Database

The research paper can be found here: Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database

The main page of the database can be found here, but to access the actual database you need to know where to click. For simplicity’s sake here is the direct link.

I am a partner and founder of SNGLR Holding AG, a Swiss group specialising in exponential technologies with offices in Europe, USA and the UAE, where I supervise projects on applied artificial intelligence. I have an Artificial Intelligence Professional certificate from IBM and one on machine learning from Google Cloud. I am a member of several AI industry associations: AAAI, ACM (SIGAI), AIxIA. I participate to the European AI Alliance of the European Commission and I work with the European Defence Agency and the Joint Research Centre.