AI bias is a systematic skew in what a model predicts or decides, caused by skewed training data or skewed design, so it treats similar people or cases unfairly and consistently.
No jargon, no math
A model learns statistical patterns from its training data, nothing else. If the data under-represents a group or encodes a stereotype, the pattern inherits the skew and repeats it at scale, politely and consistently. The usual hiding places: CV screening trained on a decade of past hires that rarely included certain groups; a fraud filter that learns postcode as a proxy for risk; a demand forecast that ignores your smallest depots because the history did. Proxies are the sneakiest: the model never sees gender or ethnicity, it sees address, school or a career gap, and draws the same line anyway. Then feedback loops lock it in: if the biased system says no, the next dataset holds even fewer examples of yes. You catch bias by testing outputs across groups before deployment (a bias audit), retraining or re-weighting data, routing high-stakes decisions through human review, and re-testing after every model update. The EU AI Act classifies many of these uses as high-risk for exactly this reason.
An AI audit is a structured review of how an organisation actually uses AI: every tool, model and workflow is inventoried, then tested for accuracy, data exposure, cost and compliance, with findings ranked by risk and a remediation plan attached.
ReadModel evaluation is the process of measuring how well a model performs on data it has never seen, using metrics and test sets agreed in advance, before you trust it with real decisions.
ReadThe EU AI Act is the European regulation that sorts AI systems into risk levels: unacceptable practices are banned outright, high-risk systems must meet documentation, data-quality, logging and human-oversight requirements before they can be sold or deployed, and the rest face lighter transparency duties.
Read§ 03
We design and ship AI systems with permissions, logs and human approval. It starts with a 30-minute scoping call.