Reference Materials

    AI risks

    The harms AI systems cause in normal operation: bias, deepfakes, identity fraud, privacy leakage and misalignment. Distinct from adversarial AI attacks.

    An AI risk is a way an AI system can cause harm in normal operation, with nobody attacking it. That makes risk a different subject from AI attacks, where an adversary is deliberately trying to break the system. A model that quietly discriminates against applicants is a risk. A model manipulated through prompt injection is an attack. Most real programs have to handle both.

    This hub covers the harms themselves. For the controls and evidence that management and regulators expect against them, see AI Governance.

    Start here

    Harms to people

    The risks that land on individuals rather than on systems. These are also the ones regulators move on first.

    When the model itself is the risk

    Failure modes that come from how models are built and trained, not from misuse. Deceptive alignment — models that behave under test and differently in deployment — is covered in AI safety, along with how red teaming actually works.

    Data and privacy

    Training data can also be extracted from a deployed model directly — see AI attacks for how that works and why it is a data-protection problem rather than only a technical one.

    Where risk becomes misuse

    The boundary cases, where a capability is turned to harm. Past this line the subject becomes AI attacks.

    Managing the risk

    Naming a risk is the easy half. Assigning an owner, assessing it against a framework and holding evidence an auditor accepts is the work — that is what AI governance covers, and the NIST AI RMF is the usual starting structure. AISGRC provides a free scorecard as a baseline for that work.