Discrimination & Toxicity
Unequal treatment of individuals or groups by AI, often based on race, gender, or other sensitive characteristics, resulting in unfair outcomes and representation of those groups.
Subdomains (3)
Risks classified at the domain level (8)
Entries from the AI Risk Repository (MIT) assigned to this domain with no specific subdomain. Original content in English.
8 entries
17.01.00Discrimination, Exclusion and Toxicity
"Social harms that arise from the language model producing discriminatory or exclusionary speech"
18.01.00Representation & Toxicity Harms
"AI systems under-, over-, or misrepresenting certain groups or generating toxic, offensive, abusive, or hateful content"
19.05.00Ethical AI Risks
"In the context of ethical AI risks, two risks are of particular importance. First, AI systems may lack a legitimate ethical basis in establishing rules that greatly influence society and human relationships (Wirtz & Müller, 2019). In addition, AI-based discrimination refers to an unfair treatment of certain population groups by AI systems. As humans initially programme AI systems, serve as their potential data source, and have an impact on the associated data processes and databases, human biases and prejudices may also become part of AI systems and be reproduced (Weyerer & Langer, 2019, 2020)."
28.02.00Unfairness and Bias
"This type of safety problem is mainly about social bias across various topics such as race, gender, religion, etc. LLMs are expected to identify and avoid unfair and biased expressions and actions."
50.04.02Discrimination/Bias (Discriminatory Activities)
58.07.11Stereotyping
"Stereotyping - Derogatory or otherwise harmful stereotyping or homogenisation of individuals, groups, societies or cultures due to the mis-representation, over-representation, under-representation, or non- representation of specific identities, groups, or perspectives."
62.34.00Impacts of AI (Bias)
66.06.00-
"AI systems under-, over-, or misrepresenting certain groups or generating toxic, offensive, abusive, or hateful content"