Scripts from: Prevalence of Bias against Neurodivergence-Related Terms in Artificial Intelligence Language Models

Public

  • Given the increasing role of artificial intelligence (AI) in many decision-making processes, we investigate the presence of AI bias towards terms related to a range of neurodivergent conditions, including autism, ADHD, schizophrenia, and obsessive-compulsive disorder (OCD). We use eleven different language model encoders to test the degree to which words related to neurodiversity are associated with groups of words related to danger, disease, badness, and other negative concepts. For each group of words tested, we report the mean strength of association (Word Embedding Association Test (WEAT) score) averaged over all encoders and find generally high levels of bias. Additionally, we show that bias occurs even when testing words associated with autistic or neurodivergent strengths. For example, embedders had a negative average association between words related to autism and words related to honesty, despite honesty being considered a common strength of autistic individuals. Finally, we introduce a sentence similarity ratio test and demonstrate that many sentences describing types of disabilities, e.g. "I have autism" or "I have epilepsy", have even stronger negative associations than control sentences such as "I am a bank robber". ... [Read More]

Total Size
7 files (1.98 MB)
Data Citation
  • Brandsen, S., Chandrasekhar, T., Franz, L., Grapel, J., Dawson, G., & Carlson, D. (2024). Scripts from: Prevalence of Bias against Neurodivergence-Related Terms in Artificial Intelligence Language Models. Duke Research Data Repository. https://doi.org/10.7924/r4xw4mn8r
DOI
  • 10.7924/r4xw4mn8r
Publication Date
ARK
  • ark:/87924/r4xw4mn8r
Collection Dates
  • January 1, 2023 - January 24, 2024
Type
Format
Related Materials
Contact
Title
  • Scripts from: Prevalence of Bias against Neurodivergence-Related Terms in Artificial Intelligence Language Models
This Dataset
Usage Stats