Performance Disparities between Accents in Automatic Speech Recognition

Alex DiChristofano; Henry Shuster; Shefali Chandra; Neal Patwari

doi:10.1609/aaai.v37i13.26960

Performance Disparities between Accents in Automatic Speech Recognition

Alex DiChristofano
, Henry Shuster
, Shefali Chandra
, Neal Patwari

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

6 Scopus citations

Abstract

In this work, we expand the discussion of bias in Automatic Speech Recognition (ASR) through a large-scale audit. Using a large and global data set of speech, we perform an audit of some of the most popular English ASR services. We show that, even when controlling for multiple linguistic covariates, ASR service performance has a statistically significant relationship to the political alignment of the speaker's birth country with respect to the United States' geopolitical power.

Original language	English
Title of host publication	AAAI-23 Special Programs, IAAI-23, EAAI-23, Student Papers and Demonstrations
Editors	Brian Williams, Yiling Chen, Jennifer Neville
Publisher	AAAI press
Pages	16200-16201
Number of pages	2
ISBN (Electronic)	9781577358800
DOIs	https://doi.org/10.1609/aaai.v37i13.26960
State	Published - Jun 27 2023
Event	37th AAAI Conference on Artificial Intelligence, AAAI 2023 - Washington, United States Duration: Feb 7 2023 → Feb 14 2023

Publication series

Name	Proceedings of the 37th AAAI Conference on Artificial Intelligence, AAAI 2023
Volume	37

Conference

Conference	37th AAAI Conference on Artificial Intelligence, AAAI 2023
Country/Territory	United States
City	Washington
Period	02/7/23 → 02/14/23

Access to Document

10.1609/aaai.v37i13.26960

Cite this

DiChristofano, A., Shuster, H., Chandra, S., & Patwari, N. (2023). Performance Disparities between Accents in Automatic Speech Recognition. In B. Williams, Y. Chen, & J. Neville (Eds.), AAAI-23 Special Programs, IAAI-23, EAAI-23, Student Papers and Demonstrations (pp. 16200-16201). (Proceedings of the 37th AAAI Conference on Artificial Intelligence, AAAI 2023; Vol. 37). AAAI press. https://doi.org/10.1609/aaai.v37i13.26960

DiChristofano, Alex ; Shuster, Henry ; Chandra, Shefali et al. / Performance Disparities between Accents in Automatic Speech Recognition. AAAI-23 Special Programs, IAAI-23, EAAI-23, Student Papers and Demonstrations. editor / Brian Williams ; Yiling Chen ; Jennifer Neville. AAAI press, 2023. pp. 16200-16201 (Proceedings of the 37th AAAI Conference on Artificial Intelligence, AAAI 2023).

@inproceedings{761d1c0a09434786aca83a302da7a196,

title = "Performance Disparities between Accents in Automatic Speech Recognition",

abstract = "In this work, we expand the discussion of bias in Automatic Speech Recognition (ASR) through a large-scale audit. Using a large and global data set of speech, we perform an audit of some of the most popular English ASR services. We show that, even when controlling for multiple linguistic covariates, ASR service performance has a statistically significant relationship to the political alignment of the speaker's birth country with respect to the United States' geopolitical power.",

author = "Alex DiChristofano and Henry Shuster and Shefali Chandra and Neal Patwari",

note = "Publisher Copyright: Copyright {\textcopyright} 2023, Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved.; 37th AAAI Conference on Artificial Intelligence, AAAI 2023 ; Conference date: 07-02-2023 Through 14-02-2023",

year = "2023",

month = jun,

day = "27",

doi = "10.1609/aaai.v37i13.26960",

language = "English",

series = "Proceedings of the 37th AAAI Conference on Artificial Intelligence, AAAI 2023",

publisher = "AAAI press",

pages = "16200--16201",

editor = "Brian Williams and Yiling Chen and Jennifer Neville",

booktitle = "AAAI-23 Special Programs, IAAI-23, EAAI-23, Student Papers and Demonstrations",

}

DiChristofano, A, Shuster, H, Chandra, S & Patwari, N 2023, Performance Disparities between Accents in Automatic Speech Recognition. in B Williams, Y Chen & J Neville (eds), AAAI-23 Special Programs, IAAI-23, EAAI-23, Student Papers and Demonstrations. Proceedings of the 37th AAAI Conference on Artificial Intelligence, AAAI 2023, vol. 37, AAAI press, pp. 16200-16201, 37th AAAI Conference on Artificial Intelligence, AAAI 2023, Washington, United States, 02/7/23. https://doi.org/10.1609/aaai.v37i13.26960

Performance Disparities between Accents in Automatic Speech Recognition. / DiChristofano, Alex; Shuster, Henry; Chandra, Shefali et al.
AAAI-23 Special Programs, IAAI-23, EAAI-23, Student Papers and Demonstrations. ed. / Brian Williams; Yiling Chen; Jennifer Neville. AAAI press, 2023. p. 16200-16201 (Proceedings of the 37th AAAI Conference on Artificial Intelligence, AAAI 2023; Vol. 37).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Performance Disparities between Accents in Automatic Speech Recognition

AU - DiChristofano, Alex

AU - Shuster, Henry

AU - Chandra, Shefali

AU - Patwari, Neal

PY - 2023/6/27

Y1 - 2023/6/27

N2 - In this work, we expand the discussion of bias in Automatic Speech Recognition (ASR) through a large-scale audit. Using a large and global data set of speech, we perform an audit of some of the most popular English ASR services. We show that, even when controlling for multiple linguistic covariates, ASR service performance has a statistically significant relationship to the political alignment of the speaker's birth country with respect to the United States' geopolitical power.

AB - In this work, we expand the discussion of bias in Automatic Speech Recognition (ASR) through a large-scale audit. Using a large and global data set of speech, we perform an audit of some of the most popular English ASR services. We show that, even when controlling for multiple linguistic covariates, ASR service performance has a statistically significant relationship to the political alignment of the speaker's birth country with respect to the United States' geopolitical power.

UR - https://www.scopus.com/pages/publications/85168234899

U2 - 10.1609/aaai.v37i13.26960

DO - 10.1609/aaai.v37i13.26960

M3 - Conference contribution

AN - SCOPUS:85168234899

T3 - Proceedings of the 37th AAAI Conference on Artificial Intelligence, AAAI 2023

SP - 16200

EP - 16201

BT - AAAI-23 Special Programs, IAAI-23, EAAI-23, Student Papers and Demonstrations

A2 - Williams, Brian

A2 - Chen, Yiling

A2 - Neville, Jennifer

PB - AAAI press

T2 - 37th AAAI Conference on Artificial Intelligence, AAAI 2023

Y2 - 7 February 2023 through 14 February 2023

ER -

DiChristofano A, Shuster H, Chandra S, Patwari N. Performance Disparities between Accents in Automatic Speech Recognition. In Williams B, Chen Y, Neville J, editors, AAAI-23 Special Programs, IAAI-23, EAAI-23, Student Papers and Demonstrations. AAAI press. 2023. p. 16200-16201. (Proceedings of the 37th AAAI Conference on Artificial Intelligence, AAAI 2023). doi: 10.1609/aaai.v37i13.26960

Performance Disparities between Accents in Automatic Speech Recognition

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this