Confides: A Visual Analytics Solution for Automated Speech Recognition Analysis and Exploration

Sunwoo Ha, Chaehun Lim, R. Jordan Crouser, Alvitta Ottley

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Confidence scores of automatic speech recognition (ASR) outputs are often inadequately communicated, preventing its seamless integration into analytical workflows. In this paper, we introduce Confides, a visual analytic system developed in collaboration with intelligence analysts to address this issue. Confides aims to aid exploration and post-AI-transcription editing by visually representing the confidence associated with the transcription. We demonstrate how our tool can assist intelligence analysts who use ASR outputs in their analytical and exploratory tasks and how it can help mitigate misinterpretation of crucial information. We also discuss opportunities for improving textual data cleaning and model transparency for human-machine collaboration.

Original languageEnglish
Title of host publicationProceedings - 2024 IEEE Visualization Conference - Short Papers, VIS 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages271-275
Number of pages5
ISBN (Electronic)9798350354850
DOIs
StatePublished - 2024
Event2024 IEEE Visualization and Visual Analytics Conference, VIS 2024 - St. Pete Beach, United States
Duration: Oct 13 2024Oct 18 2024

Publication series

NameProceedings - 2024 IEEE Visualization Conference - Short Papers, VIS 2024

Conference

Conference2024 IEEE Visualization and Visual Analytics Conference, VIS 2024
Country/TerritoryUnited States
CitySt. Pete Beach
Period10/13/2410/18/24

Keywords

  • automatic speech recognition
  • confidence visualization
  • Visual analytics

Fingerprint

Dive into the research topics of 'Confides: A Visual Analytics Solution for Automated Speech Recognition Analysis and Exploration'. Together they form a unique fingerprint.

Cite this