Veritas: Combining expert opinions without labeled data

Sharath R. Cholleti, Sally A. Goldman, Avrim Blum, David G. Politte, Steven Don

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

11 Scopus citations

Abstract

We consider a variation of the problem of combining expert opinions for the situation in which there is no ground truth to use for training. Even though we don't have labeled data, the goal of this work is quite different from an unsupervised learning problem in which the goal is to cluster the data into different groups. Our work is motivated by the application of segmenting a lung nodule in a computed tomography (CT) scan of the human chest. The lack of a gold standard of truth is a critical problem in medical imaging. A variety of experts, both human and computer algorithms, are available that can mark which voxels are part of a nodule. The question is, how to combine these expert opinions to estimate the unknown ground truth. We present the Veritas algorithm that predicts the underlying label using the knowledge in the expert opinions even without the benefit of any labeled data for training. We evaluate Veritas using artificial data and real CT images to which a synthetic nodule has been added, providing a known ground truth.

Original languageEnglish
Title of host publicationProceedings - 20th IEEE International Conference on Tools with Artificial Intelligence, ICTAI'08
Pages45-52
Number of pages8
DOIs
StatePublished - 2008
Event20th IEEE International Conference on Tools with Artificial Intelligence, ICTAI'08 - Dayton, OH, United States
Duration: Nov 3 2008Nov 5 2008

Publication series

NameProceedings - International Conference on Tools with Artificial Intelligence, ICTAI
Volume1
ISSN (Print)1082-3409

Conference

Conference20th IEEE International Conference on Tools with Artificial Intelligence, ICTAI'08
Country/TerritoryUnited States
CityDayton, OH
Period11/3/0811/5/08

Fingerprint

Dive into the research topics of 'Veritas: Combining expert opinions without labeled data'. Together they form a unique fingerprint.

Cite this