Music can be reconstructed from human auditory cortex activity using nonlinear decoding models

Ludovic Bellier, Anaïs Llorens, Déborah Marciano, Aysegul Gunduz, Gerwin Schalk, Peter Brunner, Robert T. Knight

Research output: Contribution to journalArticlepeer-review

25 Scopus citations

Abstract

AU Music: Pleaseconfirmthatallheadinglevelsarerepresentedcorrectly is core to human experience, yet the precise neural dynamics : underlying music perception remain unknown. We analyzed a unique intracranial electroencephalography (iEEG) dataset of 29 patients who listened to a Pink Floyd song and applied a stimulus reconstruction approach previously used in the speech domain. We successfully reconstructed a recognizable song from direct neural recordings and quantified the impact of different factors on decoding accuracy. Combining encoding and decoding analyses, we found a right-hemisphere dominance for music perception with a primary role of the superior temporal gyrus (STG), evidenced a new STG subregion tuned to musical rhythm, and defined an anterior–posterior STG organization exhibiting sustained and onset responses to musical elements. Our findings show the feasibility of applying predictive modeling on short datasets acquired in single patients, paving the way for adding musical elements to brain–computer interface (BCI) applications.

Original languageEnglish
Article numbere3002176
JournalPLoS biology
Volume21
Issue number8 August
DOIs
StatePublished - Aug 2023

Fingerprint

Dive into the research topics of 'Music can be reconstructed from human auditory cortex activity using nonlinear decoding models'. Together they form a unique fingerprint.

Cite this