Parameter-Efficient Adaptation for Computational Imaging

Nebiyou Yismaw, Ulugbek S. Kamilov, M. Salman Asif

Research output: Contribution to journalConference articlepeer-review

Abstract

Deep learning-based methods provide remarkable performance in a number of computational imaging problems. Examples include end-to-end trained networks that map measurements to unknown signals, plug-and-play (PnP) methods that use pretrained denoisers as image prior, and model-based unrolled networks that train artifact removal blocks. Many of these methods lack robustness and fail to generalize with distribution shifts in data, measurements, and noise. In this paper, we present a simple framework to perform domain adaptation as data and measurement distribution shifts. Our method learns a small number of factors to add in a pretrained model to bridge the gap in performance. We present a number of experiments on accelerated magnetic resonance imaging (MRI) reconstruction and image deblurring to demonstrate that our method requires a small amount of memory and parameter overhead to adapt to new domains.

Original languageEnglish
Pages (from-to)13051-13055
Number of pages5
JournalICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
DOIs
StatePublished - 2024
Event2024 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2024 - Seoul, Korea, Republic of
Duration: Apr 14 2024Apr 19 2024

Fingerprint

Dive into the research topics of 'Parameter-Efficient Adaptation for Computational Imaging'. Together they form a unique fingerprint.

Cite this