Mississippi State University
Gurbuz, Ali Cafer
Ball, John E.
Date of Degree
Dissertation - Open Access
Electrical and Computer Engineering
Doctor of Philosophy (Ph.D)
James Worth Bagley College of Engineering
Department of Electrical and Computer Engineering
Typically, inverse imaging problems deal with the reconstruction of images from the sensor measurements where sensors can take form of any imaging modality like camera, radar, hyperspectral or medical imaging systems. In an ideal scenario, we can reconstruct the images via applying an inversion procedure from these sensors’ measurements, but practical applications have several challenges: the measurement acquisition process is heavily corrupted by the noise, the forward model is not exactly known, and non-linearities or unknown physics of the data acquisition play roles. Hence, perfect inverse function is not exactly known for immaculate image reconstruction. To this end, in this dissertation, I propose an automatic sensing and reconstruction scheme based on deep learning within the compressive sensing (CS) framework to solve the computational imaging problems. Here, I develop a data-driven approach to learn both the measurement matrix and the inverse reconstruction scheme for a given class of signals, such as images. This approach paves the way for end-to-end learning and reconstruction of signals with the aid of cascaded fully connected and multistage convolutional layers with a weighted loss function in an adversarial learning framework. I also propose to extend our analysis to introduce data driven models to directly classify from compressed measurements through joint reconstruction and classification. I develop constrained measurement learning framework and demonstrate higher performance of the proposed approach in the field of typical image reconstruction and hyperspectral image classification tasks. Finally, I also propose a single data driven network that can take and reconstruct images at multiple rates of signal acquisition. In summary, this dissertation proposes novel methods on the data driven measurement acquisition for sparse signal reconstruction and classification, learning measurements for given constraints underlying the requirement of the hardware for different applications, and producing a common data driven platform for learning measurements to reconstruct signals at multiple rates. This dissertation opens the path to the learned sensing systems. The future research can use these proposed data driven approaches as the pivotal factors to accomplish task-specific smart sensors in several real-world applications.
1) National Science Foundation (NSF) under Grant No: 204777 titled ``CAREER: Learning to Sense: Joint Learning of Task Oriented Cognitive Sensing with Data Driven Reconstruction and Inference'', 2) NSF CPS Awards 1931861 titled ``CPS: Small: Collaborative Research: RF Sensing for Sign Language Driven Smart Environments.
Mdrafi, Robiulhossain, "Data-driven sparse computational imaging with deep learning" (2022). Theses and Dissertations. 5458.