Multispectral Interlaced Sparse Sampling Photoacoustic

Tomography
 MODIFIED TITLE

Human Head Image reconstruction in PAT using Edge

Detection Technique
 ABSTRACT

Photoacoustic tomography (PAT) of the human brain is challenging due to the fact that
the skull strongly absorbs and scatters light, and attenuates and distorts ultrasound as well.
Photoacoustic tomography (PAT) combines rich optical absorption contrast with the high
spatial resolution of ultrasound at depths in tissue. The image reconstruction problem (or
inverse problem) in photoacoustic tomography is to resolve the initial pressure distribution
from detected ultrasound waves generated within an object due to an illumination by a short
light pulse. Here, c. This approach can produce accurate estimates of the initial pressure
distribution in realistic measurement geometries and that the reliability of these estimates can
be assessed.
 INTRODUCTION

• Photoacoustic tomography is a hybrid imaging method which combines optical contrast and
ultrasound resolution.
• The goal of photoacoustic tomography is to resolve an initial pressure distribution from
detected ultrasound waves generated within an object due to an illumination of a short light
pulse.
• Photoacoustic tomography (PAT), also known as optoacoustic tomography, is a hybrid
imaging modality which combines optical contrast and high spatial resolution of ultrasound
techniques.
 LITERATURE SURVEY
Multispectral opto-acoustic tomography of deep-seated fluorescent proteins in
vivo

Multispectral photoacoustic tomography (PAT) is capable of resolving tissue chromophore

distribution based on spectral un-mixing. It works by identifying the absorption spectrum
variations from a sequence of photoacoustic images acquired at multiple illumination
wavelengths. Due to multispectral acquisition, this inevitably creates a large dataset. To cut
down the data volume, sparse sampling methods that reduce the number of detectors have
been developed. However, image reconstruction of sparse sampling PAT is challenging
because of insufficient angular coverage. During spectral un-mixing, these inaccurate
reconstructions will further amplify imaging artefacts and contaminate the results. 
 Deep learning optoacoustic tomography with sparse data

The rapidly evolving field of optoacoustic (photoacoustic) imaging and tomography is driven by a
constant need for better imaging performance in terms of resolution, speed, sensitivity, depth and
contrast. In practice, data acquisition strategies commonly involve sub-optimal sampling of the
tomographic data, resulting in inevitable performance trade-offs and diminished image quality. We
propose a new framework for efficient recovery of image quality from sparse optoacoustic data
based on a deep convolutional neural network and demonstrate its performance with whole body
mouse imaging in vivo. To generate accurate high-resolution reference images for optimal training, a
full-view tomographic scanner capable of attaining superior cross-sectional image quality from
living mice was devised. When provided with images reconstructed from substantially undersampled
data or limited-view scans, the trained network was capable of enhancing the visibility of arbitrarily
oriented structures and restoring the expected image quality. Notably, the network also eliminated
some reconstruction artefacts present in reference images rendered from densely sampled data. 
 High-Throughput Sparsity-Based Inversion Scheme for Optoacoustic
Tomography

The concept of sparsity is extensively exploited in the fields of data acquisition and image
processing, contributing to better signal-to-noise and spatio-temporal performance of the
various imaging methods. In the field of optoacoustic tomography, the image reconstruction
problem is often characterized by computationally extensive inversion of very large datasets,
for instance when acquiring volumetric multispectral data with high temporal resolution. In
this article we seek to accelerate accurate model-based optoacoustic inversions by identifying
various sources of sparsity in the forward and inverse models as well as in the single- and
multi-frame representation of the projection data. These sources of sparsity are revealed
through appropriate transformations in the signal, model and image domains and are
subsequently exploited for expediting image reconstruction. 
 EXISTING MODEL

• Here, proposed the interlaced sparse sampling (ISS) PAT, a method that utilizes a small
number of transducers to obtain interlaced sparse signal at multiple wavelengths.
• During imaging, the transducer array rotated around the imaged object as the excitation
wavelength changes and photoacoustic signals are acquired from non-overlapping angles.
• Therefore, because the signals acquired at multiple wavelengths are also acquired at different
locations, these signals can be combined to form a dense set of signal that has a higher angular
coverage density.
• From this dense signal, a high quality PAT image can be reconstructed.
BLOCK DIAGRAM
 PROBLEM IDENTIFICATION

• Due to the (non-ideal) highly heterogeneous and wavelength-dependent nature of biological

tissues, images reconstructed from data usually contain artifacts, such as negative values in the
images which otherwise have no physical meaning.
• In addition, high noise levels, limited bandwidth of the detection system, inaccurate
assumptions on the speed of sound, acoustic attenuation, as well as limited view in detection,
can all alter the signals in a way that the reconstructed image accuracy is highly compromised.
 PROJECT OBJECTIVE

• The objective of PAT is to determine an estimate of an object’s spatially variant absorbed

optical energy density from measurements of pressure wave fields that are induced via the
thermoacoustic effect.
• Because the optical absorption characteristics of tissue vary strongly with hemoglobin content,
knowledge of the absorbed optical energy distribution can yield both structural and functional
information.
 MODIFICATION

• Here, Canny Edge detection is proposed to detect the maximum number of real edges, the
proximity of a detected edge to its original position and minimal response (i.e. no false edge
detection due to noise).

• The accuracy of the Canny edge detector is such that it is widely acknowledged as one of the
best edge detection algorithms .

• The proposed approach to segmentation is thresholding, which converts a grayscale image to a

binary image by applying an optimal threshold.

• It is extended into 3D through isosurface contouring.

• Processing is based on the image’s gray values by defining a range, outside of which values
are discarded.

• Hysteresis thresholding uses two threshold values (high and low) which typically improves
connectivity within edges. Any pixel above the high threshold is turned white and considered
to be a strong edge pixel.
BLOCK DIAGRAM
 Image Acquisition
• To deal with images and before analyzing them the most important thing is
to capture the image. This is called as Image Acquisition. Image
Acquisition is achieved by suitable camera (Data sets). 
 Pre-processing
• The aim of pre-processing is an improvement of the image
data that suppresses unwilling distortions or enhances some
image features important for further processing, although
geometric transformations of images.
 Thresholding
• Thresholding is a type of image segmentation, where we
change the pixels of an image to make the image easier to
analyze. In thresholding, we convert an image from color or
grayscale into a binary image.
 Reconstruction
• Image reconstruction is a  process that generates
tomographic images from X-ray projection data acquired at
many different angles around the patient. Image
reconstruction has fundamental impacts on image quality and
therefore on radiation dose.
 Edge Detection
• The Canny edge detector is an edge
detection operator that uses a multi
stage algorithm to detect a wide range
of edges in images.
 REFERENCES

[1] D. Razansky, M. Distel, C. Vinegoni, R. Ma, N. Perrimon, R. W. Köster, and V. Ntziachristos, "Multispectral
opto-acoustic tomography of deep-seated fluorescent proteins in vivo," Nat. Photonics, vol. 3, no. 7, pp.
412-417, 2009.
[2] L. V. Wang and J. Yao, "A practical guide to photoacoustic tomography in the life sciences," Nat. Methods,
vol. 13, no. 8, pp. 627-638, 2016.
[3] L. Ding, X. L. Dean Ben, N. C. Burton, R. W. Sobol, V. Ntziachristos, and D. Razansky, "Constrained
Inversion and Spectral Unmixing in Multispectral Optoacoustic Tomography," IEEE Trans. Med. Imaging,
vol. 36, no. 8, pp. 1676-1685, 2017.

[4] S. Tzoumas, N. Deliolanis, S. Morscher, and V. Ntziachristos, "Unmixing molecular agents from absorbing
tissue in multispectral optoacoustic tomography," IEEE Trans. Med. Imaging, vol. 33, no. 1, pp. 48-60,
2014.

[5] N. C. Burton, M. Patel, S. Morscher, W. H. P. Driessen, J. Claussen, N. Beziere, et al., "Multispectral opto-
acoustic tomography (MSOT) of the brain and glioblastoma characterization," Neuroimage, vol. 65, pp.
522-528, 2013.