Three-dimensional imaging through turbid media using deep learning: NIR transillumination imaging of animal bodies

Using near-infrared (NIR) light with 700-1200 nm wavelength, transillumination images of small animals and thin parts of a human body such as a hand or foot can be obtained. They are two-dimensional (2D) images of internal absorbing structures in a turbid medium. A three-dimensional (3D) see-through image is obtainable if one can identify the depth of each part of the structure in the 2D image. Nevertheless, the obtained transillumination images are blurred severely because of the strong scattering in the turbid medium. Moreover, ascertaining the structure depth from a 2D transillumination image is difficult. To overcome these shortcomings, we have developed a new technique using deep learning principles. A fully convolutional network (FCN) was trained with 5,000 training pairs of clear and blurred images. Also, a convolutional neural network (CNN) was trained with 42,000 training pairs of blurred images and corresponding depths in a turbid medium. Numerous training images were provided by the convolution with a point spread function derived from diffusion approximation to the radiative transport equation. The validity of the proposed technique was confirmed through simulation. Experiments demonstrated its applicability. This technique can provide a new tool for the NIR imaging of animal bodies and biometric authentication of a human body.