A novel polynomial reconstruction algorithm‐based 1D convolutional neural network used for transfer learning in Raman spectroscopy application

When a convolutional neural network (CNN) model was built, the size and resolution of its input data were fixed. However, Raman spectra collected by different Raman spectrometers usually had different length, intensity range, and wavenumber interval between two adjacent data points, which made the e...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of Raman spectroscopy 2022-02, Vol.53 (2), p.237-246
Hauptverfasser: Shang, Lin‐Wei, Bao, Yi‐Lin, Tang, Jin‐Lan, Ma, Dan‐Ying, Fu, Juan‐Juan, Zhao, Yuan, Wang, Xiao, Yin, Jian‐Hua
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:When a convolutional neural network (CNN) model was built, the size and resolution of its input data were fixed. However, Raman spectra collected by different Raman spectrometers usually had different length, intensity range, and wavenumber interval between two adjacent data points, which made the existing CNN model difficult to be applied to a new Raman spectral data set. Therefore, this paper proposed a polynomial reconstruction algorithm as pretreatment method to obtain reconstructed spectra that would be imported into CNN model with consistent length, intensity range, and wavenumber interval. To test the effectiveness of this method, a big data set with 2563 Raman spectra of 831 minerals and synthetic organic pigments samples was constructed from the RRUFF and SOP database to pretrain a one‐dimensional CNN (1D‐CNN) model. The pretraining results showed that polynomial reconstruction algorithm used as pretreatment method was better than SG smoothing combined spline interpolation algorithm. Then two data sets were collected by different Raman spectrometers for evaluating the transfer learning performance of the trained 1D‐CNN model. Both data sets contained 390 Raman spectra from the same 39 samples of inorganic salts, organic compounds, and amino acids. One was used as calibration data to retrain the 1D‐CNN model, while the other was used as test. Based on data augmentation and 75% calibration data for retraining, the transfer learning performances of 1D‐CNN model were clearly shown in the excellent identification accuracies of 99.58%, 99.32%, and 97.69% for training, validation, and test sets, respectively, which were better than those of K‐nearest neighbor classifier. This paper provides a significant way for the wide application of CNN model in Raman spectroscopy with much more advantages in simplicity and rapidity. A polynomial reconstruction algorithm was developed to standardize the length, intensity range, and wavenumber interval of Raman spectra, so that transfer learning of one‐dimensional convolutional neural network model can be realized among different data sets collected by different Raman spectrometers. The requirement for calibration data and processing methods in transfer learning were further explored. It suggests that the data augmentation and the 75% calibration data are necessary to get satisfactory transfer learning performance in Raman spectroscopy application.
ISSN:0377-0486
1097-4555
DOI:10.1002/jrs.6268