Digital Fingerprinting of Complex Liquids Using a Reconfigurable Multi‐Sensor System with Foundation Models

Combining chemical sensor arrays with machine learning enables designing intelligent systems to perform complex sensing tasks and unveil properties that are not directly accessible through conventional analytical chemistry. However, personalized and portable sensor systems are typically unsuitable f...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Advanced science 2024-11, Vol.11 (44), p.e2407513-n/a
Hauptverfasser: Gabrieli, Gianmarco, Manica, Matteo, Cadow‐Gossweiler, Joris, Ruch, Patrick W.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Combining chemical sensor arrays with machine learning enables designing intelligent systems to perform complex sensing tasks and unveil properties that are not directly accessible through conventional analytical chemistry. However, personalized and portable sensor systems are typically unsuitable for the generation of extensive data sets, thereby limiting the ability to train large models in the chemical sensing realm. Foundation models have demonstrated unprecedented zero‐shot learning capabilities on various data structures and modalities, in particular for language and vision. Transfer learning from such models is explored by providing a framework to create effective data representations for chemical sensors and ultimately describe a novel, generalizable approach for AI‐assisted chemical sensing. The translation of signals produced by remarkably simple and portable multi‐sensor systems into visual fingerprints of liquid samples under test is demonstrated, and it is illustrated that how a pipeline incorporating pretrained vision models yields >95%$>95\%$ average classification accuracy in four unrelated chemical sensing tasks with limited domain‐specific training measurements. This approach matches or outperforms expert‐curated sensor signal features, thereby providing a generalization of data processing for ultimate ease‐of‐use and broad applicability to enable interpretation of multi‐signal outputs for generic sensing applications. Translating signals produced by portable multi‐sensor systems into image representations enables the generation of visual fingerprints of liquid samples under test. A transfer learning pipeline incorporating vision foundation models pretrained on natural images yields >95% average classification accuracy when applied to visual chemical sensor fingerprints in four unrelated sensing tasks with limited domain‐specific training measurements.
ISSN:2198-3844
2198-3844
DOI:10.1002/advs.202407513