Flexible touch and gesture recognition system for curved surfaces with machine learning for assistive applications
•A flexible touch and gesture sensing patch was developed using a multi-element, screen-printed strain sensing patch integrated with a foam layer, capable of detecting both touch and bending on flat and curved surfaces.•The patch achieved pressure sensitivity of 0.827 kPa⁻¹ and a strain sensitivity...
Gespeichert in:
Veröffentlicht in: | Sensors and actuators reports 2025-06, Vol.9, p.100284, Article 100284 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | •A flexible touch and gesture sensing patch was developed using a multi-element, screen-printed strain sensing patch integrated with a foam layer, capable of detecting both touch and bending on flat and curved surfaces.•The patch achieved pressure sensitivity of 0.827 kPa⁻¹ and a strain sensitivity of 53.42/με, with minimal performance drift (∼1.3 %) after 1000 touch cycles.•An ML based gesture recognition system was developed using SVM for high accuracy (93 %) and real-time compatibility, that could distinguish taps, swipes, and touch locations.•The patch was seamlessly integrated with a virtual keypad to demonstrate its potential for assistive technology with an intuitive interface for individuals with limited mobility and speech.
Touch is a fundamental mode of human-machine interaction and ability to monitor tactile pressure, recognize gestures and location of touch are crucial for touch-based technologies. However, achieving reliable touch sensing on curved surfaces remains challenging as flexing often disrupts the stability of sensor outputs and diminishes sensitivity, especially in dynamic environments. This study presents the development of a flexible multi-element touch sensing patch that can monitor its bending state as well as detect pressure with a sensitivity of 0.827 kPa−1. The patch is fabricated using resistive strain sensors, screen printed onto a PET sheet with a foam backing. Evaluation electronics were integrated to ensure stable, noise-free signal acquisition, and output was processed with machine learning (ML) algorithms to classify gestures such as single and double finger taps, swipes, and touch locations, with 93 % accuracy, on both flat and curved surfaces. Based on the identified gesture, the system enables users to type text or control external devices with minimal physical effort. Its scalable fabrication, high sensitivity, mechanical resilience and seamless ML integration establishes it as a powerful and efficient tool for assistive technologies, designed to support individuals with limited speech and mobility, such as those with quadriplegia or paralysis.
[Display omitted] |
---|---|
ISSN: | 2666-0539 2666-0539 |
DOI: | 10.1016/j.snr.2025.100284 |