BCI for mobile devices: Time-frequency and representation learning analysis of mobile gesture tasks

dc.contributor.authorYılmaz, Çagatay Murat
dc.contributor.authorUlu, Ahmet
dc.contributor.authorDemirbaş, Gülşah
dc.date.accessioned2026-07-08T08:46:48Z
dc.date.available2026-07-08T08:46:48Z
dc.date.issued2025
dc.departmentAÇÜ, Mühendislik Fakültesi, Bilgisayar Mühendisliği Bölümü
dc.description.abstractMobile devices are central to daily life, yet their interaction remains primarily limited to touch and voice, which may be impractical in restricted mobility scenarios. Brain-computer interfaces (BCIs) offer a promising alternative by enabling device control through neural activity. Although motor imagery (MI) BCIs have been extensively studied, MI signals for mobile-specific gestures remain relatively underexplored. This study addresses this gap by investigating the effectiveness of combining time-frequency transformations with deep learning for classifying MI of mobile gestures. Using the MI-BMPI dataset-comprising EEG recordings of participants imagining tapping and swiping, and among the few publicly available datasets of its kind-we applied Short Time Fourier Transform, Continuous Wavelet Transform, Stockwell Transform, and Hilbert-Huang Transform as inputs to architectures including ResNeSt-50d, HRNet-W18, ConvNeXt-Base, DeiT-Base, Swin Transformer-Tiny, and RegNetX-002. In the classification of tapping and swiping MI tasks, performance across different subjects ranged from 0.61 to 0.947 when averaged over five random seeds, while individual subject models achieved results between 0.708 and 0.975. These promising outcomes are consistent with other evaluation metrics. Overall, this work provides the first systematic evaluation of mobile gesture MI-BCIs, demonstrating that time-frequency representations coupled with deep learning enable robust EEG-based mobile interaction and laying the groundwork for the development of future neuroadaptive technologies.
dc.identifier.doi10.1109/ICSigSys67277.2025.11269155
dc.identifier.endpage33
dc.identifier.isbn979-833158127-5
dc.identifier.scopus2-s2.0-105031435217
dc.identifier.startpage27
dc.identifier.urihttps://hdl.handle.net/11494/6269
dc.indekslendigikaynakScopus
dc.institutionauthorUlu, Ahmet
dc.language.isoen
dc.publisherInstitute of Electrical and Electronics Engineers Inc.
dc.relation.ispartofProceedings of 2025 IEEE International Conference on Signals and Systems, ICSigSys 2025
dc.relation.publicationcategoryKonferans Öğesi - Uluslararası - Kurum Öğretim Elemanı
dc.rightsinfo:eu-repo/semantics/embargoedAccess
dc.subjectBrain-computer interface (BCI)
dc.subjectDeep learning
dc.subjectElectroencephalography (EEG)
dc.subjectHuman-computer interaction (HCI)
dc.subjectMobile gesture
dc.subjectMobile neurofeedback
dc.titleBCI for mobile devices: Time-frequency and representation learning analysis of mobile gesture tasks
dc.typeConference Object

Dosyalar

Orijinal paket
Listeleniyor 1 - 1 / 1
[ X ]
İsim:
6269.pdf
Boyut:
1.02 MB
Biçim:
Adobe Portable Document Format
Lisans paketi
Listeleniyor 1 - 1 / 1
[ X ]
İsim:
license.txt
Boyut:
1.17 KB
Biçim:
Item-specific license agreed upon to submission
Açıklama: