๐ค AI Summary
To address three key challenges in wrist-based sEMG-driven keyboard-free text inputโpoor cross-user generalization, fragile reliance on high-order features, and absence of bilateral physiological priorsโthis paper proposes SplashNet-mini. The method innovatively encodes hand bilateral symmetry as a structured inductive bias and introduces a Split-and-Share dual-stream Transformer encoder. It integrates rolling temporal normalization, aggressive channel masking, and lightweight spectral dimensionality reduction (33 โ 6 frequency bands). In zero-shot evaluation, character error rate drops to 36.4% (โ31% relative improvement); after user-specific fine-tuning, it further decreases to 5.9% (โ21%). With only one-quarter the parameters and 40% fewer FLOPs compared to baseline models, SplashNet-mini significantly enhances generalization, robustness, and computational efficiency.
๐ Abstract
Surface electromyography (sEMG) at the wrists could enable natural, keyboard-free text entry, yet the state-of-the-art emg2qwerty baseline still misrecognizes $51.8%$ of characters in the zero-shot setting on unseen users and $7.0%$ after user-specific fine-tuning. We trace many of these errors to mismatched cross-user signal statistics, fragile reliance on high-order feature dependencies, and the absence of architectural inductive biases aligned with the bilateral nature of typing. To address these issues, we introduce three simple modifications: (i) Rolling Time Normalization, which adaptively aligns input distributions across users; (ii) Aggressive Channel Masking, which encourages reliance on low-order feature combinations more likely to generalize across users; and (iii) a Split-and-Share encoder that processes each hand independently with weight-shared streams to reflect the bilateral symmetry of the neuromuscular system. Combined with a five-fold reduction in spectral resolution ($33!
ightarrow!6$ frequency bands), these components yield a compact Split-and-Share model, SplashNet-mini, which uses only $ frac14$ the parameters and $0.6 imes$ the FLOPs of the baseline while reducing character-error rate (CER) to $36.4%$ zero-shot and $5.9%$ after fine-tuning. An upscaled variant, SplashNet ($ frac12$ the parameters, $1.15 imes$ the FLOPs of the baseline), further lowers error to $35.7%$ and $5.5%$, representing relative improvements of $31%$ and $21%$ in the zero-shot and fine-tuned settings, respectively. SplashNet therefore establishes a new state of the art without requiring additional data.