Engineering Touchscreen Input for 3-Way Displays: Taxonomy, Datasets, and Classification

Engineering Touchscreen Input for 3-Way Displays: Taxonomy, Datasets, and Classification

• 1.
  Engineering Touchscreen Inputfor 3-Way Displays: Taxonomy, Datasets, and Classification Jean Vanderdonckt, Radu-Daniel Vatavu, Arthur Sluÿters
• 2.
  Engineering Touchscreen Inputfor 3-Way Displays: Taxonomy, Datasets, and Classification Jean Vanderdonckt LouRIM Université catholique de Louvain, Belgium Radu-Daniel Vatavu Machine Intelligence & Information Visualization Lab Stefan cel Mare University of Suceava, Romania Arthur Sluÿters LouRIM Université catholique de Louvain, Belgium
• 4.
  Introduction and Motivation •The 3-way screen used in our study
• 5.
  5 • Cross-device taxonomy:for GUIs only Source: https://dl.acm.org/doi/10.1145/3290605.3300792
• 6.
  6 • Revisiting thistaxonomy for gesture UIs Cross-device | Multi-device | Distributed Cross-display | Multi-display Multi-mobile 2-way MDEs Multi-monitor/screen Multi-slate/tablet Multi-display environment Cross-surface | Multi-surface | Trans-surface a b c d e Flipping gestures [45] Pull gestures [22] Across screens [22] Between screens [22] 3-way MDEs This paper Spatially-aware gestures [5,23] Spatially-agnostic gestures [23] Shortcut gestures [21] Motion gestures [26] Surface gestures [18,43] Spherical Gestures [33] Data-sharing gestures [6], Synchronous gestures [9,24], Connection gestures [12,14], Data transfer gestures [13], Auxiliary display [22], Cross-device Drag & Drop [31] Multi-touch [7], Swipe-hand open [22], Pick & Drop [25], Prevalent gestures [28], Multi-surface gestures [29] withi n across level of distribution Stitching gestures [10] Dexterous gestures [46] Object movement gestures [17], Cooperative gestures [17]
• 7.
  • Second gestureelicitation study .388 .344 .301 .250 .232 .225 .185 .170 .159 .159 .141 .141 .130 .130 .127 .127 .109 .109 .105 .101 .101 .094 .083 .080 .177 .155 .166 0 .1 .2 .3 .4 .5 Move file across Move file within Collect files within Switch files within Permute files across Dock file within Permute files within Dock file across Collect files across Split files across Duplicate file within Merge files within Switch files across Split files within Open file within Broadcast file across Duplicate file across Delete file across Broadcast file within Close file across Merge files across Delete file within Close file within Open file across Overall within Overall across Overall Referent (r) Agreement Rate AR(r) in [0..1] * Low Medium agreement High Staircase Tap Heartbeat Cross Curve Circular arrow Circle Curly staircase Zoom in Star Swap Letter “L” Letter “V” Double swap expanding Spread swap expanding Star Like a tie Zigzag Star Letter “U” Circle Greek letter “alpha” Curly line Check mark Consensus gesture set
• 8.
  8 • Revisiting thistaxonomy for gesture UIs Cross-device | Multi-device | Distributed Cross-display | Multi-display Multi-mobile 2-way MDEs Multi-monitor/screen Multi-slate/tablet Multi-display environment Cross-surface | Multi-surface | Trans-surface a b c d e Flipping gestures [45] Pull gestures [22] Across screens [22] Between screens [22] 3-way MDEs This paper Spatially-aware gestures [5,23] Spatially-agnostic gestures [23] Shortcut gestures [21] Motion gestures [26] Surface gestures [18,43] Spherical Gestures [33] Data-sharing gestures [6], Synchronous gestures [9,24], Connection gestures [12,14], Data transfer gestures [13], Auxiliary display [22], Cross-device Drag & Drop [31] Multi-touch [7], Swipe-hand open [22], Pick & Drop [25], Prevalent gestures [28], Multi-surface gestures [29] withi n across level of distribution Stitching gestures [10] Dexterous gestures [46] Object movement gestures [17], Cooperative gestures [17]
• 9.
  9 • Resulting classificationof gestures Single-tap gestures Multi-tap gestures Vertical swipes Horizontal swipes Geometrical shapes Symbolic shapes Stichting gestures Edge-center gestures Pinch-in center, pinch-out lateral In-out lateral gestures
• 10.
  10 • Conclusion • Cross-devicetaxonomy for stroke-gesture interaction • 2 Gesture Elicitation Studies • Taxonomy: 20 classes of stroke gestures • Most important: lateral in/out, stichting gestures • Limitations • No mid-air gestures • No study of fatigue effect on gesture production • Gesture vocabulary depends on the application (here, only IoT and MDE)
• 11.
  Thank you verymuch for your attention