30 years of evaluating innovative accessible or assistive technology in Human-Computer Interaction research and how we could do better
Quantitative, if possible experimental, studies and evaluations are central in Human-Computer Interaction (HCI) and to motivate policy initiatives. Yet, few technologies for children with visual impairments have been evaluated this way in education research; it is also an issue in research on technology for locomotion and mobility. Even if they were evaluated: the current replication crisis calls for revisiting our practices, and standards for quantitative evaluations have changed through time. We set to investigate how quantitative empirical evaluations of technology for visually impaired people are conducted in papers published by top HCI venues in this area (CHI, Tochi, Assets, Taccess), and to identify areas of improvements. We suggest that single subject experiment designs might be more adequate with this group. We also outline practical steps for authors and reviewers to improve their evaluation practices.
Continuer la lecture de « Evaluating technologies with and for visually impaired people »