Evaluation of Interactive Machine Learning Systems

Abstract : The evaluation of interactive machine learning systems remains a difficult task. These systems learn from and adapt to the human, but at the same time, the human receives feedback and adapts to the system. Getting a clear understanding of these subtle mechanisms of cooperation and co-adaptation is challenging. In this chapter, we report on our experience in designing and evaluating various interactive machine learning applications from different domains. We argue for coupling two types of validation: algorithm-centered analysis, to study the computational behaviour of the system; and human-centered evaluation, to observe the utility and effectiveness of the application for end-users. We use a visual analytics application for guided search, built using an interactive evolutionary approach, as an exemplar of our work. We argue that human-centered design and evaluation complement al-gorithmic analysis, and can play an important role in addressing the " black-box " effect of machine learning. Finally, we discuss research opportunities that require human-computer interaction methodologies, in order to support both the visible and hidden roles that humans play in interactive machine learning.
Type de document :
Chapitre d'ouvrage
J. Zhou; F. Chen. Human and Machine Learning Visible, Explainable, Trustworthy and Transparent, Springer, pp.341-360, 2018, 978-3-319-90403-0. 〈https://www.springer.com/la/book/9783319904023〉
Liste complète des métadonnées

Littérature citée [31 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01845018
Contributeur : Anastasia Bezerianos <>
Soumis le : vendredi 20 juillet 2018 - 00:09:47
Dernière modification le : samedi 21 juillet 2018 - 01:17:38
Document(s) archivé(s) le : dimanche 21 octobre 2018 - 12:18:15

Fichier

evaluation-interactive-machine...
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01845018, version 1

Citation

Nadia Boukhelifa, Anastasia Bezerianos, Evelyne Lutton. Evaluation of Interactive Machine Learning Systems. J. Zhou; F. Chen. Human and Machine Learning Visible, Explainable, Trustworthy and Transparent, Springer, pp.341-360, 2018, 978-3-319-90403-0. 〈https://www.springer.com/la/book/9783319904023〉. 〈hal-01845018〉

Partager

Métriques

Consultations de la notice

208

Téléchargements de fichiers

24