Research

Towards Flexible and Robust User Interface Adaptations With Multiple Objectives

Published at UIST '23: Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, 2023

We propose ParetoAdapt, an adaptation approach that uses online multi-objective optimization with a posteriori articulated preferences—that is, articulation of preferences after the optimization has concluded—to make UI adaptation robust to incomplete and inaccurate objective formulations.

Recommended citation: Christoph Albert Johns, João Marcelo Evangelista Belo, Anna Maria Feit, Clemens Nylandsted Klokmose, and Ken Pfeuffer. 2023. Towards Flexible and Robust User Interface Adaptations With Multiple Objectives. In UIST '23: Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, October, 2023, San Francisco, CA, USA. ACM, New York, NY, USA 17 Pages. https://doi.org/10.1145/3586183.3606799 https://doi.org/10.1145/3586183.3606799

Interactive Link Prediction as a Downstream Task for Foundational GUI Understanding Models

Published at KI 2023 – 46th German Conference on Artificial Intelligence, 2023

we present interactive link prediction as a downstream task for GUI understanding models and provide baselines as well as testing tools to effectively and efficiently evaluate predictive GUI understanding models.

Recommended citation: Johns, C.A., Barz, M., Sonntag, D. (2023). Interactive Link Prediction as a Downstream Task for Foundational GUI Understanding Models. In: Seipel, D., Steen, A. (eds) KI 2023: Advances in Artificial Intelligence. KI 2023. Lecture Notes in Computer Science(), vol 14236. Springer, Cham. https://doi.org/10.1007/978-3-031-42608-7_7 https://doi.org/10.1007/978-3-031-42608-7_7

Mixed Reality UI Adaptations with Inaccurate and Incomplete Objectives

Published at CHI ’23 Workshop on Future of Computational Approaches for Understanding and Adapting User Interfaces, 2023

We propose a new approach to adapt 3D UI layouts using multi-objective optimization and interactive preference elicitation to provide flexible and effective adaptations in light of incomplete information about end-user preferences, emphasizing the importance of user control.

Recommended citation: Christoph Albert Johns and João Marcelo Evangelista Belo. 2023. Mixed Reality UI Adaptations With Inaccurate and Incomplete Objectives. In CHI ’23 Workshop on Future of Computational Approaches for Understanding and Adapting User Interfaces: ACM CHI Conference on Human Factors in Computing Systems, April 23, 2023, Hamburg, Germany. ACM, New York, NY, USA, 6 pages. https://drive.google.com/file/d/1DG96ItpxiFSj9mLREaABWDa3M3cdMusP/view

Pareto Optimal Layouts for Adaptive Mixed Reality

Published at Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA '23), 2023

We suggest using online multi-objective optimization methods for online UI adaptations which generate a set of Pareto optimal adaptation proposals, giving users more control and adding flexibility to the computational decision-making.

Recommended citation: Christoph Albert Johns, João Marcelo Evangelista Belo, Clemens Nylandsted Klokmose, and Ken Pfeuffer. 2023. Pareto Optimal Layouts for Adaptive Mixed Reality. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA '23), April 23--28, 2023, Hamburg, Germany. ACM, New York, NY, USA 7 Pages. https://doi.org/10.1145/3544549.3585732 https://doi.org/10.1145/3544549.3585732