Combining Intelligent Recommendation and Mixed Reality in Itineraries for Urban Exploration
Abstract
Exploration of points of interest (POI) in urban environments is challenging for the large amount of items near or reachable by the user and for the modality hindrances due to reduced manual flexibility and competing visual attention. We propose to combine different modalities, VR, AR, haptics-audio interfaces, with intelligent recommendation based on a computational method combining different data graph overlays: social, personal and search-time user input. We integrate such features in flexible itineraries that aid different phases and aspects of exploration.
Downloads
Download data is not yet available.
References
[1] Aranyi, G., Kouider, S., Lindsay, A., Prins, H., Ahmed, I., Jacucci, G., ... & Cavazza, M. (2014). Subliminal cueing of selection behavior in a virtual environment. PRESENCE: Teleoperators and Virtual Environments, 23(1), 33-50.
[2] L. Ardissono, T. Kuflik, and D. Petrelli, “Personalization in cultural heritage: the road travelled and the one ahead,” User Modeling and User-Adapted Interaction, Vol. 22, no. 1, 2012, pp. 73-99.
[3] Barral, O., Kosunen, I., Ruotsalo, T., Spapé, M. M., Eugster, M. J., Ravaja, N., ... & Jacucci, G. (2016). Extracting relevance and affect information from physiological text annotation. User Modeling and User-Adapted Interaction, 26(5), 493-520.
[4] B. Bell, S. Feiner, and T. Höllerer, “View management for virtual and augmented reality,” Symposium on User Interface Software and Technology, 2001, pp. 101–110.
[5] Eugster, M. J., Ruotsalo, T., Spapé, M. M., Kosunen, I., Barral, O., Ravaja, N., ... & Kaski, S. Predicting Term-Relevance from Brain Signals.Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval (SIGIR '14). ACM, New York, NY, USA, 425-434.
[6] J. Grubert, T. Langlotz, R. Grasset (2011). Augmented reality browser survey, Technical Report 1101, Institute for Computer Graphics and Vision, University of Technology Graz, 2011
[7] Jylhä, A., Hsieh, Y. T., Orso, V., Andolina, S., Gamberini, L., & Jacucci, G. (2015, November). A Wearable Multimodal Interface for Exploring Urban Points of Interest. In Proceedings of the 2015 ACM on International Conference on Multimodal Interaction (pp. 175-182). ACM.
[8] A. Lugmayr, B. Stockleben, C. Scheib, and M. Mailaparampil, “Cognitive Big Data. Survey and Review on Big Data Research and its Implications: What is Really ‘New’? Cognitive Big Data!,” Journal of Knowledge Management (JMM), vol. 21, no. 1, 2017.: http://www.emeraldgrouppublishing.com /products/journals/ call_for_papers.htm ?id=5855k, Journal of Knowledge Management/Emerald
[9] A. Lugmayr, A. Greenfeld, A. Woods, and P. Joseph, “Cultural Visualisation of a Cultural Photographic Collection in 3D Environments – Development of ‘PAV 3D’ (Photographic Archive Visualisation),” in Entertainment Computing - ICEC 2016: 15th IFIP TC 14 International Conference, Vienna, Austria, September 28-30, 2016, Proceedings, G. Wallner, S. Kriglstein,
[10] H. Hlavacs, R. Malaka, A. Lugmayr, and H.-S. Yang, Eds. Cham: Springer International Publishing, 2016, pp. 272–277
Nurminen, A. 2008. Mobile 3D City Maps. IEEE Computer Graphics and Applications 28, 4 (2008), 20–31.
[11] Orso, V., Ruotsalo, T., Leino, J., Gamberini, L., & Jacucci, G. (2017). Overlaying social information: The effects on users’ search and information-selection behavior. Information Processing & Management, 53(6), 1269-1286.
[12] S. Lemmelä, A. Vetek, K. Mäkelä, and D. Trendafilov, “Designing and evaluating multimodal interaction for mobile contexts,” Proc. 10th international conference on Multimodal interfaces, (ICMI '08), 2008, pp. 265-272.
[13] M. Tatzgern, V. Orso, D. Kalkofen, G. Jacucci, L. Gamberini, and D. Schmalstieg, “Adaptive Information Density for Augmented Reality Displays,” In Proc. IEEE Virtual Reality, November 2016.
[14] M. Turk, “Multimodal interaction: A review,” Pattern Recognition Letters, Vol. 36, 2014, pp. 189-195.
[15] Zhu, K., Ma, X., Chen, H., and Liang, M. (2016). Tripartite Effects: Exploring Users' Mental Model of Mobile Gestures under the Influence of Operation, Handheld Posture, and Interaction Space. International Journal of Human-Computer Interaction.
[2] L. Ardissono, T. Kuflik, and D. Petrelli, “Personalization in cultural heritage: the road travelled and the one ahead,” User Modeling and User-Adapted Interaction, Vol. 22, no. 1, 2012, pp. 73-99.
[3] Barral, O., Kosunen, I., Ruotsalo, T., Spapé, M. M., Eugster, M. J., Ravaja, N., ... & Jacucci, G. (2016). Extracting relevance and affect information from physiological text annotation. User Modeling and User-Adapted Interaction, 26(5), 493-520.
[4] B. Bell, S. Feiner, and T. Höllerer, “View management for virtual and augmented reality,” Symposium on User Interface Software and Technology, 2001, pp. 101–110.
[5] Eugster, M. J., Ruotsalo, T., Spapé, M. M., Kosunen, I., Barral, O., Ravaja, N., ... & Kaski, S. Predicting Term-Relevance from Brain Signals.Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval (SIGIR '14). ACM, New York, NY, USA, 425-434.
[6] J. Grubert, T. Langlotz, R. Grasset (2011). Augmented reality browser survey, Technical Report 1101, Institute for Computer Graphics and Vision, University of Technology Graz, 2011
[7] Jylhä, A., Hsieh, Y. T., Orso, V., Andolina, S., Gamberini, L., & Jacucci, G. (2015, November). A Wearable Multimodal Interface for Exploring Urban Points of Interest. In Proceedings of the 2015 ACM on International Conference on Multimodal Interaction (pp. 175-182). ACM.
[8] A. Lugmayr, B. Stockleben, C. Scheib, and M. Mailaparampil, “Cognitive Big Data. Survey and Review on Big Data Research and its Implications: What is Really ‘New’? Cognitive Big Data!,” Journal of Knowledge Management (JMM), vol. 21, no. 1, 2017.: http://www.emeraldgrouppublishing.com /products/journals/ call_for_papers.htm ?id=5855k, Journal of Knowledge Management/Emerald
[9] A. Lugmayr, A. Greenfeld, A. Woods, and P. Joseph, “Cultural Visualisation of a Cultural Photographic Collection in 3D Environments – Development of ‘PAV 3D’ (Photographic Archive Visualisation),” in Entertainment Computing - ICEC 2016: 15th IFIP TC 14 International Conference, Vienna, Austria, September 28-30, 2016, Proceedings, G. Wallner, S. Kriglstein,
[10] H. Hlavacs, R. Malaka, A. Lugmayr, and H.-S. Yang, Eds. Cham: Springer International Publishing, 2016, pp. 272–277
Nurminen, A. 2008. Mobile 3D City Maps. IEEE Computer Graphics and Applications 28, 4 (2008), 20–31.
[11] Orso, V., Ruotsalo, T., Leino, J., Gamberini, L., & Jacucci, G. (2017). Overlaying social information: The effects on users’ search and information-selection behavior. Information Processing & Management, 53(6), 1269-1286.
[12] S. Lemmelä, A. Vetek, K. Mäkelä, and D. Trendafilov, “Designing and evaluating multimodal interaction for mobile contexts,” Proc. 10th international conference on Multimodal interfaces, (ICMI '08), 2008, pp. 265-272.
[13] M. Tatzgern, V. Orso, D. Kalkofen, G. Jacucci, L. Gamberini, and D. Schmalstieg, “Adaptive Information Density for Augmented Reality Displays,” In Proc. IEEE Virtual Reality, November 2016.
[14] M. Turk, “Multimodal interaction: A review,” Pattern Recognition Letters, Vol. 36, 2014, pp. 189-195.
[15] Zhu, K., Ma, X., Chen, H., and Liang, M. (2016). Tripartite Effects: Exploring Users' Mental Model of Mobile Gestures under the Influence of Operation, Handheld Posture, and Interaction Space. International Journal of Human-Computer Interaction.
Published
2018-01-11
How to Cite
JACUCCI, Giulio et al.
Combining Intelligent Recommendation and Mixed Reality in Itineraries for Urban Exploration.
International SERIES on Information Systems and Management in Creative eMedia (CreMedia), [S.l.], n. 2017/2, p. 18-23, jan. 2018.
ISSN 2341-5576.
Available at: <https://www.ambientmediaassociation.org/Journal/index.php/series/article/view/276>. Date accessed: 27 mar. 2023.
(c) International Ambient Media Association (iAMEA) [Copyright and License Transfer Agreement]
