Hostname: page-component-84b7d79bbc-c654p Total loading time: 0 Render date: 2024-07-28T02:10:15.876Z Has data issue: false hasContentIssue false
  • English
  • Français

A SYSTEMATIC COLLECTION OF NATURAL INTERACTIONS FOR IMMERSIVE MODELING FROM BUILDING BLOCKS

Published online by Cambridge University Press:  27 July 2021

Jakob Harlan ,
Benjamin Schleich  and
Sandro Wartzack
Jakob Harlan*
Affiliation:
Friedrich-Alexander-Universität Erlangen-Nürnberg
Benjamin Schleich
Affiliation:
Friedrich-Alexander-Universität Erlangen-Nürnberg
Sandro Wartzack
Affiliation:
Friedrich-Alexander-Universität Erlangen-Nürnberg
*
Harlan, Jakob, Friedrich-Alexander-Universität Erlangen-Nürnberg, KTmfk, Germany, harlan@mfk.fau.de

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

The increased availability of affordable virtual reality hardware in the last years boosted research and development of such systems for many fields of application. While extended reality systems are well established for visualization of product data, immersive authoring tools that can create and modify that data are yet to see widespread productive use. Making use of building blocks, we see the possibility that such tools allow quick expression of spatial concepts, even for non-expert users. Optical hand-tracking technology allows the implementation of this immersive modeling using natural user interfaces. Here the users manipulated the virtual objects with their bare hands. In this work, we present a systematic collection of natural interactions suited for immersive building-block-based modeling systems. The interactions are conceptually described and categorized by the task they fulfil.

Keywords

Virtual realityConceptual designComputer Aided Design (CAD)
Type
Article
Information
Proceedings of the Design Society , Volume 1: ICED21 , August 2021 , pp. 283 - 292
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - ND
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.
Copyright
The Author(s), 2021. Published by Cambridge University Press

References

Argelaguet, F. and Andujar, C. (2013), “A survey of 3D object selection techniques for virtual environments”, Computers & Graphics, Vol. 37 No. 3, pp. 121–136. http://doi.org/10.1016/j.cag.2012.12.003.CrossRefGoogle Scholar
Borst, C.W. and Indugula, A.P. (2005), “Realistic virtual grasping”, IEEE Proceedings. VR 2005. Virtual Reality, 2005., IEEE, Bonn, Germany, pp. 91–320. http://doi.org/10.1109/VR.2005.1492758.Google Scholar
Boulic, R., Rezzonico, S. and Thalmann, D. (1996), “Multi-finger manipulation of virtual objects”, Proceedings of the ACM Symposium on Virtual Reality Software and Technology, Association for Computing Machinery, New York, NY, USA, pp. 67–74. http://doi.org/10.1145/3304181.3304195.CrossRefGoogle Scholar
Caputo, F.M., Emporio, M. and Giachetti, A. (2017), “The Smart Pin: A Novel Object Manipulation Technique for Immersive Virtual Environments”, Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, ACM, New York, NY, USA, p. 89:1–89:2. http://doi.org/10.1145/3139131.3141784.CrossRefGoogle Scholar
Coburn, J.Q., Freeman, I. and Salmon, J.L. (2017), “A Review of the Capabilities of Current Low-Cost Virtual Reality Technology and Its Potential to Enhance the Design Process”, Journal of Computing and Information Science in Engineering, Vol. 17 No. 3. http://doi.org/10.1115/1.4036921.CrossRefGoogle Scholar
Cordeiro, E., Giannini, F. and Monti, M. (2019), “A survey of immersive systems for shape manipulation”, Computer-Aided Design and Applications, Vol. 16 No. 6, pp. 1146–1157. http://doi.org/10.14733/cadaps.2019.1146-1157.CrossRefGoogle Scholar
Cordeiro, E., Giannini, F., Monti, M., Mendes, D. and Ferreira, A. (2018), “A Study on Natural 3D Shape Manipulation in VR”, Smart Tools and Apps for Graphics - Eurographics Italian Chapter Conference, p. 9 pages. http://doi.org/10.2312/stag.20181296.CrossRefGoogle Scholar
Dachselt, R. and Hübner, A. (2007), “Three-dimensional menus: A survey and taxonomy”, Computers & Graphics, Vol. 31 No. 1, pp. 53–65. http://doi.org/10.1016/j.cag.2006.09.006.CrossRefGoogle Scholar
Fechter, M., Schleich, B. and Wartzack, S. (2020), “CAD-Gestaltmodellierung in VR für die frühe Entwurfsphase”, Konstruktion, Vol. 72, pp. 69–74.CrossRefGoogle Scholar
Fechter, M. and Wartzack, S. (2017), “Natural Finger Interaction for CAD Assembly Modeling”, in ASME (Ed.), ASME 2017 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Volume 1: 37th Computers and Information in Engineering Conference, p. V001T02A041. http://doi.org/10.1115/DETC2017-67555.Google Scholar
Harlan, J., Schleich, B. and Wartzack, S. (2020), “Linking a game-engine with CAD-software to create a flexible platform for researching extended reality interfaces for the industrial design process”, Proceedings of the 31st Symposium Design for X, The Design Society, pp. 169–178. http://doi.org/10.35199/dfx2020.18.CrossRefGoogle Scholar
Kang, J., Zhong, K., Qin, S., Wang, H. and Wright, D. (2013), “Instant 3D design concept generation and visualization by real-time hand gesture recognition”, Computers in Industry, Vol. 64 No. 7, pp. 785–797. http://doi.org/10.1016/j.compind.2013.04.012.CrossRefGoogle Scholar
LaViola, J.J., Kruijff, E., McMahan, R.P., Bowman, D.A. and Poupyrev, I. (2017), 3D User Interfaces: Theory and Practice, Second edition., Addison-Wesley, Boston.Google Scholar
Mendes, D., Medeiros, D., Sousa, M., Ferreira, R., Raposo, A., Ferreira, A. and Jorge, J. (2017), “Mid-air modeling with Boolean operations in VR”, 2017 IEEE Symposium on 3D User Interfaces (3DUI), pp. 154–157. http://doi.org/10.1109/3DUI.2017.7893332.CrossRefGoogle Scholar
Pahl, G., Beitz, W., Schulz, H.-J. and Jarecki, U. (2013), Pahl/Beitz Konstruktionslehre: Grundlagen erfolgreicher Produktentwicklung. Methoden und Anwendung, Springer-Verlag.Google Scholar
Rautaray, S.S. and Agrawal, A. (2015), “Vision based hand gesture recognition for human computer interaction: a survey”, Artificial Intelligence Review, Vol. 43 No. 1, pp. 1–54. http://doi.org/10.1007/s10462-012-9356-9.Google Scholar
Regazzoni, D., Rizzi, C. and Vitali, A. (2018), “Virtual Reality Applications: Guidelines to Design Natural User Interface”, Volume 1B: 38th Computers and Information in Engineering Conference, American Society of Mechanical Engineers, Quebec City, Quebec, Canada, http://doi.org/10.1115/DETC2018-85867.Google Scholar
Song, P., Goh, W.B., Hutama, W., Fu, C.-W. and Liu, X. (2012), “A handle bar metaphor for virtual object manipulation with mid-air interaction”, Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems CHI ’12, ACM Press, Austin, Texas, USA, p. 1297. http://doi.org/10.1145/2207676.2208585.CrossRefGoogle Scholar
Vuletic, T., Duffy, A., Hay, L., McTeague, C.P., Campbell, G., Choo, P.L. and Grealy, M. (2018), “Natural and intuitive gesture interaction for 3D object manipulation in conceptual design”, DS 92: Proceedings of the DESIGN 2018 15th International Design Conference, pp. 103–114. http://doi.org/10.21278/idc.2018.0321.CrossRefGoogle Scholar