Thematic Section

What to do in /with images? The (virtual) hand in augmented and virtual reality.

Author(s)
Keywords
  • Immersive experience
  • Virtual reality
  • Augmented reality
  • Virtual hand
  • Contemporary art
Abstract

This paper focuses on the concept of acting with and in images in the context of recent AR and VR artworks. The thesis is that the (virtual) hand plays a significant role in an immersive experience. Referring to Doris Kolesch’s relational concept of immersion as one that considers not only the status of being evolved but also the process of getting inside, three forms of actions in and with images are discussed: the hand as stage, the hand as a symbiotic contact zone, and the hand as a designing hand. With artworks by Jeremy Bailey, Aristarkh Chernyshev, Rachel Rossin, and Florian Meisenberg, this contribution aims to contour the forms of action in which the (virtual) hand, in particular, allows an immersive experience by interaction with the virtual sphere and knows how to combine distance with nearness.

References
  1. Andreas, M., Kasprowicz, D., Rieger, S., eds., Unterwachen und Schlafen: Anthropophile Medien nach dem Interface (Lüneburg: Meson Press 2018).
  2. Berkman, M. I., Akan, E., “Presence and Immersion in Virtual Reality,” in N. Lee, ed., Encyclopedia of Computer Graphics and Games (Cham: Springer, 2019): 1-10, https://doi.org/10.1007/978-3-319-08234-9_162-1.
  3. Buckingham, G., “Hand Tracking for Immersive Virtual Reality: Opportunities and Challenges,” in Front. Virtual Real 2 (2021), https://doi.org/10.3389/frvir.2021.728461.
  4. Geimer, P., “Kunst und Immersion: Der Trend zum Bildersturm,” FAZ (Juli 23, 2018), https://www.faz.net/aktuell/feuilleton/kunst-und-architektur/was-soll-der-trend-zur-immersion-in-der-kunst-15701142.html, accessed May 4, 2023.
  5. Grau, O., Virtual Art: From Illusion to Immersion (Cambridge MA: MIT Press, 2003).
  6. Hinterwaldner, I., The Systemic Image: A New Theory of Interactive Real-Time Simulations (2010), trans. E. Tucker (Cambridge/London: MIT Press, 2017).
  7. Hochscherf, T., Kjär, H., Rupert-Kruse, P., “Phänomene und Medien der Immersion,” in Jahrbuch immersiver Medien: Immersion: Abgrenzung, Annäherung, Erkundung (Kiel: Schüren, 2011): 9-18, 14, http://dx.doi.org/10.25969/mediarep/18222.
  8. Hörisch, J., Hände: Eine Kulturgeschichte (München: Hanser, 2020): 22.
  9. Kim, M., Lee, J. Y., “Touch and Hand Gesture-based Interactions for Directly Manipulating 3D Virtual Objects in Mobile Augmented Reality,” Multimed Tools Appl 75 (2016): 16529-16550, https://doi.org/10.1007/s11042-016-3355-9.
  10. Kolesch, D., “Immersion and Spectatorship at the Interface of Theatre, Media Tech and Daily Life: An Introduction,” in D. Kolesch, T. Schütz, S. Nikoleit, eds., Staging Spectators in Immersive Performances: Commit Yourself! (Oxon/New York: Routledge, 2019): 1-17.
  11. Levy, R., “Elon Musk Expects Neuralink’s Brain Chip to Begin Human Trials in 6 Months,” Reuters (December 1, 2022), https://www.reuters.com/technology/elon-musk-says-expects-neuralink-begin-human-trials-six-months-2022-12-01/, accessed May 4, 2023.
  12. Liptay, F., Dogramaci, B., eds., Immersion in the Visual Arts and Media (Leiden-Boston: Brill Rodopi, 2016): 1-17, https://doi.org/10.1163/9789004308237_002.
  13. Pinotti, A., “Towards An-iconology: The Image as Environment,” Screen 61, no. 4 (2020): 594-603, https://doi.org/10.1093/screen/hjaa060.
  14. Premaratne, P., Human Computer Interaction Using Hand Gestures (Singapur: Springer 2014).
  15. Rieger, S., Schäfer, A., Tuschling, A., eds., Virtuelle Lebenswelten: Körper – Räume –Affekte (Bielefeld: Transcript, 2022).
  16. Seja, S., “Der Handlungsbegriff in der Bild- und Kunstphilosophie,” in I. Reichle, S. Siegel, A. Spelten, eds., Verwandte Bilder: Die Fragen der Bildwissenschaft (Kadmos: Berlin, 2007): 97-112.
  17. Urban, A., Reich, J., van der Veen, M., “Passthrough: Von Portalen, Durchblicken und Übergängen zwischen den (virtuellen) Welten,” Kunstforum International 290 (2023): 86-95.
  18. Voigt-Antons, J. N., et al., “Influence of Hand Tracking as a Way of Interaction in Virtual Reality on User Experience,” Twelfth International Conference on Quality of Multimedia Experience (2020): 1-4, https://doi.org/10.1109/QoMEX48832.2020.9123085.
Read Article
Published

29 December 2023

DOI:
https://doi.org/10.54103/ai/19765
How to Cite
Reich, J. (2023). What to do in /with images? The (virtual) hand in augmented and virtual reality. AN-ICON. Studies in Environmental Images [ISSN 2785-7433], 2(II). https://doi.org/10.54103/ai/19765
Copy

Issue
Vol. 2 No. II (2023): Immersions and Dives: From the Environment to Virtual Reality

Metrics

Metrics Loading ...
License
Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.