Thematic Section

The haptics of illusion. An account of touch across theories, technologies and museums

Author(s)
Keywords
  • Haptic
  • Technology
  • Illusion
  • Virtuality
  • Museums
Abstract

Touch represents one of the latest and most complex frontiers of virtuality: a sense which historically seems to have carried the burden of proof on reality, by definition resistant to illusory environments. The paper begins from this assumption to trace a history of illusion across authors and theorists that have debated the statute of haptics, building a dialogue between philosophical dilemmas and technological developments. Moving both from an aesthetic and psychophysiological viewpoint, the article will root its analysis in an historical-artistic account, augmenting the discussion with a series of case studies from the museum sector. The introduction of haptic technologies within cultural institutions, which dates back to the last three decades, proves an interesting field to test the functions which touch plays in both educational and imaginative scenarios. The open question being whether modern technologies should aim at replicating haptic realism in miming phenomenological accuracy, or whether the most innovative applications need to aspire to a more environmental employment of touch.

References
  1. Abtahi, P., “From illusions to beyond-real interactions in virtual reality,” UIST ‘21: The Adjunct Publication of the 34th Annual ACM Symposium on User Interface Software and Technology (October 2021): 153-157, https://doi.org/10.1145/3474349.3477586.
  2. Arcagni, S., Visioni digitali: Video, web e nuove tecnologie (Torino: Einaudi, 2016).
  3. Arnold, K., “Skulls, mummies and unicorns’ horns: medicinal chemistry in early English museums,” in Anderson, R.G.W. et. al., Enlightening the British: Knowledge, Discovery and the Museum in the Eighteenth Century (London: The British Museum Press, 2003).
  4. Banham, R., “Haptic happenings: how touch technologies are taking on new meaning,” Dell Technologies (October 21, 2019), https://www.delltechnologies.com/en-us/perspectives/haptic-happenings-how-touch-technologies-are-taking-on-new-meaning/, accessed December 11, 2022.
  5. Barker, J.M., The Tactile Eye. Touch and the Cinematic Experience (Berkeley-Los Angeles-London: University of California Press, 2009).
  6. Baudrillard, J., Seduction (1979), trans. Singer, B. (Montréal: New World Perspectives. Culture Text Series, 1990).
  7. Berenson, B., Aesthetics and History (New York: Doubleday & Company, 1948).
  8. Black, G., The Engaging Museum: Developing Museums for Visitor Involvement (Oxford: Routledge, 2005).
  9. Brewster, S., “The impact of haptic ‘touching’ technology on cultural applications,” in J. Hemsley, V. Cappellini, G. Stanke, eds., Digital Applications for Cultural Heritage Institutions (Aldershot: Ashgate, 2005): 273-284.
  10. Brown, A., “Bernard Berenson and ‘tactile values’ in Florence,” in J. Connors, ed., Bernard Berenson: Formation and Heritage (Cambridge, Massachusetts: Villa I Tatti, The Harvard University Center for Italian Renaissance Studies, 2014).
  11. Brown, E., An Account of Several Travels through a Great Part of Germany (London: Benjamin Tooke, 1677).
  12. Bruno, G., “Film, aesthetics, science: Hugo Münsterberg's laboratory of moving images,” Grey Room 36 (Summer 2009): 88-113, https://doi.org/10.1162/grey.2009.1.36.88.
  13. Butler, M., Neave, P., “Object appreciation through haptic interaction,” Proceedings of the 25th Annual Conference of the Australian Society for Computers in Learning in Tertiary Education (Melbourne: Ascilite, 2008): 133-141.
  14. Candlin, F., Art, Museums and Touch (Manchester: University of Manchester Press, 2010).
  15. Carter, T. et al., “Ultrahaptics: multi-point mid-air haptic feedback for touch surfaces,” UIST '13: Proceedings of the 26th annual ACM symposium on User interface software and technology (St. Andrews, UK, October 8-11, 2013): 505-514.
  16. Casetti, F., “Che cos’è uno schermo, oggi?,” Rivista di Estetica 55 (2014): 28-34 https://doi.org/10.4000/estetica.969.
  17. Casetti, F., “Primal screens,” in C. Buckley, R. Campe, F. Casetti, eds., Screen Genealogies. From Optical Device to Environmental Medium (Amsterdam: Amsterdam University Press, 2019): 27-50.
  18. Ceccacci, S. et al., “The role of haptic feedback and gamification in virtual museum systems,” Journal on Computing and Cultural Heritage 14, no. 3 (2017) https://doi.org/10.1145/3453074.
  19. Chatterjee, H., Touch in Museums: Policy and Practice in Object Handling (Oxford: Berg, 2008).
  20. Chirimuuta, M., “Vision, perspectivism, and haptic realism,” Philosophy of Science 83, no. 5 (December 2016): 746-756, https://doi.org/10.1086/687860.
  21. Classen, C., The Book of Touch (Oxford: Berg Publishers, 2005).
  22. Classen, C., The Deepest Sense. A Cultural History of Touch (Chicago: University of Illinois Press, 2012).
  23. Comes, R., “Haptic devices and tactile experiences in museum exhibitions,” Journal of Ancient History and Archeology 3, no. 4 (2016) https://doi.org/10.14795/j.v3i4.205.
  24. Deleuze, G., Francis Bacon. Logic of Sensation (1981), trans. D.W. Smith (London-New York: Continuum, 2003).
  25. Derrida, J., On Touching — Jean-Luc Nancy (2000), trans. C. Irizarry (Stanford: Stanford University Press, 2005).
  26. Dessoir, M., Über der Hautsinn (Separat-Abzug aus Archiv für Anatomie und Physiologie: Physiologische Abtheilung, 1892).
  27. Dessoir, M., Aesthetics and Theory of Art (1906), trans. S.A. Emery (Detroit: Wayne State University Press, 1970).
  28. Diaconu, M., “Illusionary touch, and touching illusions,” in A.-T. Tymieniecka, ed., Analecta Husserliana. The Yearbook of Phenomenological Research. Human Creation Between Reality and Illusion 87 (Cham: Springer, 2005): 115-125.
  29. Dima, M., Hurcombe, L., Wright, M., “Touching the past: haptic augmented reality for museum artefacts,” in R. Shumaker, S. Lackey, eds., Virtual, Augmented and Mixed Reality. Applications of Virtual and Augmented Reality. VAMR, Lecture Notes in Computer Science 8526 (Cham: Springer, 2014): https://doi.org/10.1007/978-3-319-07464-1_1.
  30. Dudley, S., ed., Museum Objects: Experiencing the Properties of Things (London: Routledge, 2012).
  31. Fischnaller, F., “The last supper interactive project. The illusion of reality: perspective and perception,” in G. Amoruso, ed., Putting Tradition into Practice: Heritage, Place and Design, Lecture Notes in Civil Engineering 3 (Cham: Springer, 2018) https://doi.org/10.1007/978-3-319-57937-5_73.
  32. Frisoli, A. et al., “Evaluation of the pure-form haptic displays used for exploration of works of art at museums,” report on the project findings, 2005 retrieved at https://www.researchgate.net/publication/228584199_Evaluation_of_the_pure-form_haptic_displays_used_for_exploration_of_works_of_art_at_museums/related, accessed January 31, 2022.
  33. Focillon, H., “Éloge de la main” (1934), in Vie des formes (Paris: Presses Universitaires de France, 1981).
  34. Freedberg, D., Gallese, V., “Motion, emotion and empathy in aesthetic experience,” Trends in Cognitive Sciences 11, no. 5 (2007): 197-203, https://doi.org/10.1016/j.tics.2007.02.003.
  35. Gadoua, M., “Making sense through touch. Handling collections with Inuit Elders at the McCord Museum,” The Senses and Society 9, no. 3 (2014): 323-341 https://doi.org/10.2752/174589314X14023847039719.
  36. Gallace, A., Spence, C., In Touch with the Future: The Sense of Touch from Cognitive Neuroscience to Virtual Reality (Oxford: Oxford University Press, 2014).
  37. Gallace, A., Girondini, M., “Social touch in virtual reality,” Current Opinion in Behavioral Sciences 43 (February 2022): 249-254, https://doi.org/10.1016/j.cobeha.2021.11.006.
  38. Getsy, D., “Tactility or opticality, Henry Moore or David Smith: Herbert Read and Clement Greenberg on The Art of Sculpture, 1956,” in R. Peabody, ed., Anglo-American Exchange in Postwar Sculpture 1945–1975 (Los Angeles: Getty Publication, 2011): 105-120.
  39. Gibson, J., “Observations on active touch,” Psychological Review 69, no. 6 (November 1962): 477-491, https://doi.org/10.1037/h0046962.
  40. Greenberg, C., “Roundness isn’t all,” (November 25, 1956), in J. Brian, ed., Clement Greenberg: Collected Essays and Criticism 3 (Chicago: The University of Chicago Press, 1995): 105-121.
  41. Grunwald, M., ed., Human Haptic Perception. Basics and Applications (Basel: Birkhäuser, 2008).
  42. “H-Reality,” FET FX. Our Future Today (2020): http://www.fetfx.eu/project/h-reality/, accessed December 8, 2022.
  43. Heller, M., Gentaz, E., Illusions, Psychology of Touch and Blindness (New York-London: Psychology Press. Taylor & Francis Group, 2014): 61-78.
  44. Herder, J. G., Sculpture. Some Observations on Shape and Form from Pygmalion’s Creative Dream (1778), ed. J. Gaiger (Chicago-London: The University of Chicago Press, 2002).
  45. Horizon 2020 (CORDIS), Mixed Haptic Feedback for Mid-Air Interactions in Virtual and Augmented Realities (October 1, 2018- March 31, 2022): https://cordis.europa.eu/project/id/801413/it, accessed December 8, 2022.
  46. CORDIS Horizon 2020, TACTIle feedback enriched virtual interaction through virtual realITY and beyond, (July 1, 2019-September 30, 2022): https://cordis.europa.eu/project/id/856718/it, accessed December 8, 2022.
  47. CORDIS Horizon 2020, Multimodal haptic with touch devices (March 1, 2020-February 29, 2024): https://cordis.europa.eu/project/id/860114/it, accessed December 8, 2022.
  48. Howes, D., “Introduction to sensory museology,” The Senses and Society 9, no. 3 (2014): 259-267 https://doi.org/10.2752/174589314X14023847039917.
  49. Hwang, I., et al., “AirPiano: enhancing music playing experience in virtual reality with mid-air haptic feedback,” 2017 IEEE World Haptics Conference (WHC) https://doi.org/10.1109/WHC.2017.7989903.
  50. Jamil, M. H., et al., “The role of haptics in digital archaeology and heritage recording processes,” IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE) 6, no. 1 (2018): https://doi.org/10.1109/HAVE.2018.8547505.
  51. James, W., The Principles of Psychology (Ontario: York University, 1890).
  52. Jansson, G., Bergamasco, M., Frisoli, A., “A new option for the visually impaired to experience 3D art at museums: manual exploration of virtual copies,” Visual Impairment Research 5, no.1 (2003): 1-12, https://doi.org/10.1076/vimr.5.1.1.15973.
  53. Jones, L.A., Lederman, S.J., Human Hand Function (Oxford: Oxford University Press, 2006).
  54. Krohn, W.O., “Facilities in experimental psychology in the colleges of the United States,” in C.D. Green, ed., Classics in the History of Psychology (Toronto: Tork University, 1894).
  55. La Roche, S.A., Sophie in London, 1786: Being the Diary of Sophie Von La Roche, trans. C. Williams (London: Jonathan Cape, 1933).
  56. Maehigashi, A. et al., “Virtual weight illusion: weight perception of virtual objects using weight illusion,” CHI ’21 Extended Abstracts (May 2021), https://doi.org/10.1145/3411763.3451842.
  57. Marks, L.U., The Skin of the Film. Intercultural Cinema, Embodiment, and the Senses (Durham-London: Duke University Press, 2000).
  58. Marks, L.U., Touch: Sensuous Theory and Multisensory Media (Minneapolis-London: University of Minnesota Press, 2002).
  59. Martínková, I., “Body ecology: avoiding body–mind dualism,” Loisir et Société / Society and Leisure 40, no. 1 (2017): 101-112, https://doi.org/10.1080/07053436.2017.1281528.
  60. Massie, T.H., Salisbury, J.K., “The PHANToM haptic interface: a device for probing virtual objects,” Dynamic Systems and Control 1, no. 55 (1994).
  61. Mclaughlin, M., Shahabi, C., Hespanha, Joao P., “The haptic museum,” Conference: Proc. of the EVA 2000 Florence Conf. on Electronic Imaging and the Visual Arts (March 2000).
  62. Munsterberg, H., Psychological Laboratory of Harvard University (Harvard: Harvard University Press, 1893).
  63. Murray, D., Museums: Their History and Use, vol. 1 (Glasgow: James MacLehose and Sons, 1904).
  64. Nancy, J.-L., Corpus (Paris: Metailie, 1992).
  65. Novak, M., Phelan, S., Lewalter D., Schwan, S., “There is more to touch than meets the eye: haptic exploration in a science museum,” International Journal of Science Education 42, no. 18, (2020): 3026-3048, https://doi.org/10.1080/09500693.2020.1849855.
  66. Obrist, M. et al., “Emotions mediated through mid-air haptics,” Feeling and Communicating Emotions (Seoul: Crossing, 2015) https://doi.org/10.1145/2702123.2702361.
  67. Osborn H.F., The American Museum of Natural History: its Origin, its History, the Growth of its Departments to December 31, 1909 (New York: The American Museum of Natural History, 1909)
  68. Ovenell, R.F. The Ashmolean Museum, 1683–1894 (Oxford: Clarendon Press, 1986).
  69. Parisi, D., “Fingerbombing, or ‘touching is good’: the cultural construction of technologized touch,” in M. Elo, M. Luoto, eds., Figure of Touch: Sense, Technics, Body (Helsinki: The Academy of Fine Arts at the University of the Arts Helsinki, Tallinna Raamatutrükikoja OÜ, 2018): 59-89.
  70. Parisi, D., Archaeologies of Touch. Interfacing with Haptics from Electricity to Computing (Minneapolis, London: University of Minnesota Press, 2018).
  71. Park, Y. et al., “WeHAPTIC: A Wearable Haptic interface for Accurate Position Tracking and Interactive force Control,” Mechanism and Machine Theory 153 (November 2020) https://doi.org/10.1016/j.mechmachtheory.2020.104005.
  72. Perniola, M., Il Sex Appeal dell’Inorganico (Torino: Einaudi, 1994).
  73. Peterson, M., The Senses of Touch (London: Routledge, 2007).
  74. Pinotti, A., Il corpo dello Stile. Storia dell’Arte come Storia dell’Estetica a partire da Semper, Riegl, Wölfflin (Milano: Mimesis, 2001).
  75. Pinotti, A., “The touchable and the untouchable. Merleau-Ponty and Bernard Berenson,” Phenomenology 2005 3, no. 2 (2007): 479-498.
  76. Pinotti, A., “Guardare o toccare? Un’incertezza herderiana,” Aisthesis. Pratiche, linguaggi e saperi dell’estetico 1 (2009): 177-191, https://doi.org/10.13128/Aisthesis-10953.
  77. Pinotti, A., “Style, rythme, souffle: Maldiney and Kunstwissenschaft,” in J.P. Charcosset, ed., Parole tenue: Colloque du Centenaire du Maldiney á Lyon (Milano: Mimesis Edizioni, 2014): 49-59.
  78. Pinotti, A., ed., Alois Riegl. Grammatica Storica delle Arti Figurative (Macerata: Quodlibet, 2018).
  79. Pott, P.P., “Haptic interfaces,” in L. Manfredi, ed., Endorobotics. Design, R&D, Future Trends (Academic Press, 2022).
  80. Pye, E., The Power of Touch: Handling Objects in Museums and Heritage Contexts (Walnut Creek, CA: Left Coast Press, 2007).
  81. Racat, M., Capelli, S., “Touching without touching: the paradox of the digital age,” in Haptic Sensation and Consumer Behavior. The Influence of Tactile Stimulation in Physical and Online Environments (Cham: Springer, 2020).
  82. Read, H., The Art of Sculpture (London: Faber & Faber, 1954).
  83. Révész, G., The Human Hand (London: Routledge & Kegan Paul, 1958).
  84. Romand, D., “Konrad Lange on ‘the Illusion of Materials’ in painting and visual Arts: revisiting a psychoaesthetic theory of the perception of material properties,” in J. Stumpel., M. Wijntjes, eds., Art and Perception. An International Journal of Art and Perception Science, special issue: The skin of things: On the perception and depiction of materials 7, no. 3-4 (2021): 283-289.
  85. Salisbury, K., Srinivasan, M.A., “Phantom-based haptic interaction with virtual objects,” IEEE (September-October 1997): 6-10, https://doi.org/10.1109/MCG.1997.1626171.
  86. Salisbury, K., Conti, F., Barbagli, F., “Haptic rendering: introductory concepts,” IEEE Computer Society 24, no. 2 (March/April 2004): 24-32, https://doi.org/10.1109/MCG.2004.1274058.
  87. Stanco, F. et al., “Virtual anastylosis of Greek sculpture as museum policy for public outreach and cognitive accessibility,” Journal of Electronic Imaging 26, no. 1 (2017), https://doi.org/10.1117/1.JEI.26.1.011025.
  88. Strauven, W., “Marinetti’s tattilismo revisited hand travels, tactile screens, and touch cinema in the 21st Century,” in R. Catanese, ed., Futurist Cinema, (Amsterdam: Amsterdam University Press, 2018): 69-87.
  89. Strauven, W., Touchscreen Archeology (Lüneberg: Meson Press, 2021).
  90. Subramanian, S., How to Feel. The Science and Meaning of Touch (New York: Columbia University Press, 2021).
  91. Taylor, F., “Recreating sensory experience: how haptic technology could help us experience art in new ways,” UCL Culture Blog, accessed December 11, 2022, retrieved at https://blogs.ucl.ac.uk/museums/2020/07/13/recreating-sensory-experience-how-haptic-technology-could-help-us-experience-art-in-new-ways/.
  92. De Tinguy, X., Pacchierotti, C., Lécuyer, A., “Capacitive sensing for improving contact rendering with tangible objects in VR,” IEEE Trans Vis Comput Graph – IEEE Transactions on Visualization and Computer Graphics 27, no. 4 (December 2020): 2481-2487, https://doi.org/10.1109/TVCG.2020.3047689.
  93. Varchi, Benedetto, Lezzione. Nella quale si disputa della maggioranza delle arti e qual sia più nobile, la scultura o la pittura (Firenze: Fondazione Memofonte, 1547).
  94. Vardar, Y., Kuchenbeker, K.J., Behringer, L., “Challenging the design of electrovibrations to generate a more realistic feel,” Haptic Intelligence Max Planck Institute for Intelligent Systems (April 6, 2021): https://hi.is.mpg.de/news/challenging-the-design-of-electrovibrations-to-generate-a-more-realistic-feel, accessed December 8, 2022.
  95. Vaz, R., Freitas, D., Coelho, A., “Blind and visually impaired visitors’ experiences in museums: increasing accessibility through assistive technologies,” International Journal of the Inclusive Museum 13, no. 2 (June 2020): 57-80, https://doi.org/10.18848/1835-2014/CGP/v13i02/57-80.
  96. Vi, C.T. et al., “Not just seeing, but also feeling art: mid-air haptic experiences integrated in a multisensory art exhibition,” International Journal of Human-Computer Studies, vol. 108 (Elsevier Ltd, 2017) https://doi.org/10.1016/j.ijhcs.2017.06.004.
  97. Wang, D. et al., “Haptic display for virtual reality: progress and challenges,” Virtual Reality & Intelligent Hardware 1, no. 2 (April 2019) https://doi.org/10.3724/SP.J.2096-5796.2019.0008.
  98. Wang, X. et al., “VibroWeight: simulating weight and center of gravity changes of objects in virtual reality for enhanced realism,” Human Computer Interaction (2022), https://doi.org/10.48550/arXiv.2201.07078.
  99. Weiss, T., “Phantom sensations,” in Grunwald M. ed., Human Haptic Perception. Basics and Applications (Basel: Birkhäuser, 2008): 283-294.
Read Article
Published

20 December 2022

DOI:
https://doi.org/10.54103/ai/17297
How to Cite
Bartalesi, V., & Calise, A. (2022). The haptics of illusion. An account of touch across theories, technologies and museums. AN-ICON. Studies in Environmental Images [ISSN 2785-7433], 1(II). https://doi.org/10.54103/ai/17297
Copy

Issue
Vol. 1 No. II (2022): Just an illusion? Between simulation, emulation, and hyper-realism

Metrics

Metrics Loading ...
License
Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.