INTERACTIVE REALITIES
BRIDGING COMPLEX SYSTEMS IN ARTIFICIAL AND NATURAL ENVIRONMENTS
Image © Giulia Chiosini Hambsch
03 March 2022
Centre for Philosophy of Sciences of the University of Lisbon (CFCUL)and via Zoom
Join us for an interdisciplinary workshop in the beautiful city of Lisbon and via Zoom to discuss key questions on how virtual reality and artificial environments impact human self-consciousness and social interactions.
The event will take place on March 3rd, 2023, in a hybrid format, i.e., in person in Lisbon and via Zoom.
The workshop brings together world-leading scholars and junior researchers from philosophy, neuroscience, psychology, robotics, and computational neuroscience to address the following (non-exhaustive) key questions:
i) What is ‘Reality’ and what is ‘Virtual Reality’?
ii) What do we gain and what do we lose by using virtual realities technologies?
iii) What is the relationship between virtual and ‘real’ realities and the human sense of self and embodiment?
iv) What is the relationship between embodied narratives and social interactions in virtual and real environments?
v) What is the impact of interacting with artificial intelligence-based technologies on human mental and social lives?
vi) What is the role of art and virtual reality technologies in shaping neuroplasticity while enhancing body-mind wellbeing?
vii) What is the role of virtual reality technologies in facilitating embodied language learning and social communication in socially impaired populations?
Funding info:
This event is generously funded by:
The Interself project (‘The interacting Self: from Self-Consciousness to Social Interactions in Humans and Artificial Agents’) is funded by Fundaçao para a Ciência e a Tecnologia (FCT PTDC/FER-FIL/4802/2020) to Dr Anna Ciaunica and Prof. Antonia Hamilton.
The Centre for Philosophy of Sciences, University of Lisbon (CFCUL), Portugal (UIDB/00678/2020)
SPEAKERS
Shaun Gallagher (University of Memphis; University of Wollongong (AU))
Ping Li (Hong Kong Polytechnic University)
Anna Ciaunica (Centre for Philosophy of Science, Faculty of Science, University of Lisbon)
Sofia Teixeira (Faculty of Science, University of Lisbon)
Tania Alexandra Couto (Centre for Philosophy of Science, Faculty of Science, University of Lisbon)
Qihui Xu (Basque Center on Cognition, Brain and Language (BCBL), San Sebastián)
Jesper Rorvig (Centre for Philosophy of Science, Faculty of Science, University of Lisbon)
PROGRAM
Date:
Friday, March/03/2023 – 09:00 – 18:30
Venue
Amphitheatre of FCiências.ID & Online live streamed
Faculty of Sciences of the University of Lisbon
Building C1, Floor 3
Campo Grande, Lisbon
Provisional program
| Friday, March/03/2023 | |
| Morning Session | |
| 09:00 – 09:40 | Registration |
| 09:40 – 10:00 | Opening remarks: Anna Ciaunica |
| 10:00 – 11:00 | Ping Li (Hong Kong Polytechnic University): Sensorimotor Integration and Embodied Language Learning in Virtual Interactive Realities: Technology, Data, and the Brain |
| 11:00 – 11:30 | Coffee break |
| 11:30 – 12:30 | Anna Ciaunica (Centre for Philosophy of Science, Faculty of Science, University of Lisbon): Reality + and – |
| 12:30 – 13:00 | Jesper Rorvig (Centre for Philosophy of Science, Faculty of Science, University of Lisbon): Embodied Joint Agency in Human – Robot Interactions |
| 13:00 – 15:00 | Lunch break |
| Afternoon Session | |
| 15:00 – 16:00 | Sofia Teixeira (Faculty of Science, University of Lisbon): Modelling Human Behaviour and Cognition with Network Science |
| 16:00 – 16:30 | Qihui Xu (Basque Center on Cognition, Brain and Language (BCBL), San Sebastián): Does Human Cognition Require Interactive Realities? Insights from Large Language Models |
| 16:30 – 17:00 | Coffee break |
| 17:00 – 17:30 | Tania Alexandra Couto (Centre for Philosophy of Science, Faculty of Science, University of Lisbon): Immersive realities in human minds and social lives: How immersive and interactive realities impact body ownership and joint-agency during social interactions between humans and artificial agents |
| 17:30 – 18:30 | Shaun Gallagher (University of Memphis; University of Wollongong (AU)): Missing in action: Gestures and embodied narratives |
ABSTRACTS
Shaun Gallagher:
Missing in action: Gestures and embodied narratives
Embodied approaches to cognitive development underscore the relevance of narrative in lieu of mentalistic explanations of social cognition. Narrative is considered by some developmental psychologists to be an embodied practice, anchored in early social experiences, perceptions and emotions, providing children the means to understand how others act according to reasons. Relevance given to embodied narrative in developing social cognition has led researchers to explore its ontogeny, often resulting in contrasting theories. Some studies take an nativist approach and define narrative as an invariant generative process. This view argues for the continuity of narrative structure beginning in fetal and neonatal movement, through infant pre-verbal communication, and into linguistic meaning-making in childhood and adulthood. Other studies, while upholding that narrative is anchored in pre-verbal actions, suggest that it must be kept distinct from actions to avoid pan-narrativism and the overlooking of a significant status change in the nature of content (from non-representational to representational). These contrasting views on embodied narrative raise relevant questions about the relation between actions and language: the former suggesting an identity in structure, the latter suggesting a developmental derivation from action structure to narrative structure. Laura Sparaci and I have offered an analysis of the pivotal role of gestures as communicative forms that join action to language. Close analyses of the emergence of communicative gestures in childhood as well as of the recent literature on aproprioception in adults, map the path from actions to narrative through gestures. This path shows structural continuity, but a consistent shift from non-representational to representational processes, moving from functional or instrumental acts to communicative ones, suggesting continuity through change in the passage from action to narrative.
Ping Li:
Sensorimotor Integration and Embodied Language Learning in Virtual Interactive Realities: Technology, Data, and the Brain
In an era of rapid developments in digital technology, we have an opportunity to conduct highly interdisciplinary research that connects human learning experience with digital applications and mind-brain studies. In this talk, I outline an approach that combines emerging technologies with current neuro-cognitive theories, with a particular reference to sensorimotor integration in embodied language learning through virtual interactive realities. I highlight the differences in the context of learning between children (learning native language, L1) and adults (learning a foreign language, L2), and suggest ‘social learning of L2’ (SL2) as a new framework for thinking about L1-L2 differences and the corresponding neural correlates. If social and affective cues can be made available through virtual interactive realities to L2-learning adults, as they are naturally available to L1-learning children, the success of L2 learning may be enhanced. The neural evidence from our work shows that SL2-based learning, as compared with traditional classroom-based learning, can lead to brain network patterns in L2 that are more similar to those underlying L1.
Theoretically, this approach can also help us to gain a deeper understanding of embodied learning and its neural mechanisms. More broadly, our studies suggest that different patterns of neurocognitive representations can result as a function of different approaches towards learning. Combined with the power of big data and machine learning, this approach also sheds light into personalized education, thereby informing pedagogical designs and instructional innovations.
Sofia Teixeira:
Modelling Human Behaviour and Cognition with Network Science
tba
Anna Ciaunica:
Reality + and –
Recent years have seen rapid development of new technologies advocating Virtual Reality (VR) environments as new tools to expand human perception, cognition, and socialness. In this talk I explore and contrast what VR technologies can add but also remove from our day-to-day social interactions. Specifically, I will focus on the neurobiological and phenomenological bases of proximal, multisensory versus distal audiovisual social cognition. I will argue that while VR technologies can make us travel into extraordinary worlds, it can also detach us from our ‘ordinary’ world and bodies. However, while exploring the extraordinary is a fantastic achievement of the human mind, keeping our bodies safe in the ordinary world is a necessary condition for the survival of biological self-organizing systems such as humans. Hence VR worlds and technologies come both with a ‘+’ (plus) and a ‘– ‘ (minus) and both should be carefully considered for potential purposes and impact on our daily lives.
Tania Alexandra Couto:
Immersive realities in human minds and social lives: How immersive and interactive realities impact body ownership and joint-agency during social interactions between humans and artificial agents
tba
Qihui Xu:
Does Human Cognition Require Interactive Realities? Insights from Large Language Models
There has been a long-standing debate regarding the extent to which interactive realities shape human cognition and the degree to which language representation requires grounded cognition (Burgess, 2000). Recent advances in large language models (LLM), such as GPT-3 and chatGPT, have the potential to shed light on this debate. Although these models are trained on massive amounts of text without human embodied experience, they have nevertheless demonstrated human-like behaviors and performance in various psychology tasks (Binz & Schulz, 2023). The LLM’s impressive performance, most recently shown by OpenAI’s chatGPT, may provide an alternative interpretation: human cognition and behavior can emerge from very large data that capture the broad range of linguistic context. To address this problem, we analyzed and compared lexical-semantic representations between humans and chatGPT, including subjective ratings of word concreteness, body-object interaction, imageability, emotionality, and other psycholinguistic attributes. Our findings show that while chatGPT’s and human ratings are similar in some aspects such as word concreteness, they still show differences in aspects more related to embodiment experience such as body-object interaction. These results indicate that there are still gaps between human cognition and representation and what LLMs can derive based on large amount of text with broad linguistic context. As LLM models continue to develop, the picture will become further clearer regarding the limits of LLMs including chatGPT and whether interactive realities are an essential component for human cognition.
Jesper Rørvig:
Embodied Joint Agency in Human – Robot Interactions
Artificial Intelligence-based technologies such as robots are developing at an unprecedented speed in our societies, considerably impacting human lives. In order to better understand this impact, we need to investigate the effect of interacting with these technologies on human mental and social lives. Previous studies on human – robot interaction has showed that humans anthropomorphize robots. In addition, we also spontaneously attribute mental and affective states to, and feel empathy towards robots. However, the impact of interacting with humanoid robots on the human sense of self and sense of body ownership remains an open question. In this talk, I will present the Interself project on Human – Robot Interactions, which aims to unravel the link between sense of body ownership, sense of agency and sense of self, under the different conditions of interacting with either a humanoid robot or another human being.
ORGANIZERS
Anna Ciaunica (Centre for Philosophy of Sciences of the University of Lisbon, Portugal; Institute of Cognitive Science, University College of London, UK)
Tania Alexandra Couto (Centre for Philosophy of Sciences of the University of Lisbon; Faculty of Sciences University of Lisbon, Portugal)
Silvia Di Marco (Centre for Philosophy of Sciences of the University of Lisbon; Faculty of Sciences University of Lisbon, Portugal)
Ana Vilar Bravo (Centre for Philosophy of Sciences of the University of Lisbon, Portugal; Faculty of Sciences University of Lisbon, Portugal)
João Luís Cordovil (Centre for Philoophy of Sciences of the University of Lisbon, Portugal; Faculty of Sciences University of Lisbon, Portugal)
Giulia Chiosini Hambsch (University of Osnabrück)
Jesper Rørvig: (Centre for Philosophy of Sciences of the University of Lisbon; Faculty of Sciences University of Lisbon, Portugal)
Alberto Colombo (Faculty of Science, University of Lisbon, Portugal)
Liberty Severs (University of Sussex, Centre for Philosophy of Sciences of the University of Lisbon; Faculty of Sciences University of Lisbon, Portugal)
Francisca Ayres Ribeiro (Faculty of Science, University of Lisbon)
Pedro Neves (Faculty of Science, University of Lisbon, Portugal)
Madalena Girão (Faculty of Science, University of Lisbon)
Emre Fatih (Berlin School of Mind and Brain)