Embodied interaction: Multimodality, body and cognition in the analysis of conversations involving individuals with Alzheimer's

This article aims to explore, theoretically and analytically, how we construct multimodal interaction spaces, i.e. how an action (verbal or non verbal) is constructed by virtue of an ecology of sign systems (GOODWIN, 2010) structurally different among themselves, but intrinsically related. For this end, we included some theoretical references in the field of Interaction Studies that understand social interaction and human cognition as embodied (embodied interaction, STREECK et al., 2011). This discussion is based on the microanalysis of two excerpts from conversations involving Alzheimer's patients. The data were extracted from the DALI (Alzheimer's Disease, Language and Interaction) audiovisual corpus. Inspired by videoanalysis research (MONDADA, 2008; KNOBLAUCH et al., 2012), this paper explores the role of the body and gestures in the construction of an interaction space. The analytical focus is on the so-called minimal gestures present in the course of the interaction, and the moments when it is possible to detect a synchronicity between speech and gestures. As a potential contribution, the discussion promoted in this study aims to reflect on a multitude of cognitive resources which are or may be mobilized and analyzed in the construction of face-to-face interaction. KEYWORDS: Embodied interaction. Gestures. Videoanalysis. Ecology. Body. Cognition. Pathologies. Este artigo procura explorar, teorica e analiticamente, como construimos os espacos interacionais multimodalmente, ou seja, como uma acao (verbal ou nao) e construida gracas a uma ecologia (GOODWIN, 2010) de sistemas de signos, estruturalmente distintos entre si, mas intrinsecamente relacionados. Para isso, trazemos alguns referencias teoricos do campo dos estudos interacionais que concebem a interacao social e a cognicao humana de forma corporificada (embodied interaction, STRECK et al., 2011), como uma organizacao temporal, espacial, corporal e materialmente coletiva. Propomos essa discussao com base na analise de dois excertos de conversas envolvendo sujeitos com Alzheimer. Os dados analisados foram extraidos do corpus audiovisual DALI (Doenca de Alzheimer, Linguagem e Interacao). Inspiradas nas pesquisas em video-analises (MONDADA, 2008; KNOBLAUCH et al., 2012), as analises trazidas permitem destacar o papel do corpo e dos gestos na construcao de um espaco interacional. O enfoque analitico recai sobre os chamados gestos minimos localizados no curso da interacao e sobre os momentos em que e p