36.304, Reviews: Multimodality and Translanguaging in Video Interactions: Caron (2025)

[The LINGUIST List]

LINGUIST List: Vol-36-304. Wed Jan 22 2025. ISSN: 1069 - 4875.

Subject: 36.304, Reviews: Multimodality and Translanguaging in Video Interactions: Caron (2025)

Moderator: Steven Moran (linguist at linguistlist.org)
Managing Editor: Justin Fuller
Team: Helen Aristar-Dry, Steven Franks, Joel Jenkins, Daniel Swanson, Erin Steitz
Jobs: jobs at linguistlist.org | Conferences: callconf at linguistlist.org | Pubs: pubs at linguistlist.org

Homepage: http://linguistlist.org

Editor for this issue: Joel Jenkins <joel at linguistlist.org>

================================================================


Date: 22-Jan-2025
From: Joffrey Caron [joffreycaron at gmail.com]
Subject: Applied Linguistics; Multimodality and Translanguaging in Video Interactions: Caron (2025)


Book announced at https://linguistlist.org/issues/35-769

Title: Multimodality and Translanguaging in Video Interactions
Series Title: Elements in Applied Linguistics
Publication Year: 2023

Publisher: Cambridge University Press
           http://www.cambridge.org/linguistics
Book URL: https://cambridge.org/9781009286923

Author(s): Maria Grazia Sindoni

Reviewer: Joffrey Caron

SUMMARY
Section 1: Introduction
The author situates her discussion on VMC (video-mediated
communication) in the context of the Covid-19 pandemic, highlighting
how this event accelerated the adoption of technology and revealed the
challenges and opportunities it presents. She also emphasizes the need
for further research to fully understand the interactional dynamics
specific to VMC. Indeed, she points out that while pedagogical and
technical aspects have been extensively documented by research, few
studies have analyzed how video-based teaching and learning differs
semiotically from traditional offline teaching. This is the starting
point and the rationale for her work. After a brief literature review
on VMC, she presents the theoretical framework on which her analysis
will be based: the combination of multimodality and translanguaging,
which she presents as an approach suited to the intrinsic richness of
multilingual, multisemiotic, and multimodal communication. The
introduction concludes with a presentation of the datasets used
throughout the book (over 900 hours, diverse, and rich in content).
Section 2 : Familiar, Reconfigured, and Emergent Uses of Speech and
Writing
This section explores how the affordances of speech and writing are
reconfigured in video interactions. The author aims to determine
whether the traditional distinction between speech and writing remains
relevant in this new context. In video interactions, the boundaries
between speech and writing blur, with participants frequently
alternating between the two modes. This alternation, referred to as
"mode-switching," is influenced by the specific affordances of video
platforms, such as the ability to insert written text into oral
conversations, among other possibilities. The author examines its
communicative function and how speakers take advantage of it. She
demonstrates that participants utilize it for pragmatic and social
reasons, such as creating intimacy, maintaining secrecy, having fun or
joking, or providing references. The practice is influenced by the
social context and communication norms. She concludes by emphasizing
that video-mediated communication (VMC) contributes to the
hybridization of speech and writing, allowing speakers to use writing
to reinforce their oral discourse.
Section 3: Translanguaging Practices as Meaning-Making Resources
This section examines how translanguaging practices contribute to the
creation of meaning in video interactions. The author presents
translanguaging as a common phenomenon in these contexts, reflecting
the multimodal and multilingual nature of communication. She begins by
exploring the historical context of translanguaging, highlighting its
evolution in the fields of bilingual education and applied
linguistics. The chapter then analyzes examples of translanguaging
drawn from video interactions in both educational and informal
contexts. She argues that translanguaging goes beyond mere
"code-switching," involving a strategic use of languages to negotiate
meaning and manage interpersonal relationships. Social semiotics,
which emphasizes the role of signs and symbols in meaning-making, is
presented as a relevant framework for understanding translanguaging.
Section 4: The Repurposing of Gaze in Video-Mediated Scenarios
The author demonstrate how gaze—a key element of non-verbal
communication—is reconfigured and reassigned in the context of video
interactions, pointing out its role in regulating turn-taking and
conveying non-verbal information. In video interactions, gaze is
constrained by the affordances of the platforms, leading to patterns
that differ from those observed in face-to-face interactions. The
reduction of visibility and the non-reciprocal nature of gaze can
result in difficulties in interpretation and misunderstandings:
participants develop new strategies to manage gaze, adapting to the
platform's constraints and using it strategically to achieve
communicative goals. The author also presents self-looking, or the
tendency to focus on one’s own image, as a common phenomenon in video
interactions, influenced by the desire to manage one’s appearance.
Section 5: The On-Screen Distribution of Movement and the Construction
of Distance
In this section, the author analyzes how bodily movements and
proxemics are utilized to construct distance and meaning in video
interactions. Kinesics and proxemics patterns are essential elements
of non-verbal communication, but their affordances are altered in the
context of video interactions. The camera's framing and the reduced
screen size limit the amount of kinesic and proxemic information
available, potentially leading to ambiguities and misunderstandings.
This section underscores the importance of intercultural awareness in
avoiding misunderstandings related to proxemics in video interactions.
Participants adapt to these constraints by employing specific kinesic
and proxemic strategies to communicate effectively. Virtual proxemics
is influenced by cultural and social factors, resulting in variations
in the perception of distance and intimacy. Additionally, this section
provides an overview of theories of kinesics and proxemics in
face-to-face communication, emphasizing their roles in conveying
non-verbal information and managing interpersonal relationships.
Section 6: Conclusions
This section synthesizes the main arguments and conclusions of the
book, emphasizing the significance of a multimodal and translanguaging
approach to understanding video interactions. The author notes that
further research is needed to explore the impact of digital
technologies on communication and to comprehend how individuals adapt
to new communication environments, such as the metaverse.
EVALUATION
In this book, the author addresses a timely need: since the COVID-19
pandemic, a significant portion of humanity has had to shift abruptly
from face-to-face to video-mediated communication (VMC). This shift
has had far-reaching consequences, as communication—often
professional—now frequently occurs in private spaces, with calls
taking place at home, which influences how people interact with
others. The book succeeds in explaining how VMC, while appearing to
replicate face-to-face communication, transforms interaction by
reconfiguring the resources available to participants. It provides an
analysis of VMC's specificities, aiming to harness its affordances
while mitigating its limitations—a goal that seems of importance for
educational and professional purposes.
To do so, the author examines how embodied interactions, as well as
the use of speech, writing, translanguaging practices, gaze, and
proxemic and kinesic patterns, contribute to the construction of
meaning in the context of video communication. The characteristics of
virtual environments—such as the reduction of visual cues—lead to a
reliance on other communication strategies, resulting in the use of a
wide range of semiotic resources that can be employed to construct
meaning apart from or alongside language. In particular, the author
analyzes kinesics and proxemics as functioning in parallel with
language, making them analyzable in isolation. Additionally, her
analysis of mode-switching, that she defines as a specific affordance
of this communication medium, offers insights that merit attention.
The author adopts a robust scientific approach to explore
multimodality and translanguaging in video interactions. She employs a
qualitative approach, utilizing empirical data collected over ten
years from various sources. Regarding methodology, the author
approaches hers through what she describes as the "common reformist
agenda," a concept she elaborates on over several pages, addressing
both the position of multimodality against logocentrism and that of
translanguaging against ethnocentric monoglossia. While these two
approaches are not always unified, this bifocal perspective enriches
the author’s analysis, making this book a compelling testament to the
relevance of this theoretical framework.
By analyzing video interactions through her framework, the author
highlights the distinct aspects of mediated communication compared to
face-to-face interactions. She underscores the importance of
considering the affordances of digital platforms alongside the
constraints they impose on communication modes. Her examination of
gaze, gestures, and proxemics sheds light on how individuals construct
a sense of presence and intimacy, even through technological
mediation. This approach enables her to explore several interdependent
dimensions, such as the varied uses of writing and their effects on
users (including feelings of security, divided attention, and complex
conversational flow), as well as the impact of code-switching and the
ease with which speakers understand each other.
In discussing translanguaging, the author carefully addresses a common
misconception—that translanguaging is simply the use of an
individual’s linguistic repertoire to express themselves. This
misconception often limits our understanding of translanguaging to
practice that overlooks its social and interactive nature.
Translanguaging is a socially constructed and co-constructed practice,
in which each participant adjusts their language choices in response
to those of others. This adjustment is not a passive reaction but
rather an active, reciprocal engagement with the linguistic cues and
choices of interlocutors, creating a fluid and adaptive communication
process.
Translanguaging is therefore a dynamic, creative form of
communication, requiring speakers to consider the entire ecology of
the interaction—its context, participants, and objectives—when
deciding how to use language effectively. This approach demands an
acute attention to the linguistic, cultural, and social elements
present within the conversation. The author effectively articulates
these aspects by exploring key concepts of translanguaging, using
examples to illustrate how speakers draw on multiple languages and
weave them together in ways that go beyond simple code-switching. For
instance, an extreme example of translanguaging space is the “Main
Camfrog room” chat room, from which the author examines a short
excerpt where people communicate with each other in Thai, English,
Tagalog, Uzbek, and Gujarati. Micro-conversations occur simultaneously
and overlap, with speakers talking to each other at the same time,
both speaking and writing, and adapting their language choices to each
interlocutor accordingly.
In summary, this book makes an excellent contribution to its field of
research, serving as both an introduction and an illustration of a
comprehensive and enriching approach. The author draws on several
corpora, and the total size of her data enables her to analyze
numerous aspects of video communication with significant depth.
Furthermore, although the book is short, it is not superficial; it
offers thorough and informative analyses within the constraints of its
length – said length being, it seems, dictated by the “Elements
series” format of Cambridge University Press. In each section, the
author presents research questions and addresses them clearly and
comprehensively, avoiding jargon-laden explanations, which makes the
book accessible to a wide range of readers, including students.
In conclusion, the author’s work not only emphasizes the critical
importance of multimodality and translanguaging in video communication
but also highlights the need for further exploration of these themes.
By prioritizing these perspectives, she invites researchers to
consider the implications of the growing prevalence of video
communication in everyday life, spanning personal, educational, and
professional contexts. Her emphasis on multimodal and translanguaging
practices contributes to ongoing discussions in conversation analysis,
semiotics, and the social sciences more broadly. Ultimately, the book
stands as a compelling testament to the relevance and applicability of
its theoretical framework, encouraging future research.
ABOUT THE REVIEWER
Joffrey Caron is a PhD candidate and adjunct professor at the
University of Castilla-La Mancha in Spain. His research interests lie
at the crossroads of multimodal conversation analysis, game studies,
and second-language acquisition. His dissertation focuses on the
interactions of French as a foreign language (FLE) learners within
video game contexts, specifically investigating the dynamics of
cooperation and meaning negotiation.



------------------------------------------------------------------------------

********************** LINGUIST List Support ***********************
Please consider donating to the Linguist List to support the student editors:

https://www.paypal.com/donate/?hosted_button_id=87C2AXTVC4PP8

LINGUIST List is supported by the following publishers:

Bloomsbury Publishing http://www.bloomsbury.com/uk/

Cambridge University Press http://www.cambridge.org/linguistics

Cascadilla Press http://www.cascadilla.com/

Elsevier Ltd http://www.elsevier.com/linguistics

John Benjamins http://www.benjamins.com/

Language Science Press http://langsci-press.org

Multilingual Matters http://www.multilingual-matters.com/

Netherlands Graduate School of Linguistics / Landelijke (LOT) http://www.lotpublications.nl/

Wiley http://www.wiley.com


----------------------------------------------------------
LINGUIST List: Vol-36-304
----------------------------------------------------------