Beyond Words: Towards a Multimodal Model of Subtitle Analysis

Abstract

The present article highlights the importance of adopting a multimodal approach to subtitle analysis in audiovisual translation (AVT) research. While existing studies have predominantly focused on verbal and textual dimensions, they have often underestimated the relevance of the interaction between linguistic, visual, and acoustic modes in audiovisual texts. To address this gap, the study adopts a multimodal perspective that conceptualizes subtitling as the outcome of meaning-making processes unfolding across multiple semiotic channels. In this regard, a subtitled excerpt from Hicham Ayouch’s 2021 comedy film Abdelinho was analyzed by using a modified version of Taylor’s (2016) multimodal transcription model (MT). The findings reveal that subtitling decisions are not shaped by language alone but are also influenced by multimodal and cinematic cues, resulting in shifts, omissions, or compensations across semiotic modes.