World Futures through RT’s Eyes: Multimodal Dataset and Methodology

Wilson A, Pavlova I, Payne E, Burenko I, Uhrig P (2024)


Publication Language: English

Publication Type: Journal article, Original article

Publication year: 2024

Journal

Book Volume: 9

Article Number: 1356702

URI: https://www.frontiersin.org/articles/10.3389/fcomm.2024.1356702/full

DOI: 10.3389/fcomm.2024.1356702

Open Access Link: https://www.frontiersin.org/articles/10.3389/fcomm.2024.1356702/full

Abstract

There is a need to develop new interdisciplinary approaches suitable for a more complete analysis of multimodal data. Such approaches need to go beyond case studies and leverage technology to allow for statistically valid analysis of the data. Our study addresses this need by engaging with the research question of how humans communicate about the future for persuasive and manipulative purposes, and how they do this multimodally. It introduces a new methodology for computer-assisted multimodal analysis of video data. The study also introduces the resulting dataset, featuring annotations for speech (textual and acoustic modalities) and gesticulation and corporal behaviour (visual modality). To analyse and annotate the data and develop the methodology, the study engages with 23 26-min episodes of the show ‘SophieCo Visionaries’, broadcast by RT (formerly ‘Russia Today’).

Authors with CRIS profile

Involved external institutions

How to cite

APA:

Wilson, A., Pavlova, I., Payne, E., Burenko, I., & Uhrig, P. (2024). World Futures through RT’s Eyes: Multimodal Dataset and Methodology. Frontiers in Communication, 9. https://doi.org/10.3389/fcomm.2024.1356702

MLA:

Wilson, Anna, et al. "World Futures through RT’s Eyes: Multimodal Dataset and Methodology." Frontiers in Communication 9 (2024).

BibTeX: Download