The Structure of Multimodal Documents: An Empirical Approach

ISBN-13: 9781138824744 / Angielski / Twarda / 2015 / 240 str.

Tuomo Hiippala

Opis

This book develops a new framework for describing the structure of multimodal documents: how language, image, layout and other modes of communication work together to convey meaning. Building on recent research in multimodal analysis, functional linguistics and information design, the book examines the textual, visual, and spatial aspects of page-based multimodal documents and employs an analytical model to describe and interpret their structure using the concepts of semiotic modes, medium and genre. To demonstrate and test this approach, the study performs a systematic, longitudinal analysis of a corpus of multimodal documents within a single genre: an extensively annotated corpus of tourist brochures produced between 1967-2008. The book provides multimodal discourse analysts with methodological tools to draw empirically-based conclusions about multimodal documents, and will be a valuable resource for researchers planning to develop and study multimodal corpora.

Spis treści

1. Introduction  2. Understanding page-based media  3. An empirical approach to multimodality  4. Genre: perspectives and patterns  5. Working with multimodal corpora  6. The medium and its characteristics  7. The content and its structure  8. The page and its interpretation  9. Multimodal artefacts in digital media  10. Conclusions and outlook

O autorze

Tuomo Hiippala is a post-doctoral researcher at the Centre for Applied Language Studies at the University of Jyväskylä, Finland. He holds a PhD in English philology from the University of Helsinki. He has published internationally in a number of journals and collections, such as Journal of Pragmatics and Literary and Linguistic Computing.