IACS 2024 - Conceptual generalizations of multimodal metaphor expressions
IACS 2024 - Conceptual generalizations of multimodal metaphor expressions
The central research question posed here is whether, and under what circumstances, the
metaphorical conceptualizations we derive from linguistic expressions and vice versa apply to
cases of multimodal metaphors in the process of meaning making. Specifically, in cognitive
linguistics, the phenomenon of conceptual mapping between metaphorical domains, which
leads to a number of associated linguistic realizations, has been thoroughly explained and
confirmed theoretically and through corpus research so far. However, researchers' attention
has recently been drawn more to the phenomenon of multimodality in communication,
metaphors included, particularly with the advancement of digital technologies. As a result, the
ground-breaking work of Charles Forceville (1996) was largely responsible for the first
recognition of visual metaphor in a variety of genres, and later interest was expanded to
include its multimodal expressions. Unfortunately, not much corpus research has been done in
this area, but the available material can be used to identify inconsistencies in the identification
process as well as in the associated taxonomies. It appears that such research is mostly kept at
the expression level, so multimodal metaphors are frequently recognized and annotated
superficially, while the question of their conceptual generalizations, which have been well
described through language examples, largely escapes the authors' attention. To resolve this
issue, or at the very least to suggest potential solutions, two currently dominant models of
identifying multimodal metaphors will be used as a theoretical template: the previously
mentioned Forceville's linguistic model and the marketing approach developed by Phillips
and McQuarrie (2004), combined with the VisMet online database of visual and multimodal
metaphors for the analysis. The already recognized inconsistencies in the current annotations
regarding the level of metaphorical expression will be highlighted (Sušac, 2022), as well as
the possibilities of their conceptualizations that could generate different multimodal
realizations, similar to the process already recognized in language samples. The assumption is
that such an approach can have a high application value, primarily in the field of advertising,
i.e. for different displays of the same product or for different products with equal or similar
conceptual mappings.
References
Bolognesi, M. & van Den Heerik, R. & E. van Den Berg, E. (2018). VisMet 1.0: An online
corpus of visual metaphors. In G. Steen (eds.), Visual metaphor: Structure and process, 89–
113. Amsterdam: John Benjamins.
Kress, G. & Van Leeuwen, T. (2006). Reading images: The grammar of visual design.
London: Routledge.
Lakoff, G. & M. Johnson. (1980). Metaphors we live by. Chicago/London: The University of
Chicago Press.
Phillips, B. & McQuarrie, E. (2004). Beyond visual metaphor: a new typology of visual
rhetoric in advertising, Marketing Theory 2004; 4; 113–136.
Steen, G. J. (eds.). (2018). Visual metaphor: Structure and process. Amsterdam: John
Benjamins.