Cybervisuals or the meaning of memes: multimodal perception, emotion and meaning-attribution to digital imagery
Author(s) / Creator(s)
Müller, Marion G.
Barth, Christof
Christ, Katharina
Abstract / Description
Recently, viral internet memes have become a hot topic in mass media research (e.g., Shifman, 2013, 2014; Gal et al., 2016; Marcus & Singer, 2017; Ross & Rivers, 2017; Nissenbaum & Shifman 2017, 2018; Babic & Volarevic, 2018; Lobinger et al., 2019). The scope of research ranges from entertaining to political memes on a global scale, mostly assessing the types and contents of memetic communication. This paper proposes a mixed-method approach combining an eyetracking experiment, and a self-report questionnaire with the intention of improving the understanding of perception, evaluation and meaning-attribution processes of internet memes. These new forms of communication and expression in a multimodal, yet predominatly visual online format have long left the merely interpersonal communication realm. Viral memes constitute a societally and politically relevant global communication format that is still understudied in terms of the meanings generated and attributed to them. Theoretically, this between-participants experiment builds on the Visual Communication Process Model (VCPM-Model) developed by Müller et al. (2012), focusing on the major visual communication processes from perception to meaning-attribution to emotional evaluation. Valence, emotion- and meaning-attribution are the key variables that are being tested in this experiment. Building on results from previous research on press photography, one key question is how valence, emotion and meaning are influenced by text and/or by visual elements of the meme stimuli. In an eyetracking experiment using TobiiPro3-Lab soft- and hardware, 30 participants (XF/XM) are viewing 20 text-visual experimental stimuli all downloaded from publicly accessible online sites in a randomized condition. Each stimulus has been manipulated to provide both a positive and a negative version by using a generic image software to modify the textual elements of each meme. Postive and negative versions are randomized, and equally distributed among the participants. Participants evaluate three aspects of visual communication: Whether the meme has a positive, negative or neutral meaning (valence), what kind of emotion is depicted, which emotional reaction is elicited by the stimulus (emotion-attribution) and what is the meaning association for each meme (meaning-attribution). While valence and emotion are being tested in the eyetracking experiment, meaning-attribution is being tested through the post-experimental survey.
Persistent Identifier
Date of first publication
2021-03-10
Publisher
PsychArchives
Citation
Müller, M. G., Barth, C., & Christ, K. (2021). Cybervisuals or the meaning of memes: multimodal perception, emotion and meaning-attribution to digital imagery. PsychArchives. https://doi.org/10.23668/PSYCHARCHIVES.4702
-
FIN-RESEARCH REPORT_Cybervisuals_ZPID_MüllerBarthChrist_090321.pdfAdobe PDF - 393.02KBMD5: 7f4e14c740d13c233bf2165e94b4fecf
-
There are no other versions of this object.
-
Author(s) / Creator(s)Müller, Marion G.
-
Author(s) / Creator(s)Barth, Christof
-
Author(s) / Creator(s)Christ, Katharina
-
PsychArchives acquisition timestamp2021-03-10T15:56:16Z
-
Made available on2021-03-10T15:56:16Z
-
Date of first publication2021-03-10
-
Abstract / DescriptionRecently, viral internet memes have become a hot topic in mass media research (e.g., Shifman, 2013, 2014; Gal et al., 2016; Marcus & Singer, 2017; Ross & Rivers, 2017; Nissenbaum & Shifman 2017, 2018; Babic & Volarevic, 2018; Lobinger et al., 2019). The scope of research ranges from entertaining to political memes on a global scale, mostly assessing the types and contents of memetic communication. This paper proposes a mixed-method approach combining an eyetracking experiment, and a self-report questionnaire with the intention of improving the understanding of perception, evaluation and meaning-attribution processes of internet memes. These new forms of communication and expression in a multimodal, yet predominatly visual online format have long left the merely interpersonal communication realm. Viral memes constitute a societally and politically relevant global communication format that is still understudied in terms of the meanings generated and attributed to them. Theoretically, this between-participants experiment builds on the Visual Communication Process Model (VCPM-Model) developed by Müller et al. (2012), focusing on the major visual communication processes from perception to meaning-attribution to emotional evaluation. Valence, emotion- and meaning-attribution are the key variables that are being tested in this experiment. Building on results from previous research on press photography, one key question is how valence, emotion and meaning are influenced by text and/or by visual elements of the meme stimuli. In an eyetracking experiment using TobiiPro3-Lab soft- and hardware, 30 participants (XF/XM) are viewing 20 text-visual experimental stimuli all downloaded from publicly accessible online sites in a randomized condition. Each stimulus has been manipulated to provide both a positive and a negative version by using a generic image software to modify the textual elements of each meme. Postive and negative versions are randomized, and equally distributed among the participants. Participants evaluate three aspects of visual communication: Whether the meme has a positive, negative or neutral meaning (valence), what kind of emotion is depicted, which emotional reaction is elicited by the stimulus (emotion-attribution) and what is the meaning association for each meme (meaning-attribution). While valence and emotion are being tested in the eyetracking experiment, meaning-attribution is being tested through the post-experimental survey.en
-
CitationMüller, M. G., Barth, C., & Christ, K. (2021). Cybervisuals or the meaning of memes: multimodal perception, emotion and meaning-attribution to digital imagery. PsychArchives. https://doi.org/10.23668/PSYCHARCHIVES.4702en
-
Persistent Identifierhttps://hdl.handle.net/20.500.12034/4157
-
Persistent Identifierhttps://doi.org/10.23668/psycharchives.4702
-
Language of contenteng
-
PublisherPsychArchivesen
-
Is related tohttps://doi.org/10.23668/psycharchives.2653
-
Is related tohttps://doi.org/10.23668/psycharchives.4803
-
Dewey Decimal Classification number(s)150
-
TitleCybervisuals or the meaning of memes: multimodal perception, emotion and meaning-attribution to digital imageryen
-
DRO typereporten