I Have No Text in My Post: Using Visual Hints to Model User Emotions in Social Media

Title
I Have No Text in My Post: Using Visual Hints to Model User Emotions in Social Media
Author
한경식
Keywords
Emotion analysis; social media images; visual hints
Issue Date
2022-04
Publisher
Association for Computing Machinery, Inc
Citation
WWW 2022 - Proceedings of the ACM Web Conference 2022, Page. 2888-2896
Abstract
As an emotion plays an important role in people's everyday lives and is often mirrored in their social media use, extensive research has been conducted to characterize and model emotions from social media data. However, prior research has not sufficiently considered trends of social media use - the increasing use of images and the decreasing use of text - nor identified the features of images in social media that are likely to be different from those in non-social media. Our study aims to fill this gap by (1) considering the notion of visual hints that depict contextual information of images, (2) presenting their characteristics in positive or negative emotions, and (3) demonstrating their effectiveness in emotion prediction modeling through an in-depth analysis of their relationship with the text in the same posts. The results of our experiments showed that our visual hint-based model achieved 20% improvement in emotion prediction, compared with the baseline. In particular, the performance of our model was comparable with that of the text-based model, highlighting not only a strong relationship between visual hints of the image and emotion, but also the potential of using only images for emotion prediction which well reflects current and future trends of social media use.
URI
https://dl.acm.org/doi/10.1145/3485447.3512009https://repository.hanyang.ac.kr/handle/20.500.11754/177152
DOI
10.1145/3485447.3512009
Appears in Collections:
COLLEGE OF ENGINEERING[S](공과대학) > INTELLIGENCE COMPUTING(데이터사이언스전공) > Articles
Files in This Item:
There are no files associated with this item.
Export
RIS (EndNote)
XLS (Excel)
XML


qrcode

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

BROWSE