MGMLaboratory
Back

Menu

01Home
02About Us
03Projects
04Publications
05Member
06Articles
07Contact

Let's Talk

Open in Mail app

Socials

Malang (ID) --:--Privacy PolicyTerms of Service

February 15, 20181 min read

Why a Like Carries Less Weight Than a SentenceWhy a Like Carries Less Weight Than a Sentence

Engagement counts help sentiment models only after they are filtered and weighted.

  • Journal
  • Publications

Written by

  • SRShirasaka RenIT & Infrastructure · Student Member

In this article

  1. 01Filter, then weight
  2. 02What the tuning showed

Numeric engagement data is tempting precisely because it is easy to collect. A like is a number, a retweet is a number, and both arrive without any parsing. The trouble is that a number is not an opinion, and a model that leans on it too hard will learn the wrong thing.

The platform supplies the reaction, not just the text. Image: MainlyTwelve, CC BY-SA 4.0, via Wikimedia Commons.
Fig. 01The platform supplies the reaction, not just the text. Image: MainlyTwelve, CC BY-SA 4.0, via Wikimedia Commons.

01/02

Filter, then weight

The approach in this study does the two steps in that order. Fisher Score first ranks which engagement features are worth keeping, cutting the ones that say little about sentiment. Only then does the model decide how much each family of features should count.

That second decision takes the form of two weights, alpha for the text side and beta for the engagement side. Rather than guessing, the team ran the experiment across combinations and read the F1 score at each setting.

Reactions are cheap to count but hard to interpret. Image: Rawpixel, CC0, via Wikimedia Commons.
Fig. 02Reactions are cheap to count but hard to interpret. Image: Rawpixel, CC0, via Wikimedia Commons.

02/02

What the tuning showed

The winning setting kept the larger share on the text, at 0.6 against 0.4, and produced an F1 score of 0.838. The gap between the two weights is not dramatic, and that is the interesting part. Engagement data adds something real, but it does not take over the decision.

  • Screen non textual features before adding them, not after
  • Treat text and engagement as separate families with separate weights
  • Report the score at each setting so the tradeoff stays visible

Anyone working with social data can carry one habit out of this. A reaction metric measures the audience as much as the message, so it belongs in the model beside the words rather than in place of them.

Source

  1. Rizal Setya Perdana and Aryo Pinandito (2018). Combining Likes-Retweet Analysis and Naive Bayes Classifier within Twitter for Sentiment Analysis. Journal of Telecommunication, Electronic and Computer Engineering.

Next articlePython, PHP, or Ruby for a Genetic Algorithm(Keep scrolling)(Read it next)(Loading)