TY - JOUR
T1 - Event detection in Twitter
T2 - A machine-learning approach based on term pivoting
AU - Kunneman, Florian
AU - Bosch, Antal Van Den
PY - 2014/1/1
Y1 - 2014/1/1
N2 - The large number of messages on Twitter posted each day provide rich insights into real-world events and public opinion. However, it is difficult to automatically distinguish tweets referring to such events from everyday chatter, and subsequently to distinguish significant events affecting many people from insignificant events. We apply a term-pivot approach to event detection from the Twitter stream. In order to filter out noisy and mundane events, we train a machine learning classifier on several rich features, and rank the events based on classifier confidence. After training and re-training the classifier using manually annotated data, we obtain an Fβ=1 score of 0.79. However, a baseline that only takes into account the frequency of the tweets that refer to an event yields a better Fβ=1 score of 0.86. We argue that performance is highly related to the definition of what makes a significant event, and that human understanding of this concept is not uniform.
AB - The large number of messages on Twitter posted each day provide rich insights into real-world events and public opinion. However, it is difficult to automatically distinguish tweets referring to such events from everyday chatter, and subsequently to distinguish significant events affecting many people from insignificant events. We apply a term-pivot approach to event detection from the Twitter stream. In order to filter out noisy and mundane events, we train a machine learning classifier on several rich features, and rank the events based on classifier confidence. After training and re-training the classifier using manually annotated data, we obtain an Fβ=1 score of 0.79. However, a baseline that only takes into account the frequency of the tweets that refer to an event yields a better Fβ=1 score of 0.86. We argue that performance is highly related to the definition of what makes a significant event, and that human understanding of this concept is not uniform.
UR - https://research.vu.nl/en/publications/cec49cba-6eb2-41e7-bd1d-65d3f974362f
M3 - Article
SN - 1568-7805
SP - 65
EP - 72
JO - Belgian/Netherlands Artificial Intelligence Conference
JF - Belgian/Netherlands Artificial Intelligence Conference
ER -