This paper presents twAwler, a lightweight twitter crawler that targets language-specific communities of users. twAwler takes advantage of multiple endpoints of the twitter API to explore user relations and quickly recognize users belonging to the targetted set. It performs a complete crawl for all users, discovering many standard user relations, including the retweet graph, mention graph, reply graph, quote graph, follow graph, etc. twAwler respects all twitter policies and rate limits, while able to monitor large communities of active users. twAwler was used between August 2016 and March 2018 to generate an extensive dataset of close to all Greek-speaking twitter accounts (about 330 thousand) and their tweets and relations. In total, the crawler has gathered 750 million tweets of which 424 million are in Greek; 750 million follow relations; information about 300 thousand lists, their members (119 million member relations) and subscribers (27 thousand subscription relations); 705 thousand trending topics; information on 52 million users in total of which 292 thousand have been since suspended, 141 thousand have deleted their account, and 3.5 million are protected and cannot be crawled. twAwler mines the collected tweets for the retweet, quote, reply, and mention graphs, which, in addition to the follow relation crawled, offer vast opportunities for analysis and further research.
The extensive use of social media for protest purposes was a distinctive feature of the recent protest events in Spain, Greece, and the United States. Like the Occupy Wall Street protesters in the United States, the indignant activists of Spain and Greece protested against unjust, unequal, and corrupt political and economic institutions marked by the arrogance of those in power. Social media can potentially change or contribute to the political communication, mobilization, and organization of social movements. To what extent did these three movements use social media in such ways? To answer this question a comparative content analysis of tweets sent during the heydays of each of the campaigns is conducted. The results indicate that, although Twitter was used significantly for political discussion and to communicate protest information, calls for participation were not predominant. Only a very small minority of tweets referred to protest organization and coordination issues. Furthermore, comparing the actual content of the Twitter information exchanges reveals similarities as well as differences among the three movements, which can be explained by the different national contexts. Today, a considerable proportion of the public political discourse that proceeds nationwide elections is happening through Online Social Networks. Through analyzing this content, we can discover the major themes that prevailed during the discussion, investigate the temporal variation of positive and negative sentiment and examine the semantic proximity of these themes. According to existing studies, the results of similar tasks are heavily dependent on the quality and completeness of dictionaries for linguistic preprocessing, entity discovery and sentiment analysis. Additionally, noise reduction is achieved with methods for sarcasm detection and correction. Here we report on the application of these methods on the complete corpus of tweets regarding two local electoral events of worldwide impact: the Greek referendum of 2015 and the subsequent legislative elections. To this end, we compiled novel dictionaries for sentiment and entity detection for the Greek language tailored to these events. We subsequently performed volume analysis, sentiment analysis and sarcasm correction. Results showed that there was a strong anti-austerity sentiment accompanied with a critical view on European and Greek political actions.