Series: Big Data - like a dream. 2nd series. Big Data Negative or Positive?

    When are you more often angry - in the morning, afternoon, or in the evening? Could Skolkovo’s losses on early reduction of investments in “unsuccessful” 50-70 startups be reduced? Where to move to live? You can ask other probabilistically uncertain questions and tasks - each of us has such a million. Often, Big Data technologies allow ... no, it’s not solved, but the right approach to the problem as a whole, to look from the height of the Demiurge, to pose the right questions and build more optimal ways of a practical solution.

    In the comments on the 1st series, ServPonomarev asked an interesting question about the cases of obtaining new meta-knowledge from Big Data. We suggest even going a little further: new technologies can not only gain new knowledge, but also, in a demiurgical way, affect the environment with new knowledge.

    To begin with, answer yourself one question: " How many times are more negative than social positives in social networks? 2, 5, 10 times? Or can it be all the same about the same?" We all know that social networks are a real cesspool of negativity, it remains to check the depth of the fall of mankind. But only grant “scientists” or in the form of a “technological branch” of practical tasks can afford to engage in such nonsense.

    The task of geolocating "messages" in VK, FB, Twitter, OK, Instagram and other social networksnon-FourSqure type - one of the serious commercial needs, requiring non-trivial solutions and massive global testing. Good executives, of course, try to “get a fat” with any costs. A couple of years ago, Natalya Sokolova, the head of Brand Analytics, came up with the idea of ​​a practical application for testing a new powerful geo-module - this is how the popular regular study “Love and Hate in the Russian Regions” was born, the results of which are reprinted with pleasure by the mass of regional and federal press and social network users, and governors use in their reports. The latest study for the winter of 2014-2015 -

    Data for the study - more than half a BILLIONMessages for 2 weeks of December from 35 million Russian authors. It is clear that the results of the study are the tip of the iceberg, and people with an analytical mind and Mendeleev’s syndrome can independently “dig up” a lot of additional interesting information by comparing with other data. For example, to evaluate the volume of data on specific social networks from public online statistics of the social media data aggregator - . We will definitely talk about the unique features of social media data aggregation technology in one of the series, this is a huge and interesting technology market - it is not for nothing that Apple “stole” TopSy from Twitter for $ 200 million, Twitter was forced to buy gnip in retaliation, and FB does marketing insights with DataSift .

    Returning to “Love and Hate”: asking hundreds of acquaintances the initial question (“How many times are more negative than positive?”) They only once heard the answer that “There is probably more positive”. The study shows that positive in the statements of users of social networks in Russian social networks is MORE negative on average 4 times!

    Two aspects at the end of the series:

    1. A month and a half ago, a study of “scientists” linguists on the positive mood of humanity as a whole was published: - the study itself, a Russian-language interpretation of the results - lenta .ru / news / 2015/02/10 / positive

    Such studies require serious methodology and linguistic study. Brand Analytics publishes the “Love and Hate” study in a semi-annual mode, because society is changing slowly and a high frequency FOR STUDY is not needed. Speed ​​is needed to MONITOR a changing situation and trend surges (such as the Chelyabinsk meteorite). It takes only 1-2 days of Big Data analysts to prepare the study, because there are appropriate technologies for processing unstructured Big Data (linguistics, tonality, NER, geo-referencing), which we will also talk about in more detail later.

    2. In our opinion, the most important and unexpected result: Each subsequent six-month study shows an increase in positivity in social networks in Russia! Positive feedback has been created: millions of people - billions of messages - Big Data technologies - research - thousands of publications in social media (media, forums, social networks) - tens of thousands of comments, discussions, oaths “now I will write only positive thoughts in my public” - growth positive for millions of people ... Man - was and is a herd creature :-)

    A brief summary of the 2nd series: Big Data - a lake of data, but to catch a tasty fish, you need some initial information - the right questions: why were you next to the lake? why do you need fish? what color, size, from what depth do you need fish? Then you will get half the answer: whether you need a fishing rod or a spinning rod, a sinker or a float, a boat or “from the shore”. Bon Appetit!

    In the next series, we will definitely tell about Big Data analysts: firstly, our colleagues are constantly looking for those (while BD analysis is more art than skill, and hundreds of those who call themselves as such do not sufficiently separate themselves and the “system” or are used to working in a more relaxed mode (week-month-quarter, not seconds-minutes-hours); secondly, after the first series, 5 requests came with questions about Big Data analytics - and we try to follow the signals of interest.

    1st series: Big Data - how Dream
    Series 3: Obama Button

    Also popular now: