Who indexed my site?

    Creating a site on Biggo , it is possible to take advantage of another advantage of SaaS - accounting for indexing the site by search robots. Conventional JS-counters or picture-based counters, of course, do not give such an opportunity. In liveinternet there is an opportunity to take into account the requests of search bots, but it is given there “catch-up”, in the express audit section. In addition, in order for this report to work, you must install the proposed PHP code.

    Our system independently collects data to create this report necessary for webmasters and optimizers and displays the results in the form of beautiful interactive graphs. Pie chart showing the shares of different search robots. Robot indexing graph for the last month.
    image


    image


    image
    The indexing chart of the selected robot for the last month and the pages indexed today. You can get into this report by clicking on the desired part of the pie chart.

    We have been collecting statistics data for a long time, but we started doing reports recently, the first to decide to do this one, because It will perfectly complement the information that can be obtained using public meters.

    Technical features



    Data is collected in the MongoDB collection, then it is processed once an hour and converted into a convenient form for creating graphs: In this format, it’s already a matter of technique to build a graph every day - it is efficient and convenient. MongoDB is ideal for this task for at least 3 reasons:
    { "_id" : ObjectId("4c4ec447e555c04d1e002fbf"), "bots" : [
    {
    "num" : 2,
    "bot_name" : "Google"
    },
    {
    "num" : 1,
    "bot_name" : "Nigma"
    }
    ], "bdate" : "2010-07-15", "site_id" : 178 }
    { "_id" : ObjectId("4c4ec448e555c04d1e002fc2"), "bots" : [ { "num" : 10, "bot_name" : "Yandex" } ], "bdate" : "2010-07-15", "site_id" : 250 }
    { "_id" : ObjectId("4c4ec448e555c04d1e002fc4"), "bots" : [ { "num" : 3, "bot_name" : "Twiceler" } ], "bdate" : "2010-07-15", "site_id" : 107 }
    { "_id" : ObjectId("4c4ec446e555c04d1e002fa4"), "bots" : [
    {
    "num" : 6,
    "bot_name" : "Google"
    },
    {
    "num" : 10,
    "bot_name" : "Yahoo!"
    },
    {
    "num" : 9,
    "bot_name" : "Yandex"
    },
    {
    "num" : 5,
    "bot_name" : "MSN"
    },
    {
    "num" : 2,
    "bot_name" : "Twiceler"
    },
    {
    "num" : 1,
    "bot_name" : "Rambler"
    }
    ], "bdate" : "2010-07-15", "site_id" : 133 }




    • Allows you to store nested objects
    • Allows you to set the capped parameter for the collection, so the old data does not need to be deleted, they will be overwritten with new ones
    • Does not load the main postgres base, which has a lot of its own affairs


    Charting Client Library - Open Flash Chart 2

    Also popular now: