Comparison of MaxMind and Sypex

No, it's not about speed, there have already been such comparisons . And I wanted to compare the output of different databases on the same data set. And not countries (this is normal for everyone), but cities.

For comparison, the following databases were used:
  1. MaxMind: GeoLite2 City, October 9, 2015
  2. Sypex: Sypex Geo City, October 5, 2015

IP from internal logs was used, a little - only 28012 pieces, mainly Russian. But this amount was enough to get interesting results.

To begin with, both bases could not cope with six addresses, that is, they did not determine either the city or the country:

  1. 96.47.226.20
  2. 141.0.14.15
  3. 141.0.14.199
  4. 141.0.14.29
  5. 141.0.14.174
  6. 195.160.253.4

Additionally Sypex did not define anything for 53 IP:

list
  1. 45.33.149.6
  2. 45.64.9.238
  3. 45.79.152.156
  4. 45.79.139.163
  5. 65.49.14.165
  6. 65.49.14.85
  7. 65.49.14.94
  8. 65.49.14.59
  9. 65.49.14.60
  10. 65.49.14.156
  11. 65.49.14.87
  12. 104.128.144.131
  13. 104.152.128.187
  14. 104.156.222.206
  15. 104.238.180.234
  16. 104.45.92.166
  17. 131.0.160.14
  18. 131.221.208.2
  19. 138.122.142.18
  20. 138.204.27.157
  21. 141.0.15.155
  22. 160.176.232.3
  23. 162.252.188.138
  24. 172.77.39.227
  25. 172.78.141.158
  26. 172.79.136.230
  27. 177.235.49.236
  28. 177.92.13.51
  29. 177.92.20.134
  30. 179.105.241.151
  31. 185.104.215.108
  32. 185.112.142.213
  33. 185.81.157.159
  34. 185.91.178.161
  35. 185.91.179.83
  36. 185.91.178.227
  37. 185.91.179.196
  38. 185.91.178.52
  39. 185.91.178.66
  40. 185.91.179.193
  41. 185.91.179.106
  42. 185.91.179.237
  43. 185.91.178.186
  44. 185.91.178.69
  45. 185.91.179.4
  46. 185.91.179.173
  47. 185.91.178.10
  48. 185.92.73.126
  49. 185.95.104.234
  50. 185.97.165.245
  51. 185.97.165.11
  52. 191.37.63.14
  53. 201.140.240.254


MaxMind - for 78:

list
  1. 66.249.81.157
  2. 66.249.81.153
  3. 66.249.93.163
  4. 66.249.93.146
  5. 66.249.93.153
  6. 66.249.93.154
  7. 66.249.93.157
  8. 66.249.93.150
  9. 66.249.93.161
  10. 66.249.81.149
  11. 82.145.220.108
  12. 82.145.209.36
  13. 82.145.221.24
  14. 82.145.208.144
  15. 82.145.218.254
  16. 82.145.223.56
  17. 82.145.220.94
  18. 82.145.208.197
  19. 82.145.221.153
  20. 82.145.220.208
  21. 82.145.223.110
  22. 82.145.221.46
  23. 82.145.222.49
  24. 82.145.222.91
  25. 82.145.217.220
  26. 82.145.222.101
  27. 82.145.211.24
  28. 82.145.221.127
  29. 82.145.221.34
  30. 82.145.208.194
  31. 82.145.210.174
  32. 82.145.216.190
  33. 82.145.208.146
  34. 82.145.208.147
  35. 82.145.220.65
  36. 82.145.221.102
  37. 82.145.208.130
  38. 82.145.223.7
  39. 82.145.217.209
  40. 82.145.222.240
  41. 82.145.208.196
  42. 82.145.222.192
  43. 82.145.220.176
  44. 82.145.219.143
  45. 82.145.209.50
  46. 82.145.222.233
  47. 82.145.221.226
  48. 82.145.222.112
  49. 82.145.208.131
  50. 82.145.223.93
  51. 82.145.222.25
  52. 82.145.220.173
  53. 82.145.223.4
  54. 82.145.223.63
  55. 82.145.223.45
  56. 82.145.223.51
  57. 82.145.222.184
  58. 134.222.104.250
  59. 169.143.244.115
  60. 185.26.182.34
  61. 185.26.180.87
  62. 185.26.182.25
  63. 185.26.182.29
  64. 185.26.180.206
  65. 185.26.180.111
  66. 185.26.183.75
  67. 185.26.180.33
  68. 185.26.182.35
  69. 185.26.180.136
  70. 185.26.182.37
  71. 185.26.182.33
  72. 185.26.180.19
  73. 185.26.180.221
  74. 185.26.182.36
  75. 185.26.182.27
  76. 185.26.182.42
  77. 185.26.182.31
  78. 185.26.182.38


Partially defined, when only a country is determined, but not a city, it is slightly worse. Sypex was puzzled for 91 IP, MaxMind already for 6509! That is, MaxMind could not cope with almost a quarter of the addresses provided ...

But the most interesting thing began when comparing data output with different databases for the same IP. Discrepancies revealed 1066 pieces. To reduce the amount of material in the article, the verification procedure was simple: first, the city code was compared (both bases guarantee their coincidence with the GeoNames object codes) If there is a mismatch, the name is checked. The “leading” base here was Sypex, as being more “prosperous” by “ru”, and only the first name mismatch fell into the pivot table, further ones were discarded. The coordinates of the objects were taken from the issuance, links to Google maps, Yandex cards and OSM were formed on them. And here is what happened in the end (the full table is by reference , there are much more discrepancies):

SypexMaxmind
IPthe codean objectthe codean object
5.199.212.40579266Baranchinskiy ( G ), ( I ), ( O )1538636Novouralsk ( G ), ( I ), ( O )
2.61.112.1811512236Abakan ( G ), ( I ), ( O )1508054Chernogorsk ( G ), ( I ), ( O )
217.23.187.92582432Almetyevsk ( G ), ( I ), ( O )551487Kazan ( G ), ( I ), ( O )
31.128.219.246581357Apatity ( G ), ( I ), ( O )548391Kirovsk ( G ), ( I ), ( O )
217.118.81.11580922Armavir ( G ), ( I ), ( O )542420Krasnodar ( G ), ( I ), ( O )
92.101.51.249581049Arkhangelsk ( G ), ( I ), ( O )518909Novodvinsk ( G ), ( I ), ( O )
2.92.12.195580493Astrakhan ( G ), ( I ), ( O )472757Volgograd ( G ), ( I ), ( O )
5.227.218.235579492Balakovo ( G ), ( I ), ( O )498677Saratov ( G ), ( I ), ( O )
95.73.34.150579464Balashikha ( G ), ( I ), ( O )532615Lyubertsy ( G ), ( I ), ( O )
178.187.43.1271510853Barnaul ( G ), ( I ), ( O )1538642Siberian ( G ), ( I ), ( O )
95.71.47.34578072Belgorod ( G ), ( I ), ( O )558146Gubkin ( G ), ( I ), ( O )
5.8.230.181510018Biysk ( G ), ( I ), ( O )1510853Barnaul ( G ), ( I ), ( O )
95.70.79.2062026643Birobidzhan ( G ), ( I ), ( O )2132037Bras ( G ), ( I ), ( O )
31.41.192.542026094Bratsk ( G ), ( I ), ( O )1497259New Silava ( G ), ( I ), ( O )
2.92.93.183571476Bryansk ( G ), ( I ), ( O )553915Kaluga ( G ), ( I ), ( O )
79.141.214.0519336Veliky Novgorod ( G ), ( I ), ( O )548442Kirishi ( G ), ( I ), ( O )
185.13.132.631487281Upper Pyshma ( G ), ( I ), ( O )1486209Yekaterinburg ( G ), ( I ), ( O )
95.167.53.2281487277Upper Salda ( G ), ( I ), ( O )1497393Lower Salda ( G ), ( I ), ( O )
31.185.5.71473778Prominent ( G ), ( I ), ( O )486968Stupino ( G ), ( I ), ( O )
80.83.237.1072013348Vladivostok ( G ), ( I ), ( O )2023469Irkutsk ( G ), ( I ), ( O )
178.35.118.87473249Vladikavkaz ( G ), ( I ), ( O )524736Mozdok ( G ), ( I ), ( O )
31.28.219.85473247Vladimir ( G ), ( I ), ( O )487837Stavrovo ( G ), ( I ), ( O )
188.187.16.38472757Volgograd ( G ), ( I ), ( O )498817Saint Petersburg ( G ), ( Y ), ( O )
92.38.11.21472761Volgodonsk ( G ), ( I ), ( O )533874Lozna ( G ), ( I ), ( O )
46.29.234.35472231Volzhsky ( G ), ( I ), ( O )7043838Zarechensky ( G ), ( I ), ( O )
178.64.239.12472459Vologda ( G ), ( I ), ( O )569223Cherepovets ( G ), ( I ), ( O )
91.229.177.176472045Voronezh ( G ), ( I ), ( O )572525Borisoglebsk ( G ), ( I ), ( O )
95.73.174.231471656Voskresensk ( G ), ( I ), ( O )565955Dmitrov ( G ), ( I ), ( O )
92.242.69.253563708Dzerzhinsk ( G ), ( I ), ( O )520555Nizhny Novgorod ( G ), ( I ), ( O )
95.72.12.150565955Dmitrov ( G ), ( I ), ( O )524901Moscow ( G ), ( Y ), ( O )
95.72.103.17565614Dolgoprudny ( G ), ( I ), ( O )524901Moscow ( G ), ( Y ), ( O )
5.140.162.2331486209Yekaterinburg ( G ), ( I ), ( O )1491159Sredneuralsk ( G ), ( I ), ( O )
91.190.176.113466990Essentuki ( G ), ( I ), ( O )503550Pyatigorsk ( G ), ( I ), ( O )
212.124.11.99555312Ivanovo ( G ), ( I ), ( O )473247Vladimir ( G ), ( I ), ( O )
78.85.112.21554840Izhevsk ( G ), ( I ), ( O )2132037Bras ( G ), ( I ), ( O )
91.226.122.972023469Irkutsk ( G ), ( I ), ( O )2012557Zheleznogorsk-Ilimsky ( G ), ( I ), ( O )
176.215.84.101466806Yoshkar-Ola ( G ), ( I ), ( O )1502026Krasnoyarsk ( G ), ( I ), ( O )
178.206.158.72551487Kazan ( G ), ( I ), ( O )824195Bibaevo ( G ), ( I ), ( O )
46.183.6.71554234Kaliningrad ( G ), ( I ), ( O )557882Gusev ( G ), ( I ), ( O )
109.202.54.881504826Kamensk-Uralsky ( G ), ( I ), ( O )1486209Yekaterinburg ( G ), ( I ), ( O )
91.217.3.227553190Kandalaksha ( G ), ( I ), ( O )581357Apatity ( G ), ( I ), ( O )
95.190.51.1921503901Kemerovo ( G ), ( I ), ( O )1510208Birch ( G ), ( I ), ( O )
176.115.155.82548408Kirov ( G ), ( I ), ( O )543737Kotelnich ( G ), ( I ), ( O )
95.72.84.208546230Kolomna ( G ), ( I ), ( O )566950Davydovo ( G ), ( I ), ( O )
195.88.59.213546521Kolchugino ( G ), ( I ), ( O )537107Lakinsk ( G ), ( I ), ( O )
92.37.211.1622021851Komsomolsk-on-Amur ( G ), ( I ), ( O )545736Komsomolsk ( G ), ( I ), ( O )
91.236.204.411502603Kopeysk ( G ), ( I ), ( O )1502536Korkino ( G ), ( I ), ( O )
95.153.131.117542420Krasnodar ( G ), ( I ), ( O )528293Maykop ( G ), ( I ), ( O )
46.166.75.1991502026Krasnoyarsk ( G ), ( I ), ( O )1512165Achinsk ( G ), ( I ), ( O )
149.62.51.111540030Cuban ( G ), ( I ), ( O )524901Moscow ( G ), ( Y ), ( O )
5.141.221.1911501321Barrow ( G ), ( I ), ( O )1510421Belozerskoe ( G ), ( I ), ( O )
46.229.140.229538560Kursk ( G ), ( I ), ( O )515012Eagle ( G ), ( I ), ( O )
84.18.119.182536162Leninogorsk ( G ), ( I ), ( O )578638Bawls ( G ), ( I ), ( O )
178.234.214.208535121Lipetsk ( G ), ( I ), ( O )558312Mud ( G ), ( I ), ( O )
95.73.102.180533543Bulbs ( G ), ( I ), ( O )501320Roshal ( G ), ( I ), ( O )
85.174.245.231528293Maykop ( G ), ( I ), ( O )7077462Zhukovsky ( G ), ( I ), ( O )
176.103.98.57531820Malakhovka ( G ), ( I ), ( O )524901Moscow ( G ), ( Y ), ( O )
62.182.203.22532096Makhachkala ( G ), ( I ), ( O )566789Delta ( G ), ( I ), ( O )
95.24.64.218524901Moscow ( G ), ( Y ), ( O )498817Saint Petersburg ( G ), ( Y ), ( O )
78.36.21.225524305Murmansk ( G ), ( I ), ( O )795243Snezhnogorsk ( G ), ( I ), ( O )
109.248.226.28524294Murom ( G ), ( I ), ( O )569696Cheboksary ( G ), ( I ), ( O )
31.135.77.128523811Mytishchi ( G ), ( I ), ( O )524901Moscow ( G ), ( Y ), ( O )
95.86.242.75523859Myshkin ( G ), ( I ), ( O )468902Yaroslavl ( G ), ( I ), ( O )
95.78.40.253523750Naberezhnye Chelny ( G ), ( I ), ( O )824195Bibaevo ( G ), ( I ), ( O )
85.173.113.121523523Nalchik ( G ), ( I ), ( O )579574Baksan ( G ), ( I ), ( O )
95.73.205.74523426Naro-Fominsk ( G ), ( I ), ( O )565381Domodedovo ( G ), ( I ), ( O )
46.46.11.1262019528Find ( G ), ( I ), ( O )2020812Lesozavodsk ( G ), ( I ), ( O )
83.149.37.2351497543Nizhnevartovsk ( G ), ( Y ), ( O )1486209Yekaterinburg ( G ), ( I ), ( O )
217.23.186.11521118Nizhnekamsk ( G ), ( I ), ( O )551487Kazan ( G ), ( I ), ( O )
93.120.171.24520555Nizhny Novgorod ( G ), ( I ), ( O )519336Veliky Novgorod ( G ), ( I ), ( O )
195.88.17.2071496747Novosibirsk ( G ), ( I ), ( O )1496421Ob ( G ), ( I ), ( O )
178.213.208.45518976Novocheboksarsk ( G ), ( I ), ( O )519148Nova ( G ), ( I ), ( O )
178.167.64.81520068Noginsk ( G ), ( I ), ( O )515024Orekhovo-Zuevo ( G ), ( I ), ( O )
94.103.238.207516215Odintsovo ( G ), ( I ), ( O )524901Moscow ( G ), ( Y ), ( O )
91.205.236.661538634Ozersk ( G ), ( I ), ( O )1489837New Tech ( G ), ( I ), ( O )
5.166.197.1591496153Omsk ( G ), ( I ), ( O )519336Veliky Novgorod ( G ), ( I ), ( O )
79.126.119.225515003Orenburg ( G ), ( I ), ( O )2126132Chkalov ( G ), ( I ), ( O )
95.72.162.135515024Orekhovo-Zuevo ( G ), ( I ), ( O )501320Roshal ( G ), ( I ), ( O )
94.253.117.139512023Pavlovsky Posad ( G ), ( I ), ( O )524901Moscow ( G ), ( Y ), ( O )
80.95.38.188511565Penza ( G ), ( I ), ( O )553725Kamenka ( G ), ( I ), ( O )
176.214.179.193511196Perm ( G ), ( I ), ( O )2126132Chkalov ( G ), ( I ), ( O )
77.82.142.52122104Petropavlovsk-Kamchatsky ( G ), ( I ), ( O )1504924Kamchatka ( G ), ( I ), ( O )
37.1.2.163508101Podolsk ( G ), ( I ), ( O )569591Chekhov ( G ), ( I ), ( O )
91.238.168.147507977Feet ( G ), ( I ), ( O )482283Tolyatti ( G ), ( I ), ( O )
84.204.255.21504341Pskov ( G ), ( I ), ( O )498817Saint Petersburg ( G ), ( Y ), ( O )
194.15.118.205502018Reutov ( G ), ( I ), ( O )524901Moscow ( G ), ( Y ), ( O )
77.66.132.52501175Rostov-on-Don ( G ), ( I ), ( O )501183Rostov ( G ), ( I ), ( O )
178.46.9.851493197Salekhard ( G ), ( I ), ( O )1488414Urengoy ( G ), ( I ), ( O )
217.118.90.217499099Samara ( G ), ( I ), ( O )1486209Yekaterinburg ( G ), ( I ), ( O )
178.130.38.73498817Saint Petersburg ( G ), ( Y ), ( O )491061Soldier ( G ), ( I ), ( O )
2.92.127.82498677Saratov ( G ), ( I ), ( O )553915Kaluga ( G ), ( I ), ( O )
213.110.16.83498418Satka ( G ), ( I ), ( O )873483Stingray ( G ), ( I ), ( O )
83.172.36.1361538637Seversk ( G ), ( I ), ( O )1489425Tomsk ( G ), ( I ), ( O )
188.35.14.57496638Sergiev Posad ( G ), ( I ), ( O )541950Krasnozavodsk ( G ), ( I ), ( O )
77.51.92.205496527Serpukhov ( G ), ( I ), ( O )555746Istra ( G ), ( I ), ( O )
46.172.219.145693805Simferopol ( G ), ( I ), ( O )540259Crimea ( G ), ( I ), ( O )
95.167.146.223491687Smolensk ( G ), ( I ), ( O )468866Yartsevo ( G ), ( I ), ( O )
46.45.28.2471536289Snezhinsk ( G ), ( I ), ( O )7077209Vega ( G ), ( I ), ( O )
31.42.47.98490996Solnechnogorsk ( G ), ( I ), ( O )527581Mendeleevo ( G ), ( I ), ( O )
81.177.127.83491422Sochi ( G ), ( I ), ( O )6417459Krasnoznamensk ( G ), ( I ), ( O )
77.34.175.2082016187Spassk-Dalniy ( G ), ( I ), ( O )1491197Spassk ( G ), ( I ), ( O )
46.45.227.93487846Stavropol ( G ), ( I ), ( O )522377Невинномысск (G), (Я), (O)
5.141.203.2101490624Сургут (G), (Я), (O)1508291Челябинск (G), (Я), (O)
95.52.181.96485239Сыктывкар (G), (Я), (O)511794Печора (G), (Я), (O)
78.132.234.93484646Тамбов (G), (Я), (O)502793Рассказово (G), (Я), (O)
95.29.242.149480060Тверь (G), (Я), (O)498677Саратов (G), (Я), (O)
95.67.213.95482283Тольятти (G), (Я), (O)463082Жигулевск (G), (Я), (O)
109.206.157.24482260Томилино (G), (Я), (O)524901Москва (G), (Я), (O)
77.106.104.31489425Томск (G), (Я), (O)1489870Тайшет (G), (Я), (O)
2.94.171.202480562Тула (G), (Я), (O)543878Кострома (G), (Я), (O)
91.143.48.1931488754Тюмень (G), (Я), (O)1490624Сургут (G), (Я), (O)
85.26.164.249479123Ульяновск (G), (Я), (O)482283Тольятти (G), (Я), (O)
46.46.34.192014006Уссурийск (G), (Я), (O)2020812Лесозаводск (G), (Я), (O)
94.41.235.183479561Уфа (G), (Я), (O)522942Нефтекамск (G), (Я), (O)
92.37.159.2052022890Хабаровск (G), (Я), (O)2021851Комсомольск-на-Амуре (G), (Я), (O)
5.140.235.751503772Ханты-Мансийск (G), (Я), (O)1490624Сургут (G), (Я), (O)
178.219.32.48550280Химки (G), (Я), (O)524901Москва (G), (Я), (O)
91.216.72.161569696Чебоксары (G), (Я), (O)470845Вурнары (G), (Я), (O)
5.141.192.2371508291Челябинск (G), (Я), (O)511196Пермь (G), (Я), (O)
128.0.161.90568595Черняховск (G), (Я), (O)554234Калининград (G), (Я), (O)
82.112.37.217567434Чусовой (G), (Я), (O)511196Пермь (G), (Я), (O)
195.189.180.57495260Щербинка (G), (Я), (O)508101Подольск (G), (Я), (O)
178.219.176.125563523Электросталь (G), (Я), (O)520068Ногинск (G), (Я), (O)
87.228.42.101536206Юбилейный (G), (Я), (O)523812Мытищи (G), (Я), (O)
188.244.143.1122119441Южно-Сахалинск (G), (Я), (O)2132037Брас (G), (Я), (O)
91.220.92.29469178Янаул (G), (Я), (O)576116Благовещенск (G), (Я), (O)
91.242.167.93468902Yaroslavl ( G ), ( I ), ( O )497242Semibratovo ( G ), ( I ), ( O )


There will be no conclusions. Although, IP 95.24.64.218 certainly pleased. And “either Vladivostok or Irkutsk” is also not bad.

Also popular now: