11.08.10

Gemini version available ♊︎

Commentary: StatCounter ‘Global’ Statistics

Posted in GNU/Linux at 8:10 pm by Dr. Roy Schestowitz

StatCounter bias

Summary: How StatCounter turns 4-5% of the world’s population into 25% and reduces the world’s largest Internet population (China) to just 2.46%, then claims to be measuring global market share (other surveys do the same thing)

AL submits: “Thank you for all your hard work in bringing us news through Techrights. I am reading it daily and find lots of interesting information.

“I read one of the comments from Mad Hatter in which he was talking about Wikipedia article on OS market share. I went to check it out and found that they use 1% for Linux (globally) based on the research by StatCounter Global. I was interested to see how this group is gathering their statistical data. If you go to their FAQ section they talk about sample size per country/region and there is a link to the full list of all countries. As they stated themselves their pool is 16,3 bln hits. Quite large I would say. But there is something interesting – the biggest group (region) is United States with 3,965,972,279 hits. That is almost 25% of the total pool. Now, my days of statistical studies are long gone but I still remember that in order to have accurate result you cannot over-represent one group. The result will be obviously skewed. We have one country that contributes almost 25% to the result compared to the rest of the world. As StatCounter states that they choose randomly that makes it very likely that lots of data on hits would be taken from USA. You know, for example, how much is the share of hits from China? 2,46%! In fact, looking at the whole list you can see that starting from Korea and further down the share is less than 1%! That includes countries like Poland, Greece, Japan, Russia, Switzerland etc.

“The result will be obviously skewed. We have one country that contributes almost 25% to the result compared to the rest of the world.”
      –Al
“I know some can say that there are many more computers sold in USA than in other countries (can’t be true). But market share is more complex. If we have 95% (example) Linux presence on desktops in China, they would hardly make any influence with representation of only 2,46% on the StatCounter data. Do you see what I mean? There are of course many more problems with that. What kind of websites StatCounter is using to get hits? If we put hit counter on the website with Silverlight I don’t think we will get many hits from Linux OS desktops, right? And even if the websites are getting hits from same amount of Linux OS and other OS desktops what will happen? StatCounter will randomly select hits from global pool and as data from USA will be more likely to get selected it will greatly skew the result and linux will always get under-represented. Lets say you have two crates: one with 10 pears and one with 250 tomatoes + 150 pears and you draw five times. However 3 times from first crate and 2 times from the second. You will have selected more pears than tomatoes. Even though there are 250 tomatoes and 150+10=160 pears. Is this reliable representation?”

Share in other sites/networks: These icons link to social bookmarking sites where readers can share and discover new web pages.
  • Reddit
  • email

Decor ᶃ Gemini Space

Below is a Web proxy. We recommend getting a Gemini client/browser.

Black/white/grey bullet button This post is also available in Gemini over at this address (requires a Gemini client/browser to open).

Decor ✐ Cross-references

Black/white/grey bullet button Pages that cross-reference this one, if any exist, are listed below or will be listed below over time.

Decor ▢ Respond and Discuss

Black/white/grey bullet button If you liked this post, consider subscribing to the RSS feed or join us now at the IRC channels.

8 Comments

  1. StatCounterGlobalStats said,

    November 9, 2010 at 3:59 am

    Gravatar

    Hi there,

    I’ve just stumbled across your article and hope to clear up some confusion.

    Our StatCounter Global Stats measure various market share and other stats for all countries across the globe… hence the name.

    Our methodology is very simple and we’ve purposefully kept it that way. Specifically, our stats are based on more than 15 billion hits per month to our 3 million+ member sites. We’re not aware of any other publicly available service providing market share stats that has a bigger sample size on which they base their information.

    You’re absolutely correct about us NOT weighting our data. We do not impose artificial weightings on our stats and this is a conscious and deliberate decision. Weighting stats means that the stats are only as good as the weighting methodology used. If the weighting data is inaccurate or out of date, then it renders the data completely incorrect. For these reasons again, we choose NOT to weight our data in any way and instead we report it as we record – other commentators can, however, weight the data as they wish. All our work is shared under a Creative Commons Attribution-Share Alike License (http://creativecommons.org/licenses/by-sa/3.0/) for this specific purpose – so please feel free to download our data and apply whatever weights you see fit.

    StatCounter Global Stats came about because we decided to publicly share interesting trends that we were monitoring in-house. We aim to make our stats and methodology as clear as possible and appreciate all comments, queries and suggestions. If you have any questions for us, please don’t hesitate to contact us via our feedback form (http://gs.statcounter.com/feedback) or by direct email.

    Dr. Roy Schestowitz Reply:

    Hi,

    A few quick points:

    1. The size of the sample does not matter at all. Other companies like NetApps also brag about the number of UIPs, but this number is meaningless unless distributed correctly (nature of the sites sampled, geography, etc.)
    2. How does the data account for dynamic IPs, proxies/squid, and the imbalanced use of the Web browser depending on the user (e.g. # of page requests; this can be correlated to operating systems and browser, e.g. does it support tabs? What is the connection speed?)
    3. How are zombies PCs and other ‘junk’ traffic removed from the dataset?

    There are many other challenges/deficiencies, but it’s commendable when the data and methods (preferably code) are made publicly available for independent audits, provided of course they don’t violate privacy rule (which is a hard problem when browsers are specified very precisely with locational information too). That’s why such surveys cannot reach privacy-conscious sites, many of which appeal to civil rights-aware users (many would GNU/Linux), and that’s just one example. I wrote an article on the subject 3 years ago:

    http://itmanagement.earthweb.com/osrc/article.php/3687616/Can-Linux-Adoption-Ever-be-Accurately-Gauged.htm

  2. Matsi said,

    November 9, 2010 at 1:12 pm

    Gravatar

    Here are the statcounter results for Finland

    http://gs.statcounter.com/#os-FI-monthly-200910-201010
    (showing about 2,5-2,7% for Linux)
    …and here are the results of my homepage (non-geek, 95% non-computer, mostly politics, social discussion…)

    Windows 2785 83.18%
    Linux 302 9.02%
    Macintosh 185 5.53%
    Unknown 73 2.18%
    FreeBSD 2 0.06%
    CPM 1 0.03%

    (visiters: Finland 94,4%, Sweden 0,9, USA 1,1% others 3,4%)

    No big differences between clicks, unique visitors, unique sessions…

    There are several finns telling the same story: Linux has about 7-10% marketshare on their homepages, blogsites…

    So one thing is sure – Linux has much bigger marketshare in Finland than statcounter is telling. My guess is 8% +/- 1%. There is no doubt that situation is quite the same in other regions. Linux is some 3 times bigger than statscounter is claiming.

    Dr. Roy Schestowitz Reply:

    Statscounter needs to tell which actual sites in Finland it is sampling from. These are not randomly selected Finns.

    StatCounterGlobalStats Reply:

    There is still considerable confusion here!

    Our methodology is here:
    http://gs.statcounter.com/faq#methodology

    We are NOT sampling websites from Finland.

    Geo is determined via IP address based on location of visitor NOT location of website. Nothing is randomly selected either – we publish everything we track.

    In other words our stats for Finland are based on all hits we track (approx 60 million per month) from Finland (i.e. IP addresses in Finland) to all our 3 million plus member sites.

    If anyone has further questions, please do submit them to us directly – we’re more than happy to deal with any and all queries.

    Thanks!

    Dr. Roy Schestowitz Reply:

    That does not change my point of argument. What are those 3m+ sites? There are far more sites than that on the Web (IIRC, over 100m domains registered).

    What is the geographical distribution of these 3m+ sites? What proportion of them is Finnish for example? What proportion is Chinese or Brazilian?

    Danielh Reply:

    If i get this right you are sampling 3 million sites out of the 220 million sites available?

    I really hope those sites are very spread out in target groups etc because else there seems to be a great margin for error. Do they include any of the bigger sites like Google, Facebook, Slashdot, Youtube, QQ, Baidu, Blogger, Twitter etc or is it just smaller sites?

    Dr. Roy Schestowitz Reply:

    To be fair to StatCounter, it is an exceptionally hard problem to solve because of its massive scale. I just hope they make all of their experimental data and methods public. In academia we can hardly even publish a paper without this most fundamental requirement, not to mention rigourous scrutiny (no statistician would accept StatCounter’s charts without a challenge).

DecorWhat Else is New


  1. IRC Proceedings: Sunday, January 23, 2022

    IRC logs for Sunday, January 23, 2022



  2. [Meme] Team UPC Congratulating Itself

    The barrage of fake news and misinformation about the UPC deliberately leaves out all the obvious and very important facts; even the EPO‘s António Campinos and Breton (Benoît Battistelli‘s buddy) participated in the lying



  3. Links 24/1/2022: pgBadger 11.7 Released, Catch-up With Patents

    Links for the day



  4. The Demonisation and Stereotyping of Coders Not Working for Big Corporations (or 'The System')

    The war on encrypted communication (or secure communications) carries on despite a lack of evidence that encryption stands in the way of crime investigations (most criminals use none of it)



  5. On the 'Peak Hacker' Series

    Hacker culture, unlike Ludditism, is ultimately a movement for justice, for equality, and for human rights through personal and collective emancipation; Dr. Farnell has done a good job explaining where we stand and his splendid series has come to a close



  6. Links 23/1/2022: First RC of Linux 5.17 and Sway 1.7 Released

    Links for the day



  7. Peak Code — Part III: After Code

    "Surveillance perimeters, smart TVs (Telescreens built to Orwell's original blueprint) watched over our living rooms. Mandatory smart everything kept us 'trustless'. Safe search, safe thoughts. We withdrew. Inside, we went quietly mad."



  8. IRC Proceedings: Saturday, January 22, 2022

    IRC logs for Saturday, January 22, 2022



  9. Links 23/1/2022: MongoDB 5.2, BuddyPress 10.0.0, and GNU Parallel 20220122

    Links for the day



  10. A Parade of Fake News About the UPC Does Not Change the General Consensus or the Simple Facts

    European Patents (EPs) from the EPO are granted in violation of the EPC; Courts are now targeted by António Campinos and the minions he associates with (mostly parasitic litigation firms and monopolists), for they want puppets for “judges” and for invalid patents to be magically rendered “valid” and “enforceable”



  11. Welcome to 2022: Intentional Lies Are 'Benefits' and 'Alternative Facts'

    A crooks-run EPO, together with the patent litigation cabal that we’ve dubbed ‘Team UPC’ (it has nothing to do with science or with innovation), is spreading tons of misinformation; the lies are designed to make the law-breaking seem OK, knowing that Benoît Battistelli and António Campinos are practically above the law, so perjury as well as gross violations of the EPC and constitutions won’t scare them (prosecution as deterrence just isn’t there, which is another inherent problem with the UPC)



  12. From Software Eating the World to the Pentagon Eating All the Software

    “Software is eating the world,” according to Marc Andreessen (co-founder of Netscape), but the Empire Strikes Back (not the movie, the actual empire) by hijacking all code by proxy, via Microsoft, just as it grabbed a lot of the world’s communications via Skype, bypassing the world's many national telecoms; coders need to fight back rather than participate in racist (imperial) shams such as GitHub



  13. Links 22/1/2022: Skrooge 2.27.0 and Ray-Tracing Stuff

    Links for the day



  14. IRC Proceedings: Friday, January 21, 2022

    IRC logs for Friday, January 21, 2022



  15. Peak Code — Part II: Lost Source

    "Debian and Mozilla played along. They were made “Yeoman Freeholders” in return for rewriting their charters to “work closely with the new Ministry in the interests of all stakeholders” – or some-such vacuous spout… because no one remembers… after that it started."



  16. Links 22/1/2022: Ubuntu MATE 21.10 for GPD Pocket 3, MINISFORUM Preloads GNU/Linux

    Links for the day



  17. Computer Users Should be Operators, But Instead They're Being Operated by Vendors and Governments

    Computers have been turned into hostile black boxes (unlike Blackbox) that distrust the person who purchased them; moreover, from a legislative point of view, encryption (i.e. computer security) is perceived and treated by governments like a threat instead of something imperative — a necessity for society’s empowerment (privacy is about control and people in positions of unjust power want total and complete control)



  18. Peak Code — Part I: Before the Wars

    Article/series by Dr. Andy Farnell: "in the period between 1960 and 2060 people had mistaken what they called "The Internet" for a communications system, when it had in fact been an Ideal and a Battleground all along - the site of the 100 years info-war."



  19. Links 21/1/2022: RISC-V Development Board and Rust 1.58.1

    Links for the day



  20. IRC Proceedings: Thursday, January 20, 2022

    IRC logs for Thursday, January 20, 2022



  21. Gemini Lets You Control the Presentation Layer to Suit Your Own Needs

    In Gemini (or the Web as seen through Gemini clients such as Kristall) the user comes first; it's not sites/capsules that tell the user how pages are presented/rendered, as they decide only on structural/semantic aspects



  22. The Future of Techrights

    Futures are difficult to predict, but our general vision for the years ahead revolves around more community involvement and less (none or decreased) reliance on third parties, especially monopolistic corporations, mostly because they oppress the population via the network and via electronic devices



  23. [Meme] UPC for CJEU

    When you do illegal things and knowingly break the law to get started with a “legal” system you know it’ll end up in tears… or the CJEU



  24. Links 20/1/2022: 'Pluton' Pushback and Red Hat Satellite 6.10.2

    Links for the day



  25. The Web is a Corporate Misinformation/Disinformation Platform, Biased Against Communities, Facts, and Science

    Misinformation/disinformation in so-called 'news' sites is a pandemic which spreads; in the process, the founder of GNU/Linux gets defamed and GNU/Linux itself is described as the problem, not the solution to the actual problems



  26. Links 20/1/2022: McKinsey Openwashing and Stable Kernels

    Links for the day



  27. IRC Proceedings: Wednesday, January 19, 2022

    IRC logs for Wednesday, January 19, 2022



  28. Links 20/1/2022: Linuxfx 11.1 WxDesktop 11.0.3 and FreeIPMI 1.6.9 Released

    Links for the day



  29. Links 19/1/2022: XWayland 22.1 RC1 and OnlyOffice 7.0 Release

    Links for the day



  30. Links 19/1/2022: ArchLabs 2022.01.18 and KDE's 15-Minute Bug Initiative

    Links for the day


RSS 64x64RSS Feed: subscribe to the RSS feed for regular updates

Home iconSite Wiki: You can improve this site by helping the extension of the site's content

Home iconSite Home: Background about the site and some key features in the front page

Chat iconIRC Channel: Come and chat with us in real time

Recent Posts