Random samples of the Internet

I often review groups related to global topics. For instance, today (“punctuated evolution”) which on Google search shows 56,200 entry points. That ought to be small enough to sample all of those, but using manual methods is not really accessible for study. Is it possible to get random samples from Google API? For instance (“evolution” “organizational”) shows 24 Million entry points. When I search for (“google api”) it shows 11.5 Million entry points. Even (site:google.com “google API”) has 130,000 entry points.

For 26 years of the Internet Foundation I have focused on case studies and analyses of these kinds of groups, and such as (site:un.org) 5.94 Million, (site:nih.gov) 561 Million.

But I would like to automate my standard analysis of sites in random samples to draw conclusions. Before I set up the Internet Foundation, I mostly worked on information systems and modeling of large groups, “all the people in Sahel countries for 50 years into the future” and more.

Richard K Collins

About: Richard K Collins

The Internet Foundation Internet policies, global issues, global open lossless data, global open collaboration


Leave a Reply

Your email address will not be published. Required fields are marked *