Everyone should have the opportunity to indulge their curiosities, analyze the world and pursue brilliant ideas. Small startups or even individuals can now access high quality crawl data that was previously only available to large search engine corporations.

For more information about the corpus, look at our Get Started page.

Our Google Group is an active hub for technologists to collaborate and ask questions. Our Twitter feed is a great way for everyone to keep up with our latest news, thoughts and to engage with the Common Crawl community.

We invite you to join the San Francisco Bay Area based Open Data Bay Area Meetup, a group where you can meet other supporters of Open Data like yourself.

Curious about what you can do?

Common Crawl provides a corpus for collaborative research, analysis and education. Technologists can find details on using the data on The Data and code on the Example Projects page.

If you are working with Common Crawl data, please let us know! We are always eager to highlight interesting use cases and so everyone can see the power of Open Data.

Not a technologist? You can learn about the fascinating insights others have gained from working with Common Crawl data in the papers on the Example Projects page and through the articles and videos on the Media page.

If you are an educator teaching data analysis, consider using Common Crawl data in your courses. We have a program for collaboration with educators, contact us through the Academic Collaboration Program page (link) to see how we can work together.

Help spread the word about Common Crawl so that more people learn of and use this valuable data.

Please consider making a donation to support our work.

commoncrawl.org