Alteryx Designer Knowledge Base

Definitive answers from Designer experts.

Available "Big Data Sets" on the Web

Alteryx
Alteryx
Created

Question

Where can I find available "Big Data Sets" over the internet? 

 

Big data is data that is usually with sizes beyond the ability of commonly used software tools to manage and process within a tolerable elapsed time. A year-long credit card transaction history or CDR (Call data record) of a telecoms company for the last 9 months, behavioral credit data of a large financial institution are some examples...

Answer

Comments
Meteor

For India - www.data.gov.in

Alteryx Partner

Originally there is an ongoing discussion where we list all the data sets we find. Here is the link;

https://community.alteryx.com/t5/Alteryx-Designer-Discussions/Available-quot-Big-data-sets-quot-over...

Quasar

On January 23, 2020 Google released Dataset Search, a free tool for searching 25 million publicly available datasets.

 

Google blog post: https://www.google.com/amp/s/blog.google/products/search/discovering-millions-datasets-web/amp/

 

Related post: https://towardsdatascience.com/google-just-published-25-million-free-datasets-d83940e24284

  • about half of the datasets in the search results were from for-profit aggregators
  • other popular dataset publishers on the platform include government agencies and research institutions
  • US government agencies alone have published over 2 million datasets
  • most of the datasets are related to “geosciences, biology, and agriculture.”

 

Dataset Search: http://g.co/datasetsearch

You can also check this Data Science Company