Alteryx Designer Knowledge Base

Definitive answers from Designer experts.
Alteryx is here to help you solve your biggest data challenges. Read about the new Virtual Solution Center here.

Available "Big Data Sets" on the Web

Alteryx
Alteryx
Created

Question

Where can I find available "Big Data Sets" over the internet? 

 

Big data is data that is usually with sizes beyond the ability of commonly used software tools to manage and process within a tolerable elapsed time. A year-long credit card transaction history or CDR (Call data record) of a telecoms company for the last 9 months, behavioral credit data of a large financial institution are some examples...

Answer

Comments
7 - Meteor

For India - www.data.gov.in

Alteryx Partner

Originally there is an ongoing discussion where we list all the data sets we find. Here is the link;

https://community.alteryx.com/t5/Alteryx-Designer-Discussions/Available-quot-Big-data-sets-quot-over...

12 - Quasar

On January 23, 2020 Google released Dataset Search, a free tool for searching 25 million publicly available datasets.

 

Google blog post: https://www.google.com/amp/s/blog.google/products/search/discovering-millions-datasets-web/amp/

 

Related post: https://towardsdatascience.com/google-just-published-25-million-free-datasets-d83940e24284

  • about half of the datasets in the search results were from for-profit aggregators
  • other popular dataset publishers on the platform include government agencies and research institutions
  • US government agencies alone have published over 2 million datasets
  • most of the datasets are related to “geosciences, biology, and agriculture.”

 

Dataset Search: http://g.co/datasetsearch

5 - Atom

You can also check this Data Science Company