I'm opening this topic for everyone to list some Big data* sets available over the net.
- Feel free to list competion/datathon data sets
- Results of web scraping
- Social media data
- Anything bigger than 1 mio records (beyond excel and access)
Best
Altan
* Big data is data that is usually with sizes beyond the ability of commonly used software tools to manage and process within a tolerable elapsed time. A year long credit card transaction history or CDR (Call data record) of a telecoms company for the last 9 months, behavioral credit data of a large financial institution are some examples...
--------------
[Edited by a Moderator]
We've compiled the responses to this thread into the following Knowledge Base article: Available "Big Data Sets" on the Web
--------------
