General Discussions

Check out our powerful new search update! You can read more here. Please let us know if you have any feedback by creating a topic here.
SOLVED

Available "Big data sets" over the internet...

Highlighted
Comet
Highlighted
Alteryx Alumni (Retired)

Having not fully vetted this list myself I expect there to be a few good resources in there:

http://www.datasciencecentral.com/profiles/blogs/big-data-sets-available-for-free

 

Highlighted
Meteoroid

Here are some more....

 

KD Nuggets is a well respected analytics blog, they have put together a very nice and deep list:

http://www.kdnuggets.com/datasets/index.html

 

UK Data

https://data.gov.uk/data

 

Google's PublicData Directory:

http://www.google.com/publicdata/directory

 

For the Spatial and GIS folks:

http://gisgeography.com/best-free-gis-data-sources-raster-vector/

Highlighted
Meteor

I give to you the mother of big datasets - Reddit. 1.7bn JSON objects; 250GB compressed.

 

https://www.reddit.com/r/datasets/comments/3bxlg7/i_have_every_publicly_available_reddit_comment

Highlighted
Alteryx Alumni (Retired)

Bookmarked!!!  Awesome work going on here!

Andy Cooper
Senior Solutions Engineer - EMEA
Alteryx
Highlighted
Alteryx Partner

Loads of really great links from here as well:

https://www.quora.com/Where-can-I-find-large-datasets-open-to-the-public

Highlighted
Meteor

Here you go!! IMDB Datasets..

 

http://www.imdb.com/interfaces

 

A subset of the IMDb plain text data files is available from their FTP sites as follows:

 

 

Thanks,

PV

Highlighted
Comet
Highlighted
Alteryx Partner

Tweets are removed with the new Terms&Conditions

but the follower data remains and is still usefull...

 

Thanks

Highlighted
Alteryx Partner
Alteryx Partner

One of my favorites are Data.gov where there is tons of public data from all sectors, different size sets and in different formats including API connections.This url,  http://www.data.gov/open-gov/ ,  shows each of the local goverments in the US. They have varying degrees of completion on the local level.