CSE6242OAN, Spring 2018
Data and Visual Analytics

Dataset Ideas (may need API, or scraping)

• Google public datasets. Thanks Revant!
• NYC Taxi data for 2013 (FOILed by Chris Wong). 2013 Trip Data (11.0GB). 2013 Fare Data (7.7GB). Visualization for a days trip. Thanks Jitesh.
• Large datasets publicly available. Thanks Gopi!
• Georgia Tech's campus data (has APIs): bus info, directory, building, T-square, room reservation, building facilities usage (e.g., electricity, lights, A/C, etc.), Oscar/course info/registration, etc.
• Yahoo WebScope
• Data.gov: U.S. Government's open data
• IPEDS data: Postsecondary education data from National Centre for Education Statistics
• Bureau of Labor Statistics data
• Uber data: Anonymized data from over 2 billion trips
• Freebase
• Yelp
• Microsoft Academic Graph
• Numerous APIs from Google (e.g., Maps, Freebase, YouTube, etc.)
• Zillow: real estate listing site
• Numerous graph datasets (large and small): SNAP, Konect
• Movies data: IMDB
• List of lists of datasets for recommendations.
  Thanks Jon!
• Million song dataset by Echo Nest.
  It contains not only the basic information of songs (artist, genre, year, length etc), but also some musical features(like tempo, pitch, key, brightness).
  Thanks Minwei!
• Dataset about soccer games, players, clubs.
  No API, but easy to scrape.
  For a soccer player: transfer history, performance, nationality, birth date, etc.
  For a soccer club: performance, squad, etc.
  Thanks Ding!
• The Free 'Big Data' Sources Everyone Should Know
• Quandl - a dataset search engine for time-series data.
  Thanks Henry!
• UCI also has a collection of links to various datasets sorted for various tasks (Classification, Regression, etc)
  Thanks Vinodh!
• Amazon AWS Public Data Sets (Thanks Jonathan!)
• KDD Cup: annual competition in data mining, like Kaggle
• Academic domain: Microsoft Academic Search, DBLP
• Retrosheet: MLB statistics (Game/Play logs)
• Classification datasets
  Thanks Amish!
• Various geophysical datasets for the oceans (magnetism, gravity, seismology, etc).
  Thanks Ryan!
• Social trends (Thanks Jonathan!)
• Beer data (Thanks Jonathan!). Website offline :( . Older version at web.archive.org
• Academic torrents (terabytes) (Thanks Vaibhav!)
• Article Search API from the New York Times (all the way back to 1851!) (Thanks Guido!)
• (Kayak: flight, hotel, car, etc.)
• Data Science Initiative - Microsoft Research has various datasets and access to tools that can aid in data science research