infochimps.org - help
ComingAttractions (changes)

Showing changes from revision #0 to #1: Added | Removed

A sampling of the datasets we’re adding soon

We’ve just launched the website (5 Mar 2008), which required that we focus on what description and organization the website needed from the datasets.

That’s all in place now, so we have to go back and apply this workflow to the many, many fascinating datasets we’ve collected and organized. There’s every reason to believe that most of the datasets listed below will be live within the next two weeks. If you’d like to demand faster progress (or get access to what we’ve got so far no matter how it looks) please email help@infochimps.org and we’ll work something out.

• demographics
  • world
    • world bank development data—variety of country data from world bank
    • CIA factbook
  • us
    • us_statistical_abstract—an exhaustive categorization of demographic, commercial and social data for the US
    • The full US Census Summary File 3, at the zipcode level.

• money:
  • US Stock market daily—Daily open/close/lo/hi for all listed stocks since 1970
  • US Campaign finance—Expenditures in US presidential, senate, house and governor races in 2004
  • Constantcurrency—Variety of currencies in constant dollars/pounds etc back to the 1600s

• huge & Miscellaneous:
  • infoboxen:—All the infoboxes from Wikipedia broken out into individual semantically labelled tables

• joins:
  • Common coding systems for
    • country codes, including a useful keying database from common names (“USA”, “U.S.A”, “United States”, ...) to ISO country code
    • languages
    • currencies, etc.
  • time—conversions among all of the (curiously many) competing means of measuring dates and times

• health
  • odds of dying—all causes of death in the US, broken down by category and given as rate and odds
  • middle east conflict casualties—civilian and military deaths in Iraq (OIF) and Afghanistan (OEF) since 2003/2001

• science, math & engineering:
  • nasa_eclipse 5000 years of solar and lunar eclipse, lunar phase, and planetary transits from NASA
  • 270,000+ MSDS (Materials Safety datasheets) listing properties and hazards of common and industrial chemical substances
  • material properties—basic chemical and physical properties for common chemical substances
  • powergrid Network of Power Grid Connections in the Western US (Strogatz1998)
  • fastenerdata Screw, Bolt, and Threaded Fasteners: Dimensions, Mechanical Strengths and Properties, and other useful information
  • mechanical properties Mechanical Properties for a variety of useful materials
  • consts and units Universal constants and unit conversion factors
  • standard mathematical tables Tables of Elementary functions (log, bessel, etc) over large range
  • mathematical constants The fundamental mathematical constants calculated to millions and occasionally billions of decimal places

• Art and Culture
  • Full contents of the imdb.com dataset and the musicbrainz.org datasets

• geo:
  • A huge assortment of GIS layers from nationalatlas.gov
  • Geographical place names & locations from geonames.org
  • TigerLine, a mapping from street address to location for the full US (this will take a while)
  • Postal codes – map from zip code to city and latitude/longitude

• time
  • tzinfo time zone info for everywhere
  • calendar_kitchensink 3000 years of time zone, calendar conversion, moon phase, accounting information, etc
  • accounting_calendar last fridays of each month, adjusted for holidays etc.
  • holidays major repeating holidays for most countries

• language:
  • Usage frequency (in speech and print) of every english word, from the British National Corpus
  • Moby Word lists – Word Lists, Multiple Language Lists of Common Words, Hyphenation, Part of Speech, Pronunciation, Thesaurus
  • Natural Language Toolkit Corpora NLTK’s Word lists, semantic networks, lexical data, large text corpora; several languages
  • All the words legal to play in Scrabble™

• sport:
  • Baseball:
  • retrosheet gamelogs: Game outcome and box score for every MLB game back to 1890s
  • retrosheet event files: Play by play information for almost every game back to 1957 (and all since the mid-1970s).
  • baseballdatabank: Season and Career stats for every MLB player, team, etc of all time
  • MLB Gameday: Players, Game state, Pitch-by-Pitch trajectory and Outcome for ~half of the 2007 MLB games.