An entry from 2009-10-30 in the Journal. Continuing from yesterday's talks here are my summary of the second and last day of NoSQL East. Pig--Kevin Weil--Twitter Data is getting big. NYSE produces 1TB of data every day, Facebook produces 20TB+ of compressed data each day, and CERN produces 40TB each day (15PB each year). This creates a need for multiple machines and horizontal scalability. Hadoop