Musings on Big Data
Recent article in IEEE Spectrum on Big Data
Recant by M. Jordan
Yann LeCun's opinion
Philosophical connections: Ockham's Razor workshop.
Statistical view of Boosting, JMLR 9 (2008) pdf file.