My company, CrowdFlower, recently conducted a survey of data scientists. One of the things we asked was what they spend their time working on and what they like and don’t like doing. Incredibly, cleaning and wrangling data, the thing they dislike the most, is the thing they spend the most time doing. The New York times has reported on this phenomenon and Michael Driscoll recently articulated the same concern in an article in Ad Age, saying “The best minds of my generation are deleting commas from log files, and that makes me sad.“ 

To read this article in full or to leave a comment, please click here