Amazon's version of the Mechanical Turk is a service which distributes human judgment problems to the crowd. Dolores Labs is a new enterprise which plans to make managing, collecting, interpreting and leveraging distributable judgment problems and their answers. One can get a good idea of what they do, and for whom, from their examples page, which includes: sentiment analysis, search relevance and classification tasks.
One of the nicest illustrations of the problem space is the labeling of colours. A full description appears on their blog, which includes a pointer to their released data set.