In order to do supervised learning, you need a labeled training dataset. Or do you...?

Relevant links:

http://www.cs.columbia.edu/~dplewis/candidacy/goldman00enhancing.pdf