People who are making money off of real estate aren't likely to be the right ones to fix our housing situation. And even when most of the experts agree, there's still a lot more to consider when we talk about affordable housing as a supply issue.