The city of Jerusalem didn't start with the Jews. It was an ancient city in Canaan, possibly the home of Melchizedek, and David had to conquer the city to make it his capital. Soon, it became the center of Israel and God's dwelling on earth.