A man armed with a knife was shot by a police officer Sunday in Gary after authorities say he refused commands to drop the weapon and advanced toward an officer.