Ear cancer is a rare type of cancer. Most of these cancers begin on the skin of the outer ear. About 5 to 10 percent of skin cancers occur on the ear. Ear cancer can affect both the external and internal parts of your ear.