St. Augustine is certainly not lacking of history or ghosts.  At the national park of Castillo de San Marcos learn all about how the Spanish were able to fend off enemies in this sturdy structure.  Don't forget to look for a headless ghost while you are there!