In Ephesians, Paul tells us to celebrate our faith by singing hymns and other Christian songs.  The New Testament does contain fragments of what appear to be early Christian hymns.  We celebrate the worship and evangelical impact of music on the Christian church.  In particular, hymns like Amazing Grace have hugely influenced converts over the last couple of centuries.