Sometimes you can think of the umluat as adding an "e" after the vowel (as seen in the alternative ligatures), but the best advice to pronounce them is to close your mouth as if you're kissing someone.