Sometimes is a good idea to give up. Not everybody needs to speak a lot of languages and not everybody needs to learn another language.
If you feel like giving up, do not feel guilty. You will find other activities or hobbies which will make you happy.