As stated in Tanya, a person should not be down due to their spiritual state. Instead, one should be filled with great joy. Remember, you were created to serve your Master, so how you serve doesn't matter. When you influence and help others, Hashem will also help you.
https://www.torahrecordings.com/rebbe/igroskodesh/011/012/3760