The idea behind “rejoice” is that God enjoys being with us and we should enjoy being with him - but often it doesn’t feel that way.
We often imagine God as this big angry man ready to punish us - but He’s actually a wonderful loving father ready and waiting to pour His life into us.
Prayer is not punishment - it’s life!