Back to the topic at hand. I think you shouldn't get too worked up over being rejected. If it's by the whole table, maybe you should go look in a mirror to see if something is on your face or out of place? Or just blow them off mentally. It is not easy to do. For some who have felt the pain of rejection many times in their life, accepting another is not easy. That is why I suggest that if you do say no, a polite reason should be part of it. While everyone is responsible for their own thoughts and reactions, you don;t know everyones story, and it doesn't hurt to try a little kindness. You don't know where that person has been.