Presumably you’re referring to friends/family that want to connect with you. I have no idea why.
How hard is it to pick up and say you’re in the middle of something but look forward to chatting with them? To send a quick text in response to calls you can’t pick up?
Keep this up and you’ll one day be wondering where all your friends went: remember this post (and your attitude and lame name calling) and you’ll have your answer.

Somehow the OP was referring to work colleagues that are being bothersome, not friends and family. You are entitled to enjoy your leisure time whenever you clock out of work so unless it’s anything important like an emergency at work, no one has any right to disturb you.