Doing your job and ignoring your boss isn't really stooping to their level. I do what I do and my boss does what he does. We both use power tools, but he constantly harasses me about this or that. I shrug it off and if either of us mess up, only one ends up covered in blood. As long as it's him, I don't care.
I'm not attempting to make his job harder in any way, just not sympathetic to his concerns unless he's proven right in having them.
As for family, I'll tell them to turn a pineapple sideways and inhale it through their asshole if they don't leave me alone when I have shit going on. Some more than others.