It sounds like most of the stuff that sets you off is people-related. If you are an introvert, certain types of social intrusions are going to generally be harder to deal with than others. The right boss (one who respects your space better), the right type of working environment with the right type of policies and/or the right job where you have less of that might help.