For me, the sensory distraction of people walking back and forth behind my desk is far worse than in front of it. Even if I have headphones in - vibrations from footsteps, someone bumps my chair, etc.

Damn evolution. At some point, monkeys inclined to facing into the cliff wall got eaten.