Consider an icosahedron. At each vertex a person with a vector pointing outwards. In this example, people are normalized and can be understood by 3 dimensions. There you have 12 unique persons, each of them an average of the 5 surrounding it. Pick one of them as the best, you will see that doesn't in any way violate that it is still the average.
Anyway, yeah, it also smells bad, but it could have a grain of truth.
But you're right, and what's even better is that the icosahedron case generalizes to people walking on the surface of a sphere (assuming they're evenly spaced).
Erm, I could be wrong but wouldn't the icosahedron be the maximum "evenly spaced" set of people on the surface of a sphere (that weren't all confined to a great circle)? Lots of regular polygons, rather fewer regular polyhedra.
Anyway, yeah, it also smells bad, but it could have a grain of truth.