Seriously. I'm thinking it's time I set up my phone to turn off wifi whenever I am away from home.

But would that even be the end of it? With Wifi off the phone is still broadcasting on cellular channels. Could a device be built that listened to those signals and uniquely identify them?