They don't, but I think it's fair game. If I'm out in public, I don't care if someone recognizes me and says, "Hi! Keita!" or the government says "oh look, there's Keita!" That's the definition of "being out in public".

I'm a relatively unimportant and insignificant person, though, so I can see that if you're a victim of a stalker, for example, the viewpoint would be completely different.