This seems like a very weird interpretation. It literally says to do the thing when you discover a tile with the inhabitant on it.
My group played the same way. The thought process was that the effect isn't in play until you've found them the first time, much like you can't use effects on tiles until they've been found. I don't think it's a huge stretch to interpret it that way# but it's good to have some clarification