The way I play the harbor master now is as follows:

Each settlement on a harbor is worth one "harbor point," while each city is worth two points. Once you get three total harbor points, you can claim the card. Someone has to get more than you to take it.