I wouldn't count on scaring them off. I'm not sure they actually understand things like consequences. Or fear. Or going back into water instead of flopping around on land.

[Harry briefly had a Magikarp the last time he came to Johto. He's not sure the fish ever quite understood that it was no longer in the ocean.]

I think the entire species might be in-bred or something.