That's not how it works... The larger the skew, the farther away they are. If your median goes up significantly because of whales, that means they're not really "whales" as usually understood.