He's OP in that server, therefore he's been given the responsibilities as ownership of the server itself.
He can do whatever he wants to do (abiding by the rules, or course), which includes kick/banning you.