Davis leaving police commissioner post