He gets by on his reputation of "not to be fucked with" and the fact that they all know he's one of the most famous people in there which is intimidating to the other house mates.
He really is a prick though, I agree. He's a grumpy old man with quite a snide edge to him. Despite the massive pay check he's done himself no favours from going on the show.