I get the feeling that he had a little liquor in him, started looking at Khloe with the Shaq face but then came back to the reality that she's into brothers. When he said "A lot of guys want to have sex with you...but then they're like fukk, I'm not Black, I can't hook up with her" he was really talking about his own internal thoughts.
I remember a lot of whiteboys in grade school who would sit up steaming about cacettes who they liked but were into brothers. It usually translated into some passive aggressive "so why do you like Black guys so much?" conversation where they were upset they couldn't get the girl but didn't want to be blatantly racist.