I get that you don't want to feel objectified and all that good stuff, and there is a chance that he might just be trying to smash, but ...
You feel used/disrespected and the dude hasn't even smashed and dashed on you -- actions that would justify the so-called "ego boost" you feel that you are for him -- just because he looked at you. He looked at you, and clearly liked what he saw. From what I have seen in this thread, there has been little indication that he is flirty with anyone besides you and from what I have read, I'm inferring that he has a tendency to get bold around you, which means he's probably comfortable in your presence or generally cocky/assertive. In your OP, you said before he looked at you, he was a maybe on the presumed "I'd date/fukk this cat" scale. Outside of coming right out and saying, "I want you" I am not sure what other signal of interest he could have tossed your way.
Answer me this, if you don't mind. You mentioned something about being from a different cultural background. You care to elaborate on that? It might help get to the bottom of why you're offended by someone you find nice/attractive looking at you with desire.