Dealing with wannabe college bully?

So I transferred to this college and I'm liking the place but the only problem is I'm having some problems with the guy who lives next to me in the dorms. Apparently some guys from my hs beat up a friend of his and he just won't leave all that in the past. He talks trash ONLY when about 3-4 of his friends are around( other than that he's quiet as a mouse). He calls me Urkel forgetting the fact that he wears glasses also, looking like a before picture of a black jerod. Now here's the problem, there is a zero tolerance policy for fighting on campus. Ive tried talking to him (lol) but no effect. Even though I'm smaller that him I know in a 1 on 1 fight I could beat the snort out of this punk pretty much on the basis that I wont allow myself to lose to the likes of him. Should I challenge him to come to one of my mma classes to put him in his place? Should I catch him at one of these parties and just embarrass him? I know someones gonna say this but *sigh* should I just ignore him?