But these comments are just playful banter?

Notice how the Muhajir stroked the Ansari man as a joke...but look at what it led to! Did the Prophet ﷺ make excuses after they had explained to him that this transpired from a joke? NO! Rather he censured both sides saying: دعوها leave this off فإنها خبيثة this is an evil call