Would you punish for this or just have a discussion or what?

If this is your worst problem with a 14 year olds behavior I congratulate you on good parenting. I agree it's no big deal. Just talk about it and remind him how many easily offended people are out there in the public realm. Writing an apology is a good idea, but for me that's enough. No need to punish unless he does it again right away.