Yes! Gay or straight isn't the issue here. This is malicious, distracting and inappropriate talk for the workplace. It makes you feel uncomfortable and could be considered harassment and defamation. I would write a formal letter to the GM so you have proof that you have brought this to his attention and let him know if he does not address it that you will take further action (meaning tell his boss).
Good luck!



