How to avoid petty gossip?

i know this sounds like a dumb question, and maybe it's one that has no solution, but how can you avoid gossip? i am one of those people that avoids the spotlight at all costs, i don't cause drama or seek attention, and i'm a firm believer in karma so i do my best not not talk negatively about other people yet no matter where i go i always overhear people talk or rumors about me will get back to me that are so dumb and petty like regarding my appearance (i.e. i am thin so i've heard rumors that i am anorexic...please!) or even knit-picking at just normal daily activities i take part of...it's really annoying and sometimes i feel like i am living under a microscope when i want to just be...what can i do about this?? it's starting to really affect me :/