From my reading of Marcus Aurelius' Meditations today:
He who ignores what his neighbour is saying or doing or thinking, and cares only that his own actions should be just and godly, is greatly the gainer in time and ease. A good man does not spy around for the black spots in others, but presses unswervingly on towards his mark.
I've long thought that those who are overly concerned with what's going on in my life must have a very boring life of their own. Keep your eye on the prize.