You're not alone, many have felt that way. Dostoyevsky even spoke of a similar feeling in The Brothers Karamazov.
I love humanity . . . but I can’t help being surprised at myself: the more I love humanity in general, the less I love men in particular, I mean, separately, as separate...