You are making a lot of generalizations from your own life experience. One person's experience does not constitute a generally applicable universal law. There are loads of such people in places like Silicon Valley, in Europe, in Tokyo and many tech hubs. They love anime, games, they have various game controllers, they are socially awkward, and many are married with children too.
Similarly you have no idea whether any of your more 'smart Ivy league friends who dont like anime and games' actually have hobbies that they are not exposing to the wider world including close friends, for fear of social castration. Such hobbies and tastes can only be enjoyed publicly in social settings in which they are acceptable.
That show describes a very specific social setting, a very specific demographic from a very specific socioeconomic segment. And in that setting, it is a show that is pretty spot on. In some cases, its quite realistic too.