Unfortunately for us Americans that love the sport, the USMNT will never be competitive at the world level while it languishes in the 4th to 6th range of overall popularity. I came to post something about that but MrMarcello said it very well:
I must ask - do you know much about the sporting culture in the US? Soccer (or football if you want) is like the fifth or sixth favored professional sport in the country, and thus the top athletes, top minds, and top dollars do not flood into it like the other sports. Other countries see football as their top sport, and in a few others as their second top sport. The population comment isn't representative of the actual reality. China has 1.4 billion people and India has 1.3 billion - neither qualified and rarely do.
Two anecdotes:
When I was a little kid in the early 70's, nearly every kid in the neighborhood played soccer. At least until they were about 10, then none of my friends played. They were all playing throwball, baseball or basketball. In fact, playing soccer was shunned, not only by the other kids but by gym teachers and coaches of other sports. Not to mention some parents unrealistic ideas of their kids being the next Mantle, Hornung or Russell and refusing to let their kids play that sissy sport. I had a middle school teacher basically insinuate those of us who played soccer were gay (plays soccer cuz he gives good head, stupid shyte like that). A teacher! A grown ass man in charge of "molding the minds" of the kids. Which partly leads to...
On my ride in to work today, the local sports radio station spent about 3-4 minutes talking about the USMNT being eliminated. Know that this is the only 3-4 minutes I have heard them talk about the sport in months. No scores, no news, nothing. And, the only thing they really had to say was "who cares", "it's boring". They went on to saying that they only think of it on occasion, like the Olympics, and specifically brought up a comparison with 4-man bobsled. That they only found it slightly interesting at the time, as a novelty, and could care less the rest of the time. They then stuck the knife in to end the segment saying that if there was a 4-man bobsled league, they would probably watch that over soccer (as long as it only lasted about two weeks, between the Super Bowl and BB spring training). That will be the last I hear for probably the next couple years.
So, let me ask you, if you were a kid listening to that on your way to school, would you stand up to your friends and defend your love for the sport when you know what the grownups are saying? The answer, in most cases, is no. You conform to the popular opinion or be ostracized. Middle school/high school is tough enough to navigate without that to deal with and the other sports are fun to play too.
I wish that soccer was the main sport in America. I love it and I think the US has the athletes that we could in time have a legitimate shot at reaching the QFs in the big tourneys. And, within 50 years, maybe even compete beyond that! Sad that that will never happen in my lifetime.