Or maybe not *everybody*.
N players in one location mixed down to ~60Kbps is just one stream. Then link M locations "close" (in internet terms) to the same server, where M doesn't exceed capacity and allows for a "listener".
Repeat the above. Have the listeners all connecting to another server where they're players.
Now... the delays on that might be more fun than usual...
You can add hierarchical levels as required to manage bandwidth usage and get more funky delays
.