Then you have to select the crowd appropriately, perhaps implizit at a milonga notoriously unfriendly to beginners ("El Destino" in your area?), or even explizit at an encuenro.
But you usually also get a shift in taste towards "Top 50 Tandas EdO 1941-46".
My personal explanation:
@opendoor is right, the majority of tango dancers simply dance together, mostly in the same style, mostly slightly off-beat. And that often feels better than trying to force yourself to the music. Ultimately, your dance partner is still alive, and the musicians are already dead. Or you end up hopping around to non-tango music.
And then there's a segment of experienced dancers who want to dance musically, fluidly, and with ease to mostly familiar music.
Gifted dancer, who can adapt their dance to a wide range of music, but perhaps only want to dance to a part of it at any given time, are naturally rare.
Personally, I draw my own conclusions from my observations:
In the first third of a milonga, I play simpler but good-sounding pieces. In the second third, I play more complex but good-sounding pieces. And in the final third of a milonga, I play an "endgame" with more opulent and good-sounding pieces (that I personally enjoy). Anyone who doesn't want to join in can go home, but in general, this works very well for my regular milongas.