Bateman did lots of measurements of capacitor distortion...
https://linearaudio.nl/cyril-batemans-capacitor-sound-articles
Basically electrolytic cap distortion is due to non-linearities inside the cap, so as you'd expect it increases with increasing voltage across the cap.
This means don't use electrolytics in filters (that wouldn't be a very good idea anyway considering the tolerance). However the voltage across a coupling cap remains relatively constant as long as capacitor value is large enough, so electrolytics are fine for coupling.
For example, if you have a 2V RMS signal, a 10µF coupling cap, and a 47k resistor to ground at the input of your device then there will only be 6mV across the cap at 100Hz. According to Bateman this would result in non measurable distortion.
Two polar caps in anti-series perform just as well as bipolar caps, so you can use that without problem (check the 10µF cap measurements in the article linked above). In fact 2 caps in series distort less than one cap since voltage across each cap is halved.
If there is DC across the cap, leakage current can be an issue, that will introduce DC offset in the circuit after the cap, so don't use fancy polymer caps which are optimized for low ESR but have high leakage! Just use good quality electrolytics.
Do not use Class-2 ceramics (X7R, etc) for coupling or filters. They are piezoelectric microphones... and the capacitance varies with voltage a lot. C0G ceramic on the other hand is excellent, ideal for filters, low tolerance, sub-ppm distortion, cheap, but useless for coupling as values available are too small.
Audiophiles love big film caps. They are microphonic and will resonate, the bigger the better. Put a DC bias across it, connect that to the input of an amplifier and knock on it with your fingernail... Thump thump! Some even sound like a gong. So, sure, these will sound "different"!... Electrolytics are not microphonic at all.