I turned off my subwoofer for music and my speakers finally sounded right

A subwoofer adds extra bass (and complexity) to your setup. Good-old two-channel stereo might be better…