Sound is just the vibrations of the air, so as music fades, the air calms. Echoes, reverberance, they are just a result of sound "dampening", and as each sound wave hits a surface that it reflects from the sound waves are also dampened.
So is the question where does music go? Or is it really, "where does silence come from?"