Funny story (to me at least). My dog has different barks for different animals that come by at night. Her bark for opossums is high and excited, and her bark for raccoons is meaner and growlier. One night she started going off, and I was initially confused, because her bark was kind of a mix of the two. I go out to tell her to knock it off and on the fence is the biggest fucking opossum I’ve ever seen. It was probably 25 pounds at least. No wonder she was confused!
Harmony.
Melody is the part that you sing (essentially). Harmony is the chords underneath. If you mean you want to take away all tones, then rhythm.
But music is not a pattern of vibes. Music is a pattern of many things, including melody, harmony, rhythm, dynamics, all imposed over a steady beat. I think your premise is flawed.