That's right. Specifying the destination synth is primary.
Channels come more into play when you are using something like TTS-1, Sample Tank, or Proteus.
With these, the channel will specify the instrument or part that the MIDI data is being directed to.
In the following screen shot, all synths are receiving on channel 10.
But the notes are being distributed properly, as the waveform shows.
KC, does this drum map look like what you are trying to do?