The midi buffer size is primarily used by the sequencer engine for sequenced MIDI. A change to that value doesn't impact perceived latency as played by live MIDI from a controller. That is impacted by the audio buffer size and any plugin delay in the project.