One way would be to select the entire clip that contains the controller events you wish to delete and then use Edit|Select|by filter. When the dialogue box appears, click none. Then select just controller events. Then hit delete on the computer keyboard. That should delete all of your controller events.
You can even just select the modulation events using this method.