When doing TTRPGs live, you don't necessarily want to lose room ambience when you switch or mute voice mods.
To make this feature really work in that context, you need the option to keep an ambience going as long as you need while having the option to switching or mute voices as required.
This runs slightly counter to pairing voices with FX, but you could still give the option to 'hold' a particular voices FX, and then revert FX to the currently selected voice at will. You could then 'hold' that voices effects in precisely the same way.
Would need testing, but a solid addition for TTRPG folks.