Even on the lowest sensitivity setting, highlighting which switch you want to select and change from the map view is too sensitive. The icons either need to have a stronger lock on period once they are highlighted, or the cursor speed needs the ability to be further adjusted.
I usually use the free cam for switches (and coupling) which is why it's a shame the immersion controls don't have a free cam in external view