Oh what an interesting question.
The single-word switch indicator is used only for a word. The literary ampersand, as seen in your example, is a symbol--not a word--so you will need to switch out of Nemeth before transcribing the UEB symbol for the ampersand (4, 12346).
-Lindy