Paging and Intercom- Whisper

I know the Whisper feature in Paging and Intercom is anew and considered experimental but I was wondering if there was a way for me to talk back to the person who is whispering without the party I am on the phone with hearing it?

No possible way. You can mix audio, you can’t unmix it.