The ONLY way I was able to circumvent this problem was to attach an external audio device to my Mac and then, after selecting this device for "audio conferencing", I was able to hear sound loud and clear from my built-in speakers (no audio ducking) :