Please send a "mute" session-info when video or audio are (temporarily) disabled in a call: https://xmpp.org/extensions/xep-0167.html#info-mute. That way, other clients know that their counterpart disabled audio/video and can use that information to adjust their UI.