The connection is Asymmetric. I have set QoS for sip and RTP to premium. I don't think it's happening only when the outgoing traffic is saturated.
PBX-in a flash
Trunk 1 setup
Trunk 2 setup
Attached is the log for the call. It is abnormally large. For a 5 second call the log was almost 7000 lines!