If in live mode, the sender stops sending for 500ms as the data is VBR. Is the receiver meant to resend ACKs of the same ackseq? It appears libsrt 1.4.3 does not like it when a sender does this and it resets the session somehow (potentially specific to someone's implementation).

500ms is less than the keepalive time.