Also noticed this for a while, playing back MKVs, at some point there’s a jump in picture and audio goes off sync, by a lot. Only solution is to stop playback, restart the app and resume. It doesn’t matter what kind of MKV, it happens on all of them.
I use a MacBook Pro M1 Max, Ventura 13.4.1, Infuse 7.6.4523 and listen to audio with my Airpods Max.