Occasional stuttery playback of the new UK Blu-ray of The Sweeney

This doesn’t seem to happen all the time, but occasionally when I’m watching streaming the untouched m2ts files from the UK boxset of The Sweeney the video starts becoming very choppy and stuttery and sometimes will end up just freezing completely even while the audio still plays. Just restarting playback of the file does not usually fix the issue. Sometimes I have to complete force kill Infuse or even restart my AppleTV to get it to start playing back the files correctly again. I can often watch multiple files in a row and then just out of the blue, the next episode may either start playing choppy from the beginning or it will start acting up somewhere in the middle of the episode.

From one of the m2ts files this is from MediaInfo:

Video
ID                                       : 4113 (0x1011)
Menu ID                                  : 1 (0x1)
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format profile                           : High@L4.1
Format settings                          : CABAC / 4 Ref Frames
Format settings, CABAC                   : Yes
Format settings, Reference frames        : 4 frames
Format settings, Slice count             : 4 slices per frame
Codec ID                                 : 27
Duration                                 : 51 min 10 s
Bit rate mode                            : Variable
Maximum bit rate                         : 32.0 Mb/s
Width                                    : 1 920 pixels
Height                                   : 1 080 pixels
Display aspect ratio                     : 16:9
Frame rate                               : 25.000 FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Scan type                                : MBAFF
Scan type, store method                  : Interleaved fields
Scan order                               : Top Field First
Time code of first frame                 : 00:59:58:00

I can also provide a snippet of one of the m2ts files if that would be helpful.

Edit to add:

I’m playing this on a 3rd gen Apple TV 4K.