So the problem was that Michal was hitting the “ffmpeg can’t handle FLAC files with more than 64k of metadata”.
Fortunately for him, most of the metadata on the problematic files were actually padding as they had been deleted without using the proper options to not generate padding.