I have tried the same as you. I have generated a .m3u and opened the playlist in VLC.
To my surprise, it appeared to work like a charm.
No idea what could cause your VLC to kill your firefly server…
… Just before clicking submit, VLC crashed on me, while trying to play another song. I guess VLC just isn’t really good at playing streams. 🙂