It turns out that there exists a fairly universal format called m3u format, and it can be as simple as a list of filenames separated by newlines.

$ cd to the directory

and

$ ls -1 *.mp3 > playlist.m3u

That’s it, after this you can just open the playlist and reorder the songs on the desired order.