I need to iterate over between 120k and 500k files.
find handles this well.
find $PWD -type f -path "fragments/*.pdbqt"
For some reason I want to list the same set of files again, in the same order. I don't mind if the list is sorted alpha-numerically or by
fstat calls or whatever. Using
sort is not an option because it needs to know the full
find output before proceeding, slowing down the script execution. Do you know some way to accomplish this?
Update. I described my problem poorly. While my script is processing this large number of files, a light outage might occur, and the UPS could go down. My script should continue from where it left off. How can I process the remaining files?