I'm using GNU Parallel to automatically start a large number of jobs and distribute them on the cores of a machine. One job per core.
parallel python3 program.py ::: inputs1*
When one set of jobs is about to finish, the remaining jobs only use a subset of the available cores. It would be nice to start the next set of inputs with
parallel so that they only use the unused cores. So at first a subset of all cores but later, once the previous jobs all finished, all available cores (so I can't use
If I just start a second command of
parallel, it starts jobs also for the cores that are already used by the other command. Is there a nice and easy way to avoid that?