worker-real
FACQ, Laurent
Institut de Mathématiques de Bordeaux [IMB]
Institut National des Sciences Mathématiques et de leurs Interactions - CNRS Mathématiques [INSMI-CNRS]
Centre National de la Recherche Scientifique [CNRS]
Institut de Mathématiques de Bordeaux [IMB]
Institut National des Sciences Mathématiques et de leurs Interactions - CNRS Mathématiques [INSMI-CNRS]
Centre National de la Recherche Scientifique [CNRS]
FACQ, Laurent
Institut de Mathématiques de Bordeaux [IMB]
Institut National des Sciences Mathématiques et de leurs Interactions - CNRS Mathématiques [INSMI-CNRS]
Centre National de la Recherche Scientifique [CNRS]
< Réduire
Institut de Mathématiques de Bordeaux [IMB]
Institut National des Sciences Mathématiques et de leurs Interactions - CNRS Mathématiques [INSMI-CNRS]
Centre National de la Recherche Scientifique [CNRS]
Langue
en
Résumé en anglais
Worker-Real is very use full when you have a lot of small tasks you want to submit on a slurm/torque HPC platform and you to pack those small tasks into bigger ones to reach the cluster scheduler optimal granularity.Worker-Real ...Lire la suite >
Worker-Real is very use full when you have a lot of small tasks you want to submit on a slurm/torque HPC platform and you to pack those small tasks into bigger ones to reach the cluster scheduler optimal granularity.Worker-Real allows you to reserve some resources (several nodes for several hours or days) to process a lot of small (or not so small) tasks.Tasks are represented by files.Each task can run on one or several cores. You must describe the running conditions in your batch file.At any time, you can add or remove tasks to be processed using easy files manipulations.At any time you can add computing power by starting new jobs that will process tasks from the same task pool (a simple directory).In case of HPC platform crash, you just need to move (mv command) files from the jobs-runnig directory to the jobs-todo directory and start a new job.< Réduire
Mots clés en anglais
HPC Calcul Haute Performance
slurm
torque
jobs packing
granularity
state on disk
Origine
Importé de halUnités de recherche