How do we configure Slurm to use a directory other than /tmp for $TMPDIR? Our users are routinely filling up /tmp. In our environment we'd like for the default temporary directory for users jobs to point to /scratch/local or even better something like /scratch/local/${SLURM_JOB_ID} Any suggestions on how to accomplish this on the server configuration side?
Hi, could you try writing a Prolog and a TaskProlog[1] scripts. In the Prolog script, as it is executed in the compute node by SlurmdUser (usually root), you could create your desired dir and chown/chmod it to the submitting user. Take into account that SLURM_JOB_ID and SLURM_JOB_USER can provide you with this information. Then in the TaskProlog script you could export TMPDIR env var to the desired created dir. Please, let me know if this work for you. [1] http://slurm.schedmd.com/prolog_epilog.html
Hi, were you finally able to use /scratch/local/${SLURM_JOB_ID} through the prolog scripts? Is there anything more that we can help you or can we close this bug? Thanks.
Unfortunately, I haven't had time to work on this. Based on your description I should have enough information to go on once I get some free cycles. We can close the ticket.
All right, please reopen if you have any more doubts.