Summary: | Ports that must be open on a Submit Host's Firewall? | ||
---|---|---|---|
Product: | Slurm | Reporter: | UAB Research Computing <RC_LICENSES> |
Component: | Configuration | Assignee: | Director of Support <support> |
Status: | RESOLVED INFOGIVEN | QA Contact: | |
Severity: | 4 - Minor Issue | ||
Priority: | --- | CC: | RC_LICENSES |
Version: | 16.05.8 | ||
Hardware: | Linux | ||
OS: | Linux | ||
Site: | UAB | Alineos Sites: | --- |
Atos/Eviden Sites: | --- | Confidential Site: | --- |
Coreweave sites: | --- | Cray Sites: | --- |
DS9 clusters: | --- | HPCnow Sites: | --- |
HPE Sites: | --- | IBM Sites: | --- |
NOAA SIte: | --- | OCF Sites: | --- |
Recursion Pharma Sites: | --- | SFW Sites: | --- |
SNIC sites: | --- | Linux Distro: | --- |
Machine Name: | CLE Version: | ||
Version Fixed: | Target Release: | --- | |
DevPrio: | --- | Emory-Cloud Sites: | --- |
Description
UAB Research Computing
2017-06-01 10:08:24 MDT
This is what we have defined in slurm.conf regarding ports: $ grep -i port /etc/slurm/slurm.conf SlurmctldPort=6817 SlurmdPort=6818 #SchedulerPort= In case the following is relevant, the size of our cluster is as follows: Our current cluster has 96 nodes, 2304 CPU cores, 8 GPUs and 4 Phi We are expanding soon to 114 nodes, 2736 CPU cores, 80 GPUs and 4 Phi I was able work around the issue last night by opening ports 30,000 thru 63,000 to the compute nodes and masters, although I suspect that's not the full range. Hello Mike, "srun" listens on a random port unless you set SrunPortRange in your slurm.conf file. For example: SrunPortRange=60001-63000 See more here: https://slurm.schedmd.com/slurm.conf.html#OPT_SrunPortRange One important note you'll see in the documentation: Note: A sufficient number of ports must be configured based on the estimated number of srun on the submission nodes considering that srun opens 3 listening ports plus 2 more for every 48 hosts. Example: srun -N 48 will use 5 listening ports. srun -N 50 will use 7 listening ports. srun -N 200 will use 13 listening ports. Let me know if you have any further questions or if I'm okay to close this bug. Regards Tim Hey Mike - I'm marking this resolved/infogiven while Tim's out on vacation. Please reopen if there's anything further we can answer. cheers, - Tim |