Hello Marcus, unfortunately I get essentially the same problem. srun spawns #cores instances of the CFX solver, every one of which tries to access all cores. Since they still try to communicate with the other node over ssh the result is the same error as below. Regards, Thomas Von: Marcus Wagner [mailto:wagner@itc.rwth-aachen.de] Gesendet: Dienstag, 12. Februar 2019 15:21 An: claix18-slurm-pilot@lists.rwth-aachen.de Betreff: [claix18-slurm-pilot] Re: Multi-Node ANSYS simulations Dear Thomas, could you please test the following: srun cfx5solve -batch -parallel -partition $SLURM_NTASKS -def job.def -par-dist "$CFXHOSTS" -start-method "Intel MPI Distributed Parallel". Best Marcus On 2/12/19 11:10 AM, Gier, Thomas wrote: Hello, I'm having issues running ANSYS CFX calculations across multiple nodes. Single-node simulations run fine, but multi-node configurations crash because ssh connections are being denied: " +--------------------------------------------------------------------+ | An error has occurred in cfx5solve: | | | | Remote connection to ncm0791.hpc.itc.rwthaachen.de | | (ncm0791.hpc.itc.rwth-aachen.de) could not be started, or exited | | with return code 255. It gave the following output: | | | | Permission denied (publickey,gssapi-keyex,gssapi-with-mic,pass- | | word,hostbased). | | | | Check that you have typed the hostname correctly, and that you | | have an account "tg084461" on the specified host with access | | permission from this host. You can use the following command to | | check the connection to a UNIX machine: | | | | ssh ncm0791.hpc.itc.rwth-aachen.de uname | +--------------------------------------------------------------------+" Am I missing something in my submission script, or is this a cluster config issue? Regards, Thomas Gier _______________________________________________ claix18-slurm-pilot mailing list -- claix18-slurm-pilot@lists.rwth-aachen.de<mailto:claix18-slurm-pilot@lists.rwth-aachen.de> To unsubscribe send an email to claix18-slurm-pilot-leave@lists.rwth-aachen.de<mailto:claix18-slurm-pilot-leave@lists.rwth-aachen.de> -- Marcus Wagner, Dipl.-Inf. IT Center Abteilung: Systeme und Betrieb RWTH Aachen University Seffenter Weg 23 52074 Aachen Tel: +49 241 80-24383 Fax: +49 241 80-624383 wagner@itc.rwth-aachen.de<mailto:wagner@itc.rwth-aachen.de> www.itc.rwth-aachen.de<http://www.itc.rwth-aachen.de>