Author Topic: MPI job manager  (Read 7006 times)

0 Members and 1 Guest are viewing this topic.

Offline ams_nanolab

  • Supreme QuantumATK Wizard
  • *****
  • Posts: 389
  • Country: in
  • Reputation: 11
    • View Profile
MPI job manager
« on: December 18, 2015, 09:55 »
Will the settings in the attached screenshot be equivalent to  command line "mpiexec -n 2 ... " for running simulations?

In my system mpiexec -n 2 runs perfectly but with this job manager simulations do not run, the log is also empty.
« Last Edit: December 18, 2015, 10:03 by ams_nanolab »

Offline Jess Wellendorff

  • QuantumATK Staff
  • Supreme QuantumATK Wizard
  • *****
  • Posts: 933
  • Country: dk
  • Reputation: 29
    • View Profile
Re: MPI job manager
« Reply #1 on: December 21, 2015, 10:27 »
Should work if you disable MKL_DYNAMIC.

Offline Anders Blom

  • QuantumATK Staff
  • Supreme QuantumATK Wizard
  • *****
  • Posts: 5418
  • Country: dk
  • Reputation: 89
    • View Profile
    • QuantumATK at Synopsys
Re: MPI job manager
« Reply #2 on: December 21, 2015, 10:37 »
Actually, MKL_DYNAMIC only influences performance, not whether it runs or not. Maybe you need to give the full PATH to mpiexec?

Offline ams_nanolab

  • Supreme QuantumATK Wizard
  • *****
  • Posts: 389
  • Country: in
  • Reputation: 11
    • View Profile
Re: MPI job manager
« Reply #3 on: December 23, 2015, 07:00 »
okk will try that

Offline ams_nanolab

  • Supreme QuantumATK Wizard
  • *****
  • Posts: 389
  • Country: in
  • Reputation: 11
    • View Profile
Re: MPI job manager
« Reply #4 on: January 8, 2016, 08:49 »
Still not working.
I type
 ~] which mpiexec
I get /usr/bin/mpiexec
So my path is /usr/bin/mpiexec i think.

I created a machine with the settings as attached.

Still job doesn't run (it doesn't show fail either and log file is empty) and no nc file is created. What could be wrong  ??? ???

I am having to use command line to run mpi process.
« Last Edit: January 8, 2016, 08:53 by ams_nanolab »

Offline ams_nanolab

  • Supreme QuantumATK Wizard
  • *****
  • Posts: 389
  • Country: in
  • Reputation: 11
    • View Profile
Re: MPI job manager
« Reply #5 on: January 8, 2016, 08:59 »
I am using CentOS 6.6 (64 bit).

Offline Jess Wellendorff

  • QuantumATK Staff
  • Supreme QuantumATK Wizard
  • *****
  • Posts: 933
  • Country: dk
  • Reputation: 29
    • View Profile
Re: MPI job manager
« Reply #6 on: January 14, 2016, 10:02 »
Are you using Open MPI?

Offline kanna

  • Regular QuantumATK user
  • **
  • Posts: 19
  • Reputation: 0
    • View Profile
Re: MPI job manager
« Reply #7 on: January 17, 2016, 08:45 »
I am comfortable using the commandline with mpiexec -n <threads>
Is there anything which reduces performance with this method ?

Offline Arun Dubey

  • New QuantumATK user
  • *
  • Posts: 3
  • Country: in
  • Reputation: 0
    • View Profile
Re: MPI job manager
« Reply #8 on: January 18, 2016, 06:24 »
I have used job manager with parallel feature. The executable path is right but not complete. I am using
/usr/bin/mpiexec.hydra or (/usr/local/bin/mpiexec.hydra).

I think this should work on your PC also.

Offline Jess Wellendorff

  • QuantumATK Staff
  • Supreme QuantumATK Wizard
  • *****
  • Posts: 933
  • Country: dk
  • Reputation: 29
    • View Profile
Re: MPI job manager
« Reply #9 on: January 18, 2016, 08:47 »
@kanna: There is nothing wrong with using mpiexec from the command line.

@arun: My mpiexec path is "/usr/local/bin/mpiexec", which works fine as long as is an Intel or MPICH mpi implementation. OpenMPI will not work with ATK, and I suspect this is the root cause of the issue at hand.

Offline Anders Blom

  • QuantumATK Staff
  • Supreme QuantumATK Wizard
  • *****
  • Posts: 5418
  • Country: dk
  • Reputation: 89
    • View Profile
    • QuantumATK at Synopsys
Re: MPI job manager
« Reply #10 on: January 18, 2016, 10:19 »
In terms of performance: just remember to turn off threading (export MKL_NUM_THREADS=1) if you are using all (or many) cores on the same machine for MPI.


Offline kanna

  • Regular QuantumATK user
  • **
  • Posts: 19
  • Reputation: 0
    • View Profile
Re: MPI job manager
« Reply #11 on: January 18, 2016, 14:36 »
Thanks Dr.Anders

Offline ams_nanolab

  • Supreme QuantumATK Wizard
  • *****
  • Posts: 389
  • Country: in
  • Reputation: 11
    • View Profile
Re: MPI job manager
« Reply #12 on: January 22, 2016, 11:39 »
If Open MPI won't work with ATK, how is it running from the command line? I'm confused.  :o

Offline Anders Blom

  • QuantumATK Staff
  • Supreme QuantumATK Wizard
  • *****
  • Posts: 5418
  • Country: dk
  • Reputation: 89
    • View Profile
    • QuantumATK at Synopsys
Re: MPI job manager
« Reply #13 on: January 22, 2016, 12:10 »
With MPICH2.

Offline ams_nanolab

  • Supreme QuantumATK Wizard
  • *****
  • Posts: 389
  • Country: in
  • Reputation: 11
    • View Profile
Re: MPI job manager
« Reply #14 on: January 22, 2016, 12:18 »
Okay, so if I do have MPICH2 in my system then there should be no problem in running mpi with the job manager GUI. But strangely that's not happening, it is not clear to me what is wrong?