Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

optimize computer usage #48

Open
christinafliege opened this issue Jun 15, 2020 · 5 comments
Open

optimize computer usage #48

christinafliege opened this issue Jun 15, 2020 · 5 comments

Comments

@christinafliege
Copy link

Good afternoon!

Pamir has been running successfully for many hours now. We have many more data sets we will be running it on, and so would like to optimize it and economically use our node hours.

Currently, we are using -j16 for our cluster configuration in the qsub script and running on a queue with 2 * Intel Xeon E5 2690 v3 CPUs (24 cores/node) and 256 GB of RAM. We would like to run on all 24 cores, would this be possible?

Additionally, we have access to other nodes which have 192GB and 40cores/node. So ideally we would like to be able to run on these nodes. Would that be possible?

@fhach
Copy link
Collaborator

fhach commented Jun 16, 2020

Technically it can utilize more number of nodes. I will let @f0t1h and @mortunco help you on this matter.

@fhach
Copy link
Collaborator

fhach commented Jun 19, 2020

Can you please post how you run pamir with your qsub.

@mortunco
Copy link
Contributor

Dear @christinafliege

Are you able to share us how you run the pamir on your end. At this moment, all of ours servers are on slurm so we might ask you to run small example couple times to make it working.

Thank you for your help,
T.

@christinafliege
Copy link
Author

Here is the full qsub script. we run on pbs currently, Thank you!

#!/bin/bash

#PBS -N June19_real

#PBS -l nodes=1:ppn=24,walltime=168:00:00

#PBS -M [email protected]

#PBS -m bae

#PBS -S /bin/bash

#PBS -A BANY

#PBS -q big_mem

cd /projects/mgc/Project_2/HLHS_BasilAniseVC/Pamir


module load pamir/pamir-2.1.0

 /usr/local/apps/bioapps/pamir/pamir-2.1.0/pamir.sh  -j16 --configfile /projects/mgc/Project_2/HLHS_BasilAniseVC/Pamir/realconfig.yaml

@mortunco
Copy link
Contributor

@christinafliege oh we thought you were on SGE. okay we have access to PBS and finish this conversion asap.

thanks for your patience.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants