-
Notifications
You must be signed in to change notification settings - Fork 107
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
"--usemem" parameter don't seem to work #390
Comments
Hi @erick-dorlass , You may try Best, Best, |
Hi @Cantalapiedra Cantalapiedra I tried the CPUs per worker: 1 I have tried running it with different versions of python (3.7, 3.8 and 3.10) however the result is the same CPUs per worker: 1 Jaime Huerta Cepas GPL v2 : A server for HMMER3 in-memory searches It seems that are more tries to create a server with the pip install version, however the result is the same. |
Hi, It might be the hmmer version. Which one are you using? |
Hi, I'm using HMMER 3.3.2, but i also tried with versions 3.1b2, 3.2, 3.2.1, 3.3 and 3.3.1. The same error was reported in all versions. |
Hi, ok. Then it must be another thing. How do you swap between HMMER versions? I guess you are sure that you are trying different versions and not a single version is interfering from the PATH or conda. What is the complete command which you used to create the "viral" database? Also, what is your OS distribution and version? Best, |
Also, you may try to load the DB directly using the hmmer command "hmmgpmd", and see if it is causing the problem, or instead it is an eggnog-mapper problem itself. |
Hi, I was able to create a server (master and worker) with hmmpgmd: However when I try using: I receive the message: Is there a way to create de idmap file in the server or copy it from my local machine? And this will also have to be performed to all hmmpress files? The viral hmm database is being downloaded from http://eggnog5.embl.de/download/eggnog_5.0/per_tax_level/10239/, all HMM files are concatenated with Until now, the hmmer_server.py script don't seem to work, so the option I'm considering is creating the servers with hmmpgmd, create a server list file and pass it as an input to emapper.py. I tested the HMMER versions with conda. I created a new env with eggnog-mapper, uninstall the HMMER downloaded together with eggnog-mapper and install different hmmer versions for testing I'm using a MacOS Monterey v12.3.1 |
Hi @Cantalapiedra I performed a few more tests, and indeed was the hmmer version. Once I installed eggnog-mapper version2.1.7 with pip in a conda env with hmmer v3.1b2 the --usemem, hmmpgmd and hmm_server.py started to work fine. However I'm facing another problem. Once I use:
The servers are uploaded, however I receive the following message: Error: Failed to open target sequence database /home/ec2-user/erick/eggnog_db/hmmer/viral/2756.fa for reading multiprocessing.pool.RemoteTraceback: The above exception was the direct cause of the following exception: Traceback (most recent call last): The .hits file is generated normally, however the "hit" column reads: 2756 instead of a HMM ID (4QCXI): query_name hit evalue sum_score query_length hmmfrom hmmto seqfrom seqto query_coverage It seems that the tool looks for a X.fa for phmmer to generate the .seed.orthologs file. The ".fa" files downloaded with the command
The seed.orthologs file was generated, but a new error apperars: Processed queries:26 total_time:1.509143352508545 rate:17.23 q/s During handling of the above exception, another exception occurred: Traceback (most recent call last): During handling of the above exception, another exception occurred: Traceback (most recent call last): During handling of the above exception, another exception occurred: Traceback (most recent call last): Is there a way to generate te hits file with the correct HMM ID? Should I make an alteration in the downloaded bank? |
Hi @erick-dorlass , sorry for the delay answering. The .idmap file issue could be due to format. Actually, when using
The .idmap file generated is using tabs for separating the 2 fields, whereas the parser expects single whitespace. What does your .idmap file look like? I have been checking the psutil errors, and I am afraid this is also a bug. The results (annotations, etc) should be ok, since this is a final step in which the processes running hmmpgmd server and workers are shutdown. In this case, the servers are already down, and therefore psutil cannot find the process and raises and exception. I could help you to code a workaround in case that you need it fixed ASAP. I will try to have it fixed at least in the master branch soon. Hopefully also the conda version. Best, |
I hope this is of help: https://github.com/eggnogdb/eggnog-mapper/releases/tag/2.1.8 Hopefully the conda version will be ready soon. Best, |
Hello,
I'm using eggnog-mapper for a metagenomic pipeline with hmm searches.
For optimization, i'm using "--usemem" parameter, however the process seems to be stuck in "Waiting for server to become ready". I've seen this same problem been related in other issues as #287 and #33 but without a clear solution. Have this parameter ever worked?
I'm using eggnog-mapper v2.1.7
the command:
emapper.py -m hmmer -d virus --data_dir eggnog_data --usemem -i scaffolds.faa -o test
The text was updated successfully, but these errors were encountered: