RequirementParse error on cryptography? #3495

dsethi · 2017-04-06T19:48:26Z

I am using paramiko (2.0.1) with cryptography (1.3.1) on my mac. I get the following requirements parse error:

ERROR - Unknown exception: Invalid requirement, parse error at "''"
ERROR - Traceback (most recent call last):
ERROR - File "/usr/lib/python2.7/site-packages/paramiko/transport.py", line 1774, in run
ERROR - self.kex_engine.parse_next(ptype, m)
ERROR - return self._parse_kexdh_reply(m)
ERROR - File "/usr/lib/python2.7/site-packages/paramiko/kex_group1.py", line 111, in _parse_kexdh_reply
ERROR - self.transport._verify_key(host_key, sig)
ERROR - File "/usr/lib/python2.7/site-packages/paramiko/transport.py", line 1619, in _verify_key
ERROR - key = self._key_infoself.host_key_type
ERROR - File "/usr/lib/python2.7/site-packages/paramiko/rsakey.py", line 58, in init
ERROR - ).public_key(default_backend())
ERROR - File "/usr/lib64/python2.7/site-packages/cryptography/hazmat/backends/init.py", line 35, in default_backend
ERROR - _default_backend = MultiBackend(_available_backends())
ERROR - File "/usr/lib64/python2.7/site-packages/cryptography/hazmat/backends/init.py", line 22, in _available_backends
ERROR - “cryptography.backends"
ERROR - File "/usr/lib/python2.7/site-packages/pkg_resources/init.py", line 706, in iter_entry_points
ERROR - entries = dist.get_entry_map(group)
ERROR - File "/usr/lib/python2.7/site-packages/pkg_resources/init.py", line 2578, in get_entry_map
ERROR - self._get_metadata('entry_points.txt'), self
ERROR - File "/usr/lib/python2.7/site-packages/pkg_resources/init.py", line 2316, in parse_map
ERROR - maps[group] = cls.parse_group(group, lines, dist)
ERROR - File "/usr/lib/python2.7/site-packages/pkg_resources/init.py", line 2294, in parse_group
ERROR - ep = cls.parse(line, dist)
ERROR - File "/usr/lib/python2.7/site-packages/pkg_resources/init.py", line 2276, in parse
ERROR - return cls(res['name'], res['module'], attrs, extras, dist)
ERROR - File "/usr/lib/python2.7/site-packages/pkg_resources/init.py", line 2203, in init
ERROR - self.extras = Requirement.parse(("x[%s]" % ','.join(extras))).extras
ERROR - File "/usr/lib/python2.7/site-packages/pkg_resources/init.py", line 2858, in parse
ERROR - req, = parse_requirements(s)
ERROR - File "/usr/lib/python2.7/site-packages/pkg_resources/init.py", line 2806, in parse_requirements
ERROR - yield Requirement(line)
ERROR - File "/usr/lib/python2.7/site-packages/pkg_resources/init.py", line 2815, in init
ERROR - raise RequirementParseError(str(e))
ERROR - RequirementParseError: Invalid requirement, parse error at "’'"

The text was updated successfully, but these errors were encountered:

alex · 2017-04-06T19:49:55Z

What version of setuptools are you using?

dsethi · 2017-04-06T20:18:40Z

Hi Alex,
I am using 21.0.0
(easy_install --version
setuptools 21.0.0 from /usr/local/lib/python2.7/site-packages (Python 2.7))

alex · 2017-04-06T20:25:40Z

Can you try upgrading setuptools and see if that fixes the issue?

…

On Apr 6, 2017 4:19 PM, "dsethi" ***@***.***> wrote: Hi Alex, I am using 21.0.0 (easy_install --version setuptools 21.0.0 from /usr/local/lib/python2.7/site-packages (Python 2.7)) — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#3495 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAADBDkT8crAMov-K8DUll8cSZKNAdf-ks5rtUjcgaJpZM4M2FUj> .

dsethi · 2017-04-06T21:13:42Z

Thanks. I upgraded. New version: easy_install --version
setuptools 34.3.3 from /usr/local/lib/python2.7/site-packages (Python 2.7)

However, saw the issue again:

Unknown exception: Invalid requirement, parse error at "''"
2017-04-06 14:16:50,601 - 4662317056 - ERROR - Traceback (most recent call last):
2017-04-06 14:16:50,624 - 4662317056 - ERROR - File "/usr/local/lib/python2.7/site-packages/paramiko/transport.py", line 1772, in run
2017-04-06 14:16:50,637 - 4662317056 - ERROR - self.kex_engine.parse_next(ptype, m)
2017-04-06 14:16:50,647 - 4662317056 - ERROR - File "/usr/local/lib/python2.7/site-packages/paramiko/kex_group1.py", line 75, in parse_next
2017-04-06 14:16:50,647 - 4662317056 - ERROR - return self._parse_kexdh_reply(m)
2017-04-06 14:16:50,647 - 4662317056 - ERROR - File "/usr/local/lib/python2.7/site-packages/paramiko/kex_group1.py", line 111, in _parse_kexdh_reply
2017-04-06 14:16:50,647 - 4662317056 - ERROR - self.transport._verify_key(host_key, sig)
2017-04-06 14:16:50,647 - 4662317056 - ERROR - File "/usr/local/lib/python2.7/site-packages/paramiko/transport.py", line 1617, in _verify_key
2017-04-06 14:16:50,647 - 4662317056 - ERROR - key = self._key_infoself.host_key_type
2017-04-06 14:16:50,647 - 4662317056 - ERROR - File "/usr/local/lib/python2.7/site-packages/paramiko/rsakey.py", line 58, in init
2017-04-06 14:16:50,647 - 4662317056 - ERROR - ).public_key(default_backend())
2017-04-06 14:16:50,647 - 4662317056 - ERROR - File "/usr/local/lib/python2.7/site-packages/cryptography/hazmat/backends/init.py", line 35, in default_backend
2017-04-06 14:16:50,647 - 4662317056 - ERROR - _default_backend = MultiBackend(_available_backends())
2017-04-06 14:16:50,647 - 4662317056 - ERROR - File "/usr/local/lib/python2.7/site-packages/cryptography/hazmat/backends/init.py", line 22, in _available_backends
2017-04-06 14:16:50,648 - 4662317056 - ERROR - "cryptography.backends"
2017-04-06 14:16:50,648 - 4662317056 - ERROR - File "/usr/local/lib/python2.7/site-packages/pkg_resources/init.py", line 725, in iter_entry_points
2017-04-06 14:16:50,648 - 4662317056 - ERROR - entries = dist.get_entry_map(group)
2017-04-06 14:16:50,648 - 4662317056 - ERROR - File "/usr/local/lib/python2.7/site-packages/pkg_resources/init.py", line 2656, in get_entry_map
2017-04-06 14:16:50,648 - 4662317056 - ERROR - self._get_metadata('entry_points.txt'), self
2017-04-06 14:16:50,648 - 4662317056 - ERROR - File "/usr/local/lib/python2.7/site-packages/pkg_resources/init.py", line 2394, in parse_map
2017-04-06 14:16:50,649 - 4662317056 - ERROR - maps[group] = cls.parse_group(group, lines, dist)
2017-04-06 14:16:50,650 - 4662317056 - ERROR - File "/usr/local/lib/python2.7/site-packages/pkg_resources/init.py", line 2372, in parse_group
2017-04-06 14:16:50,650 - 4662317056 - ERROR - ep = cls.parse(line, dist)
2017-04-06 14:16:50,650 - 4662317056 - ERROR - File "/usr/local/lib/python2.7/site-packages/pkg_resources/init.py", line 2354, in parse
2017-04-06 14:16:50,650 - 4662317056 - ERROR - return cls(res['name'], res['module'], attrs, extras, dist)
2017-04-06 14:16:50,651 - 4662317056 - ERROR - File "/usr/local/lib/python2.7/site-packages/pkg_resources/init.py", line 2275, in init
2017-04-06 14:16:50,652 - 4662317056 - ERROR - self.extras = Requirement.parse(("x[%s]" % ','.join(extras))).extras
2017-04-06 14:16:50,655 - 4662317056 - ERROR - File "/usr/local/lib/python2.7/site-packages/pkg_resources/init.py", line 2935, in parse
2017-04-06 14:16:50,658 - 4662317056 - ERROR - req, = parse_requirements(s)
2017-04-06 14:16:50,660 - 4662317056 - ERROR - File "/usr/local/lib/python2.7/site-packages/pkg_resources/init.py", line 2883, in parse_requirements
2017-04-06 14:16:50,661 - 4662317056 - ERROR - yield Requirement(line)
2017-04-06 14:16:50,661 - 4662317056 - ERROR - File "/usr/local/lib/python2.7/site-packages/pkg_resources/init.py", line 2892, in init
2017-04-06 14:16:50,694 - 4662317056 - ERROR - raise RequirementParseError(str(e))
2017-04-06 14:16:50,706 - 4662317056 - ERROR - RequirementParseError: Invalid requirement, parse error at "''"

alex · 2017-04-06T21:20:49Z

Sounds good.

…

On Thu, Apr 6, 2017 at 5:13 PM, dsethi ***@***.***> wrote: Thanks. I upgraded. Let me try for some time get back if I see it again (original issue happened non-deterministically so would wait some time before confirming). — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#3495 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAADBFKfigzlosvjKoTnlyrcgElS6mp3ks5rtVWGgaJpZM4M2FUj> .

-- "I disapprove of what you say, but I will defend to the death your right to say it." -- Evelyn Beatrice Hall (summarizing Voltaire) "The people's good is the highest law." -- Cicero GPG Key fingerprint: D1B3 ADC0 E023 8CA6

dsethi · 2017-04-06T21:29:12Z

Alex -- please see my edited comment above -- it re-occurred unfortunately for setup tools version 34.3.3. Thanks for the help!

alex · 2017-04-06T21:31:07Z

Ok. Can you try with the latest version of cryptography?

dsethi · 2017-04-06T21:52:15Z

Thanks Alex - upgraded -- will let you know if I hit it again (or not in some time).

dsethi · 2017-04-06T22:00:22Z

Happened again -- using:
asn1crypto==0.22.0
cryptography==1.8.1
pycrypto==2.6.1

alex · 2017-04-06T22:02:09Z

Huh. Ok. Is there some way I can reproduce this?

dsethi · 2017-04-06T23:47:45Z

Let me try to construct a minimal version of the code which replicates this and get back on this. Problem is I also hit it intermittently (as using multiple threads)

alex · 2017-04-06T23:57:19Z

Ok, I managed to reproduce. This happens on most runs:

import sys
import threading

from cryptography.hazmat.backends import default_backend


N_THREADS = 16

def main(argv):
    threads = []
    for i in range(N_THREADS):
        threads.append(threading.Thread(target=default_backend))
    for t in threads:
        t.start()
    for t in threads:
        t.join()

if __name__ == "__main__":
    main(sys.argv)

alex · 2017-04-07T00:10:34Z

Ok, this appears to be a packaging bug. Going to close this in favor the bug there: pypa/packaging#104

dsethi · 2017-04-07T01:05:05Z

Alex - thanks a bunch for doing this! I will follow the packaging issue thread.

alex · 2017-04-07T01:07:30Z

I've confirmed with @dstufft that there'll be a packaging release in the next few days. In the meantime, you can work around this by calling `defautl_backend()` somewhere before you spawn any threads.

…

On Thu, Apr 6, 2017 at 9:05 PM, dsethi ***@***.***> wrote: Alex - thanks a bunch for doing this! I will follow the packaging issue thread. — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub <#3495 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAADBGfTUs11xHwAubyqVZbIB41pXjHRks5rtYvBgaJpZM4M2FUj> .

-- "I disapprove of what you say, but I will defend to the death your right to say it." -- Evelyn Beatrice Hall (summarizing Voltaire) "The people's good is the highest law." -- Cicero GPG Key fingerprint: D1B3 ADC0 E023 8CA6

dsethi · 2017-04-07T19:35:35Z

Thanks Alex. Very helpful!
I looked into the code a bit and had a few questions on the fix -- please see comments on the commit.

alex closed this as completed Apr 7, 2017

dsethi mentioned this issue Jun 1, 2017

ERROR - RequirementParseError: Invalid requirement, parse error at "’'" paramiko/paramiko#931

Closed

github-actions bot locked as resolved and limited conversation to collaborators Aug 9, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

RequirementParse error on cryptography? #3495

RequirementParse error on cryptography? #3495

dsethi commented Apr 6, 2017 •

edited by alex

Loading

alex commented Apr 6, 2017

dsethi commented Apr 6, 2017

alex commented Apr 6, 2017 via email

dsethi commented Apr 6, 2017 •

edited

Loading

alex commented Apr 6, 2017 via email

dsethi commented Apr 6, 2017

alex commented Apr 6, 2017

dsethi commented Apr 6, 2017

dsethi commented Apr 6, 2017

alex commented Apr 6, 2017

dsethi commented Apr 6, 2017

alex commented Apr 6, 2017

alex commented Apr 7, 2017

dsethi commented Apr 7, 2017

alex commented Apr 7, 2017 via email

dsethi commented Apr 7, 2017

RequirementParse error on cryptography? #3495

RequirementParse error on cryptography? #3495

Comments

dsethi commented Apr 6, 2017 • edited by alex Loading

alex commented Apr 6, 2017

dsethi commented Apr 6, 2017

alex commented Apr 6, 2017 via email

dsethi commented Apr 6, 2017 • edited Loading

alex commented Apr 6, 2017 via email

dsethi commented Apr 6, 2017

alex commented Apr 6, 2017

dsethi commented Apr 6, 2017

dsethi commented Apr 6, 2017

alex commented Apr 6, 2017

dsethi commented Apr 6, 2017

alex commented Apr 6, 2017

alex commented Apr 7, 2017

dsethi commented Apr 7, 2017

alex commented Apr 7, 2017 via email

dsethi commented Apr 7, 2017

dsethi commented Apr 6, 2017 •

edited by alex

Loading

dsethi commented Apr 6, 2017 •

edited

Loading