Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Drop manylinux2010 #6694

Merged
merged 2 commits into from
Apr 26, 2022
Merged

Drop manylinux2010 #6694

merged 2 commits into from
Apr 26, 2022

Conversation

alex
Copy link
Member

@alex alex commented Dec 12, 2021

It has very low usage

@alex
Copy link
Member Author

alex commented Dec 12, 2021

Here's the query I used:

SELECT
  file.filename,
  COUNT(*) AS download_count
FROM
  `bigquery-public-data.pypi.file_downloads`
WHERE
  file.project = 'cryptography'
  AND DATE(timestamp) BETWEEN DATE_SUB(CURRENT_DATE(), INTERVAL 30 DAY)
  AND CURRENT_DATE()
  AND file.type = 'bdist_wheel'
  AND file.filename LIKE '%manylinux%'
  AND file.version IN ('35.0.0', '36.0.0')
GROUP BY
  file.filename
HAVING
  download_count >= 100
ORDER BY
  download_count DESC
LIMIT
  100

I then summed up all rows, and all rows where "2010" in filename and divided. Roughly 2% of wheel downloads of recent cryptography versions are manylinux2010.

@tiran
Copy link
Contributor

tiran commented Dec 12, 2021

The 2% are probably AWS Lambda users, see #6391

@alex
Copy link
Member Author

alex commented Dec 12, 2021

Clean wheel-builder run: https://github.com/pyca/cryptography/actions/runs/1569742750

@tiran does lambda really not support manylinux2014?

@tiran
Copy link
Contributor

tiran commented Dec 12, 2021

@tiran does lambda really not support manylinux2014?

I don't know, I don't use Lambda. #6391 is based on community feedback.

@alex
Copy link
Member Author

alex commented Dec 12, 2021

It looks like Amazon Linux 2 has a glibc 2.26, so that's fine. If you use AL1 I'm not sure what version of glibc it has, but AL1 appears to be extremely deprecated by Amazon.

@reaperhulk
Copy link
Member

I was going to say I wanted to keep this, but manylinux2010 is CentOS 6 derived and that is indeed ancient. The one bit of breakage it seems like we're going to cause here is users who are explicitly passing --plat with the 2010 tag (which seems to mostly be lambda folks). They can switch to 2014 with no ill effects of course, but do we know what AWS is currently recommending in their lambda docs?

@alex
Copy link
Member Author

alex commented Dec 13, 2021 via email

@alex
Copy link
Member Author

alex commented Dec 13, 2021

https://aws.amazon.com/premiumsupport/knowledge-center/lambda-python-package-compatible/ is the one thing I can find... which suggests downloading manylinux1 wheels by hand.

@reaperhulk
Copy link
Member

Ouch, who do we know who can agitate to get that fixed... @mattsb42-aws would you know somebody who could update this guidance?

@mattsb42-aws
Copy link
Contributor

I'm not sure who owns that knowledge center doc, but the "Anything we could improve" feedback link (bottom right) should contact the right owners. Ditto on the "Provide feedback" links at the bottom of each docs.aws.amazon.com page. In fact, I would say that knowledge center doc should probably just direct readers to the Lambda docs[1].

I'm not deep in the Lambda Python packaging space anymore, but if AL1 is causing Lambda issues, I suspect that's coming from folks using the Python 3.7 and earlier runtimes[2], since those still use AL1 (and probably always will until they are deprecated.)

[1] https://docs.aws.amazon.com/lambda/latest/dg/python-package.html
[2] https://docs.aws.amazon.com/lambda/latest/dg/lambda-runtimes.html

@reaperhulk
Copy link
Member

Thanks Matt, I've sent feedback via the form.

@alex
Copy link
Member Author

alex commented Jan 30, 2022

Refreshed stats, looking over the past month, and it's now down to 1.5%

@alex
Copy link
Member Author

alex commented Apr 3, 2022

Metric is down to 0.87% of wheels from 35.x and 36.x being manylinux2010

It has very low usage
@reaperhulk reaperhulk enabled auto-merge (squash) April 26, 2022 18:32
@reaperhulk reaperhulk merged commit 4d58800 into main Apr 26, 2022
@alex alex deleted the drop-manylinux2010 branch April 26, 2022 19:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

4 participants