Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve Python 3.11 support #3694

Merged
merged 21 commits into from
Mar 2, 2022
Merged

Improve Python 3.11 support #3694

Show file tree
Hide file tree
Changes from 15 commits
Commits
Show all changes
21 commits
Select commit Hold shift + click to select a range
a0eb05b
Test out Python 3.11 migration
Skylion007 Feb 7, 2022
6a0a4d0
Clean up a bit
Skylion007 Feb 7, 2022
e3f3644
Remove todo
Skylion007 Feb 7, 2022
c0a1306
Test workaround
Skylion007 Feb 7, 2022
a731769
Fix potential bug uncovered in 3.11
Skylion007 Feb 7, 2022
be95611
Try to fix it more
Skylion007 Feb 7, 2022
5864a2a
last ditch fix
Skylion007 Feb 7, 2022
4428748
Merge branch 'master' of https://github.com/pybind/pybind11 into test…
Skylion007 Feb 12, 2022
b292dd8
Revert. Tp-traverse isn't the problem
Skylion007 Feb 12, 2022
729bb4f
Test workaround
Skylion007 Feb 12, 2022
8bd9214
Try this hack
Skylion007 Feb 12, 2022
1457185
Merge branch 'master' of https://github.com/skylion007/pybind11 into …
Skylion007 Feb 27, 2022
b375591
Revert MRO changes
Skylion007 Feb 27, 2022
6fa3fc5
Use f_back properly
Skylion007 Feb 28, 2022
38f9096
Qualify auto
Skylion007 Feb 28, 2022
9b9df3d
Update include/pybind11/pybind11.h
henryiii Mar 1, 2022
6868334
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 1, 2022
1eccd5d
Simplify code slightly
Skylion007 Mar 1, 2022
b87c337
Merge branch 'master' of https://github.com/pybind/pybind11 into test…
Skylion007 Mar 1, 2022
eadcb87
Ensure co_varnames decref if dict_getitem throws
Skylion007 Mar 2, 2022
4add4c2
Eager decref f_code
Skylion007 Mar 2, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 10 additions & 2 deletions include/pybind11/detail/type_caster_base.h
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -502,9 +502,10 @@ PYBIND11_NOINLINE std::string error_string() {
}

PyFrameObject *frame = trace->tb_frame;
Py_XINCREF(frame);
errorString += "\n\nAt:\n";
while (frame) {
# if PY_VERSION_HEX >= 0x03090000
# if PY_VERSION_HEX >= 0x030900B1
PyCodeObject *f_code = PyFrame_GetCode(frame);
# else
PyCodeObject *f_code = frame->f_code;
Expand All @@ -514,7 +515,14 @@ PYBIND11_NOINLINE std::string error_string() {
errorString += " " + handle(f_code->co_filename).cast<std::string>() + "("
+ std::to_string(lineno)
+ "): " + handle(f_code->co_name).cast<std::string>() + "\n";
frame = frame->f_back;
# if PY_VERSION_HEX >= 0x030900B1
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit: Maybe we should add a backport section details/common.h . I just wasn't sure if the recommend static inline stuff would cause any nasty ODR / LTO issues so I left it as is.

auto *b_frame = PyFrame_GetBack(frame);
# else
auto *b_frame = frame->f_back;
Py_XINCREF(b_frame);
henryiii marked this conversation as resolved.
Show resolved Hide resolved
# endif
Py_DECREF(frame);
frame = b_frame;
Py_DECREF(f_code);
}
}
Expand Down
11 changes: 5 additions & 6 deletions include/pybind11/pybind11.h
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2636,19 +2636,18 @@ get_type_override(const void *this_ptr, const type_info *this_type, const char *

/* Don't call dispatch code if invoked from overridden function.
Unfortunately this doesn't work on PyPy. */
#if !defined(PYPY_VERSION) && PY_VERSION_HEX < 0x030B0000
// TODO: Remove PyPy workaround for Python 3.11.
// Current API fails on 3.11 since co_varnames can be null.
#if !defined(PYPY_VERSION)
# if PY_VERSION_HEX >= 0x03090000
PyFrameObject *frame = PyThreadState_GetFrame(PyThreadState_Get());
if (frame != nullptr) {
PyCodeObject *f_code = PyFrame_GetCode(frame);
// f_code is guaranteed to not be NULL
if ((std::string) str(f_code->co_name) == name && f_code->co_argcount > 0) {
PyObject *locals = PyEval_GetLocals();
if (locals != nullptr && f_code->co_varnames != nullptr) {
PyObject *self_caller
= dict_getitem(locals, PyTuple_GET_ITEM(f_code->co_varnames, 0));
if (locals != nullptr) {
PyObject *self_arg = PyTuple_GET_ITEM(
PyObject_GetAttrString((PyObject *) f_code, "co_varnames"), 0);
PyObject *self_caller = dict_getitem(locals, self_arg);
henryiii marked this conversation as resolved.
Show resolved Hide resolved
if (self_caller == self.ptr()) {
Py_DECREF(f_code);
Py_DECREF(frame);
Expand Down