Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate to pygls v2.0a2 #928

Merged
merged 10 commits into from
Dec 1, 2024
Merged

Migrate to pygls v2.0a2 #928

merged 10 commits into from
Dec 1, 2024

Conversation

alcarney
Copy link
Member

No description provided.

pygls in `v2.0a2` switched from using the low-level asyncio APIs to
using the high-level one and surprisingly, this broke `esbonio`.

The server would start ok, but wouldn't launch Sphinx processes, the
preview command did nothing, it wouldn't even produce any log
messages! That is, until the user changed a configuration setting.

After changing a setting - any setting, the server suddenly springs
into life, logs, previews, sphinx processes all of them would start
working as if nothing was wrong.

I eventually managed to figure out that the callbacks registered by
the configuration system on the server's `ready` future were never
being called.

```
self.server.ready.add_done_callback(self._notify_subscriptions)
```

By why would changing the asyncio API in use break these callbacks?!
After spending some time with the debugger I eventually spotted the culprit

```
>>> asyncio.get_running_loop()
<_UnixSelectorEventLoop running=True closed=False debug=False>

>>> self.server.ready._loop
<_UnixSelectorEventLoop running=False closed=False debug=False>
```

The server's `ready` future was using a different event loop and
because the event loop is not running, when the future is resolved,
the callbacks were never scheduled!

While I cannot explain why this was not an issue before, I can explain
why it is an issue now.

The `ready` future is created in the constructor of the
`EsbonioLanguageServer` class - before any event loop has been created
and so it uses a new one based on the current event loop policy[1][2].

Unfortunately, when pygls later starts its main loop by calling
`asyncio.run()` it creates a new event loop, orphaning the `ready`
future in its unused event loop[3]

Since we don't need to use the `ready` future asynchronously, the
simplest fix is to convert it to future from the `concurrent.futures`
module, removing the need for an event loop completely.

[1]: https://github.com/python/cpython/blob/307c63358681d669ae39e5ecd814bded4a93443a/Lib/asyncio/futures.py#L79
[2]: https://github.com/python/cpython/blob/307c63358681d669ae39e5ecd814bded4a93443a/Lib/asyncio/events.py#L791
[3]: https://github.com/python/cpython/blob/307c63358681d669ae39e5ecd814bded4a93443a/Lib/asyncio/runners.py#L146
- Use new `pygls.io_` infrastructure
- Use new `websockets.asyncio` API
@alcarney alcarney marked this pull request as ready for review December 1, 2024 17:29
@alcarney alcarney merged commit 39123f8 into swyddfa:develop Dec 1, 2024
13 of 14 checks passed
@alcarney alcarney deleted the pygls-v2a2 branch December 1, 2024 17:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant