Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Async IPC #307

Merged
merged 13 commits into from
May 12, 2024
Merged

Async IPC #307

merged 13 commits into from
May 12, 2024

Conversation

gatesn
Copy link
Contributor

@gatesn gatesn commented May 10, 2024

Implemented for both pure futures (e.g. Tokio) as well as MonoIO for IO-uring support.

@gatesn gatesn marked this pull request as draft May 10, 2024 16:10

let inner = futures_util::stream::unfold(self, move |mut reader| async move {
match reader.next().await {
Ok(Some(array)) => Some((Ok(array.to_static()), reader)),
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This to_static call is what allows us to use a regular futures::Stream instead of a LendingStream.

Honestly, I think I'd rather figure out buffer re-use and refactor ArrayView to not have borrowed values instead of switching over to LendingStream and losing out on the entire ecosystem e.g. StreamExt.

vortex-ipc/src/codecs/message_reader/monoio.rs Outdated Show resolved Hide resolved
vortex-ipc/src/codecs/message_reader/monoio.rs Outdated Show resolved Hide resolved
vortex-ipc/src/lib.rs Outdated Show resolved Hide resolved
@gatesn gatesn marked this pull request as ready for review May 12, 2024 11:09
@gatesn gatesn merged commit 57b8581 into develop May 12, 2024
1 check passed
@gatesn gatesn deleted the ngates/async branch May 12, 2024 11:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants