Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace tag indexer with event streaming API #3888

Closed
kostko opened this issue Apr 27, 2021 · 1 comment
Closed

Replace tag indexer with event streaming API #3888

kostko opened this issue Apr 27, 2021 · 1 comment
Labels
c:runtime/indexer Category: runtime block and/or tag indexer s:needs adr Needs a design document, discussion and decision (ADR)

Comments

@kostko
Copy link
Member

kostko commented Apr 27, 2021

The Bleve-based runtime tag indexer should be removed and replaced with an event streaming API that covers both the consensus layer and runtime events. The event sink implementations can then use something like PostgreSQL to index events.

The streaming API should support the following:

  • Streaming consensus and runtime events to be indexed (separate between block and transaction events). Error handling so events can be reindexed in case of indexing errors.
  • Querying for events using a general enough query abstraction.

Related issues that may be obsolete/subsumed by this are #3388 and #1674.

@kostko kostko added s:needs adr Needs a design document, discussion and decision (ADR) c:runtime/indexer Category: runtime block and/or tag indexer labels Apr 27, 2021
@kostko
Copy link
Member Author

kostko commented Dec 8, 2021

Actually this probably doesn't need any support from an Oasis Node as long as all the relevant information for a specific consensus/runtime height/round can be queried from it. What should probably be done instead is to define a standardized gRPC API and build an external indexer that supports "advanced" queries based on the index.

@kostko kostko closed this as completed Dec 8, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
c:runtime/indexer Category: runtime block and/or tag indexer s:needs adr Needs a design document, discussion and decision (ADR)
Projects
None yet
Development

No branches or pull requests

1 participant