Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

services/horizon: Sort trustlines by asset code and issuer #2516

Merged
merged 1 commit into from
Apr 27, 2020

Conversation

2opremio
Copy link
Contributor

PR Checklist

PR Structure

  • This PR has reasonably narrow scope (if not, break it down into smaller PRs).
  • This PR avoids mixing refactoring changes with feature changes (split into two PRs
    otherwise).
  • This PR's title starts with name of package that is most changed in the PR, ex.
    services/friendbot, or all or doc if the changes are broad or impact many
    packages.

Thoroughness

  • This PR adds tests for the most critical parts of the new functionality or fixes.
  • I've updated any docs (developer docs, .md
    files, etc... affected by this change). Take a look in the docs folder for a given service,
    like this one.

Release planning

  • I've updated the relevant CHANGELOG (here for Horizon) if
    needed with deprecations, added features, breaking changes, and DB schema changes.
  • I've decided if this PR requires a new major/minor version according to
    semver, or if it's mainly a patch change. The PR is targeted at the next
    release branch if it's not a patch change.

What

When obtaining trustlines from the DB, for rendering into the GET /accounts endpoint, order them by asset code (and issuer) so that the output is stable (postgres doesn't guarantee a consistent ordering).

Why

horizon-cmp outputs a large amount of false positives because of this, plus it's always a good idea to generate a stable output, independent of the Horizon server used.

Known limitations

The DB query becomes slower. I pondered ordering it on the Horizon-side, but I figured a DB engine would be more efficient at this.

@2opremio 2opremio requested review from abuiles, bartekn and tamirms April 27, 2020 17:28
@cla-bot cla-bot bot added the cla: yes label Apr 27, 2020
@2opremio 2opremio merged commit 698593a into master Apr 27, 2020
@bartekn
Copy link
Contributor

bartekn commented Apr 28, 2020

The DB query becomes slower. I pondered ordering it on the Horizon-side, but I figured a DB engine would be more efficient at this.

I wonder how slower it would be (we should test it in staging). trust_line table doesn't contain an index that could be directly used in this query. After filtering by account_id the result set should be small enough for most of the accounts to not affect performance but I've seen Postgres not use indices it could many times.

@tamirms
Copy link
Contributor

tamirms commented Apr 28, 2020

but I've seen Postgres not use indices it could many times.

that's a really good point. we can run an explain query on the staging pubnet db and see what it produces

@2opremio 2opremio deleted the 2447-sort-trustlines branch April 28, 2020 20:48
@2opremio
Copy link
Contributor Author

This fixed #2447

I will check the query in the staging db and report back

@2opremio
Copy link
Contributor Author

I wonder how slower it would be (we should test it in staging). trust_line table doesn't contain an index that could be directly used in this query.

Since it doesn't contain an index, I doubt it will make things considerably worse (the table needs to be scanned anyways).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants