Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

wait/pagination support for listsendpays, listforwards #6753

Merged
merged 18 commits into from
Oct 28, 2023

Conversation

rustyrussell
Copy link
Contributor

This expands wait (and pagination) to listsendpays and listforwards.

It does not cover listpays (yet, sorry), so the caller needs to collate the multiple parts (by payment_hash and groupid) to get presentable payment information (which is what the pay plugin does to create listpays.

Closes: #6740

@rustyrussell
Copy link
Contributor Author

Trivial rebase on #6802 for flake fixes.

@cdecker
Copy link
Member

cdecker commented Oct 24, 2023

Rebased on top of master due to conflicts in the generated files.

@rustyrussell
Copy link
Contributor Author

Rebased, and wrote tests and documentation (which caused more minor fixes).

Adding an index means:

1. Add the new subsystem, and new updated_index field to the db, and
   create xxx_index_deleted/created/updated APIs.
2. Hook up these functions to the points they need to be called.
3. Add index, start and limit fields to the list command.
4. Add created_index and updated_index into the list command.

This does #1.

Signed-off-by: Rusty Russell <[email protected]>
We generalize the invoice routine, though it's (known) buggy, so we have
to copy it.  We rename the invoice routine to a more specific name though.

Signed-off-by: Rusty Russell <[email protected]>
@rustyrussell
Copy link
Contributor Author

Rebase and PostgresSQL fix.

Signed-off-by: Rusty Russell <[email protected]>
Changelog-Added: JSON-RPC: `wait` now works for `sendpays` infrastructure.
We didn't write to db immediately, but waited until it the actual HTLC got
added (or failed).  That way we didn't have a separate transaction to
write the payment into the db, but the complexity is not worth it: it
makes the next refactors harder, since we can't use the normal
iterator patterns like we do with the rest of the db (as we have to add
the unstored ones).

We might as well also make sendpay return immediately: we used to return
once the HTLC had been confirmed sent, since we entered it in the db
at that point, but we can keep it simple now.

Signed-off-by: Rusty Russell <[email protected]>
Have it construct and return.  No need to expose details about dbid...

Signed-off-by: Rusty Russell <[email protected]>
It used to be used for both `sendpay` and `waitsendpay` but now it's
only for the latter, so the name is confusing.

Signed-off-by: Rusty Russell <[email protected]>
We used to have "unsaved" payments: now we don't we can use
our normal "iterator" pattern rather than returning arrays.

Signed-off-by: Rusty Russell <[email protected]>
Looking through logs I was surprise to see:

```
lightningd-1 2023-10-26T03:42:36.824Z INFO    lightningd: Sending 200000000msat over 1 hops to deliver 200000000msat
```

On a re-payment where we simply returned from sendpay immediately!  Move that log to later.
Signed-off-by: Rusty Russell <[email protected]>
Changelog-Added: JSON-RPC: `sendpay`, `listsendpays`, `delpay` new fields `created_index` (old: `id`) and `updated_index`.
Changelog-Added: JSON-RPC: `listsendpays` new parameters `index`, `start` and `limit`.
peer_htlcs has become a bit of a dumping ground: move listforwards
etc to its own file.

Also move `struct channel_info` from peer_htlcs.h to channel.h where
it more logically belongs.

Signed-off-by: Rusty Russell <[email protected]>
This table doesn't have `id`, except as the implicit one in Sqlite3,
so we need to add it for postgres.

Signed-off-by: Rusty Russell <[email protected]>
Signed-off-by: Rusty Russell <[email protected]>
Changelog-Added: JSON-RPC: `wait` now works for `forwards` infrastructure.
Signed-off-by: Rusty Russell <[email protected]>
Changelog-Added: JSON-RPC: `listforwards` fields `created_index` (old: `id`) and `updated_index`.
Changelog-Added: JSON-RPC: `listforwards` new parameters `index`, `start` and `limit`.
Without this, we have no unique identifier for which forward happened.

Signed-off-by: Rusty Russell <[email protected]>
@rustyrussell rustyrussell merged commit 62ddf84 into ElementsProject:master Oct 28, 2023
38 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Pagination for v23.11
2 participants