Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Deal Making Tests for M1 (MRA + DAGStore integration) #6789

Closed
12 of 13 tasks
aarshkshah1992 opened this issue Jul 19, 2021 · 2 comments
Closed
12 of 13 tasks

Deal Making Tests for M1 (MRA + DAGStore integration) #6789

aarshkshah1992 opened this issue Jul 19, 2021 · 2 comments
Labels
team/ignite Issues and PRs being tracked by Team Ignite at Protocol Labs

Comments

@aarshkshah1992
Copy link
Contributor

aarshkshah1992 commented Jul 19, 2021 •
edited by raulk
Loading

Testground tests

No longer necessary.

  • Upgraded client -> upgraded miner (Online storage deal and retrieval).
  • Upgraded client-> old miner (Online storage deal and retrieval).
  • Old client -> upgraded miner (Online storage deal and retrieval).
  • Old client makes an online storage deal with an old miner -> client upgrades and does a retrieval.
  • Old client makes an online storage deal with an old miner -> miner upgrades and then the old client does a retrieval.
  • Old client makes an online storage deal with an old miner -> both upgrade and then we do a retrieval.

Manual testing on Sofia Miner

  • Assume Sofia Miner is running a separate Markets process (Take help from @nonsense for this).
  • The client we run has data-cap. Please make verified storage deals.
  • Turn on the "offer free retrieval for verified deals" flag in the config so we exercise the Bedrock flow.
  • We can do a smoke test for the partial payments flow in the end.

End-End testing

  • Upgraded Client <-> Upgraded Miner (Online storage deal & retrieval).
  • Upgraded Client <-> Upgraded Miner (Offline storage deal & retrieval).

Backward compatibility testing

  • Upgraded client-> Old Miner (Online storage deal & retrieval).

    Miner
$ lotus version 
Daemon:  1.11.0-rc2+mainnet+git.0519cd371+api1.3.0
Local: lotus version 1.11.0-rc2+mainnet+git.0519cd371

Client

    $ lotus version
    Daemon: 1.11.1-dev+mainnet+git.d7827da5b+api1.3.0
    Local: lotus version 1.11.1-dev+mainnet+git.d7827da5b

    • data-cid: bafykbzacedsope4lbmvqaxrz2m2yz5wmfs5av6klmavbeygxrlechkhqhqwka
    • proposal-cid: bafyreieln6cn73c4cpnk5ol5e2s6wjoxplrjyjuybxggayojhocowpy5ha
    > Recv: 584.6 MiB, Paid 0 FIL, ClientEventBlockstoreFinalized (DealStatusCompleted)
   Success
   $ lotus client retrieve --miner f0127896 
   bafykbzacedsope4lbmvqaxrz2m2yz5wmfs5av6klmavbeygxrlechkhqhqwka /dev/null

  • Upgraded client-> Old Miner (Offline storage deal & retrieval).

     Miner 
 root at sofiaminer in ~/lotus-miner-path 
 $ lotus version
 Daemon:  1.11.0-rc2+mainnet+git.0519cd371+api1.3.0
 Local: lotus version 1.11.0-rc2+mainnet+git.0519cd371
 
 Client
  $ lotus version
  Daemon:  1.11.1-dev+mainnet+git.d7827da5b+api1.3.0
  Local: lotus version 1.11.1-dev+mainnet+git.d7827da5b
    • data-cid: bafykbzacebhevf4dq5llibfn3ncy2flx4jyohqrbgbwbptuymprk7oh3er2xg
    $ lotus client commP /tmp/613-mb-car
CID:  baga6ea4seaqc4tsfuwipw3k6nd42lvdpgcnbmfe4i3phekuv6zqqoo2hozohqiy
Piece size:  1016 MiB
    • proposal-cid: bafyreicir32axzmexcl7yc4fluxeqpwc63xgaztmmnkd32gtefild5npnu
    > Recv: 584.6 MiB, Paid 0 FIL, ClientEventBlockstoreFinalized (DealStatusCompleted)
Success
$ lotus client retrieve --miner f0127896 
 bafykbzacebhevf4dq5llibfn3ncy2flx4jyohqrbgbwbptuymprk7oh3er2xg /dev/null

  • Old client-> Upgraded Miner (Online storage deal & retrieval).

  • Old client-> Upgraded Miner (Offline storage deal & retrieval).

Shard Migration testing

  • Old client makes an online storage deal with an old miner -> client upgrades and does a retrieval.

    **Miner**
root at sofiaminer in ~/lotus-miner-path 
$ lotus version
Daemon:  1.11.0-rc2+mainnet+git.0519cd371+api1.3.0
Local: lotus version 1.11.0-rc2+mainnet+git.0519cd371

**Client**
$ lotus version
Daemon:  1.11.0-rc2+mainnet+git.0519cd371+api1.3.0
Local: lotus version 1.11.0-rc2+mainnet+git.0519cd371

    - data-cid: bafykbzaced4drsd2st6dr64oilsumvfq4s7d55jflln4whqd6pebgc5o66q6i

    - proposal-cid: bafyreihtnpqlxj633td5vpv72rg472g7znplp5hk53hmd2eaepi4o5clle

    Upgraded Client  
$ lotus version
Daemon:  1.11.1-dev+mainnet+git.d7827da5b+api1.3.0
Local: lotus version 1.11.1-dev+mainnet+git.d7827da5b
 
Miner
root at sofiaminer in ~/lotus-miner-path 
$ lotus version
Daemon:  1.11.0-rc2+mainnet+git.0519cd371+api1.3.0
Local: lotus version 1.11.0-rc2+mainnet+git.0519cd371

    > Recv: 584.6 MiB, Paid 0 FIL, ClientEventBlockstoreFinalized (DealStatusCompleted)
Success
$ lotus client retrieve --miner f0127896 
bafykbzaced4drsd2st6dr64oilsumvfq4s7d55jflln4whqd6pebgc5o66q6i /dev/null

  • Old client makes an online storage deal with an old miner -> miner upgrades and then the old client does a retrieval.

    lotus version
Daemon:  1.11.0-rc2+mainnet+git.0519cd371+api1.3.0
Local: lotus version 1.11.0-rc2+mainnet+git.0519cd371

root at sofiaminer in ~/lotus (feat/replace-multistore-carv2) 
$ lotus version
Daemon:  1.11.0-rc2+mainnet+git.0519cd371+api1.3.0 
Local: lotus version 1.11.0-rc2+mainnet+git.0519cd371

    lotus client import /tmp/613-mb-file
Import 6, Root bafykbzacebi4uhadzfdrxo3w6qzebznw74l7w2muvez4hxdtc2ongxco4ygpy
[ec2-user@ip-172-31-20-161 lotus]$ 
Proposal (f0127896) CID: bafyreiahmcdp6nc5mifkxzvxoer2pc3yarxnjer4pvorpzcpv3fl2s7l2i 

    Upgraded Miner
$ lotus version
Daemon:  1.11.1-dev+mainnet+git.62044c34b+api1.3.0
Local: lotus version 1.11.1-dev+mainnet+git.62044c34b

    > Recv: 584.6 MiB, Paid 0 FIL, ClientEventAllBlocksReceived (DealStatusCompleted)
Success
[ec2-user@ip-172-31-20-161 lotus]$ lotus client retrieve --miner f0127896 
bafykbzacebi4uhadzfdrxo3w6qzebznw74l7w2muvez4hxdtc2ongxco4ygpy /dev/null

  • Old client makes an online storage deal with an old miner -> both upgrade and then we do a retrieval.

    Miner
$ lotus version
Daemon:  1.11.1-dev+mainnet+git.62044c34b+api1.3.0
Local: lotus version 1.11.1-dev+mainnet+git.62044c34b

Client
lotus]$ lotus version
Daemon:  1.11.1-dev+mainnet+git.62044c34b+api1.3.0
Local: lotus version 1.11.1-dev+mainnet+git.62044c34b

    > Recv: 584.6 MiB, Paid 0 FIL, ClientEventBlockstoreFinalized (DealStatusCompleted)
Success
[ec2-user@ip-172-31-20-161 lotus]$ lotus client retrieve --miner f0127896  
bafykbzacebi4uhadzfdrxo3w6qzebznw74l7w2muvez4hxdtc2ongxco4ygpy /dev/null

  • Old client does an offline storage deal with an old miner -> miner upgrades and then we do a retrieval.

    ```
Miner
$ lotus version                                                                 
Daemon:  1.11.0-rc2+mainnet+git.0519cd371+api1.3.0                              
Local: lotus version 1.11.0-rc2+mainnet+git.0519cd371 

Client
$ lotus version
Daemon:  1.11.0-rc2+mainnet+git.0519cd371+api1.3.0
Local: lotus version 1.11.0-rc2+mainnet+git.0519cd371
```
       
 ```
$ lotus client commP /tmp/613-mb-car
CID:  baga6ea4seaqmycidoxg7ht3qhjjfhkgj7nkol5wysznsdrqcwvol3dbmrseaejy
Piece size:  1016 MiB
 ```

- **data-cid**=bafykbzacec5i2qdzl6initctpqpgsexvlmute7kscabhpguyfhitywlsdztzs
 
- **proposal-cid**=bafyreicqnldytirq6xxaa2aazwcrzhqltrjb5zutwdp4x3fr6rkkzlh4du

```
> Recv: 584.6 MiB, Paid 0 FIL, ClientEventAllBlocksReceived (DealStatusCompleted)

    [ec2-user@ip-172-31-20-161 lotus]$ lotus client retrieve --miner f0127896
    bafykbzacec5i2qdzl6initctpqpgsexvlmute7kscabhpguyfhitywlsdztzs /dev/null
    ```

  • Old client does an offline storage deal with an old miner -> client upgrades and then we do a retrieval.

    > Recv: 584.6 MiB, Paid 0 FIL, ClientEventBlockstoreFinalized (DealStatusCompleted)
Success
 $ lotus client retrieve --miner f0127896 
 bafykbzacec5i2qdzl6initctpqpgsexvlmute7kscabhpguyfhitywlsdztzs /dev/null

Additional non-blocking tests to run

  • Client does storage deal with upgrader Miner -> Miner downgrades. We do a retrieval.

    > Recv: 584.6 MiB, Paid 0 FIL, ClientEventBlockstoreFinalized (DealStatusCompleted)
Success
[ec2-user@ip-172-31-20-161 filc]$ lotus client retrieve --miner f0127896 
bafykbzacebwuo3xhd2yhwmphg35npcxfrfzigg4qd2dytcxuyuhbp5eo4scbw /dev/null

  • Client does a storage deal with an upgraded Miner -> Miner downgrades and removes the dagstore repo. Miner upgrades again and we do a retrieval.
@aarshkshah1992
Copy link
Contributor Author

cc @jacobheun @raulk @dirkmc @nonsense .

@aarshkshah1992 aarshkshah1992 added team/ignite Issues and PRs being tracked by Team Ignite at Protocol Labs and removed hint/needs-triaging labels Jul 19, 2021
@aarshkshah1992 aarshkshah1992 changed the title Deal Making Testing for M1 (MRA + DAGStore integration) Deal Making Tests for M1 (MRA + DAGStore integration) Jul 19, 2021
@raulk
Copy link
Member

raulk commented Aug 17, 2021

Merged in #6671.

@raulk raulk closed this as completed Aug 17, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
team/ignite Issues and PRs being tracked by Team Ignite at Protocol Labs
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@jacobheun @raulk @aarshkshah1992