Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Resume Storage Market Data Transfer #430

Merged
merged 8 commits into from
Oct 13, 2020
Merged
Show file tree
Hide file tree
Changes from 5 commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
42 changes: 25 additions & 17 deletions docs/storageclient.mmd
Original file line number Diff line number Diff line change
Expand Up @@ -10,63 +10,71 @@ stateDiagram-v2
state "StorageDealCheckForAcceptance" as 13
state "StorageDealStartDataTransfer" as 16
state "StorageDealTransferring" as 17
state "StorageDealEnsureClientFunds" as 21
state "StorageDealClientFunding" as 23
state "StorageDealError" as 26
state "StorageDealClientTransferRestart" as 19
state "StorageDealEnsureClientFunds" as 23
state "StorageDealClientFunding" as 25
state "StorageDealError" as 28
3 : On entry runs ValidateDealPublished
5 : On entry runs VerifyDealActivated
7 : On entry runs WaitForDealCompletion
11 : On entry runs FailDeal
12 : On entry runs ProposeDeal
13 : On entry runs CheckForDealAcceptance
16 : On entry runs InitiateDataTransfer
21 : On entry runs EnsureClientFunds
23 : On entry runs WaitForFunding
19 : On entry runs RestartDataTransfer
23 : On entry runs EnsureClientFunds
25 : On entry runs WaitForFunding
[*] --> 0
note right of 0
The following events are not shown cause they can trigger from any state.

ClientEventStreamCloseError - transitions state to StorageDealError
ClientEventRestart - does not transition state
end note
0 --> 21 : ClientEventOpen
21 --> 23 : ClientEventFundingInitiated
21 --> 11 : ClientEventEnsureFundsFailed
0 --> 23 : ClientEventOpen
23 --> 25 : ClientEventFundingInitiated
23 --> 11 : ClientEventEnsureFundsFailed
21 --> 12 : ClientEventFundsEnsured
25 --> 11 : ClientEventEnsureFundsFailed
23 --> 12 : ClientEventFundsEnsured
12 --> 26 : ClientEventWriteProposalFailed
25 --> 12 : ClientEventFundsEnsured
12 --> 28 : ClientEventWriteProposalFailed
12 --> 11 : ClientEventReadResponseFailed
12 --> 11 : ClientEventResponseVerificationFailed
12 --> 16 : ClientEventInitiateDataTransfer
12 --> 11 : ClientEventUnexpectedDealState
16 --> 11 : ClientEventDataTransferFailed
17 --> 11 : ClientEventDataTransferFailed
19 --> 11 : ClientEventDataTransferRestartFailed
16 --> 17 : ClientEventDataTransferInitiated
16 --> 17 : ClientEventDataTransferRestarted
19 --> 17 : ClientEventDataTransferRestarted
16 --> 13 : ClientEventDataTransferComplete
17 --> 13 : ClientEventDataTransferComplete
13 --> 13 : ClientEventWaitForDealState
13 --> 11 : ClientEventResponseDealDidNotMatch
13 --> 11 : ClientEventDealRejected
13 --> 3 : ClientEventDealAccepted
3 --> 26 : ClientEventDealPublishFailed
3 --> 28 : ClientEventDealPublishFailed
3 --> 5 : ClientEventDealPublished
5 --> 26 : ClientEventDealActivationFailed
5 --> 28 : ClientEventDealActivationFailed
5 --> 7 : ClientEventDealActivated
7 --> 9 : ClientEventDealSlashed
7 --> 8 : ClientEventDealExpired
7 --> 26 : ClientEventDealCompletionFailed
11 --> 26 : ClientEventFailed
17 --> 16 : ClientEventRestart
7 --> 28 : ClientEventDealCompletionFailed
11 --> 28 : ClientEventFailed
17 --> 19 : ClientEventRestart

note left of 3 : The following events only record in this state.<br><br>ClientEventFundsReleased


note left of 11 : The following events only record in this state.<br><br>ClientEventFundsReleased


note left of 21 : The following events only record in this state.<br><br>ClientEventFundsReserved
note left of 17 : The following events only record in this state.<br><br>ClientEventDataTransferRestarted


note left of 23 : The following events only record in this state.<br><br>ClientEventFundsReserved

9 --> [*]
8 --> [*]
26 --> [*]
28 --> [*]
Binary file modified docs/storageclient.mmd.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
6 changes: 3 additions & 3 deletions docs/storageclient.mmd.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
77 changes: 43 additions & 34 deletions docs/storageprovider.mmd
Original file line number Diff line number Diff line change
Expand Up @@ -11,13 +11,14 @@ stateDiagram-v2
state "StorageDealValidating" as 14
state "StorageDealAcceptWait" as 15
state "StorageDealTransferring" as 17
state "StorageDealWaitingForData" as 18
state "StorageDealVerifyData" as 19
state "StorageDealEnsureProviderFunds" as 20
state "StorageDealProviderFunding" as 22
state "StorageDealPublish" as 24
state "StorageDealPublishing" as 25
state "StorageDealError" as 26
state "StorageDealProviderTransferRestart" as 18
state "StorageDealWaitingForData" as 20
state "StorageDealVerifyData" as 21
state "StorageDealEnsureProviderFunds" as 22
state "StorageDealProviderFunding" as 24
state "StorageDealPublish" as 26
state "StorageDealPublishing" as 27
state "StorageDealError" as 28
4 : On entry runs HandoffDeal
5 : On entry runs VerifyDealActivated
6 : On entry runs CleanupDeal
Expand All @@ -26,11 +27,12 @@ stateDiagram-v2
11 : On entry runs FailDeal
14 : On entry runs ValidateDealProposal
15 : On entry runs DecideOnProposal
19 : On entry runs VerifyData
20 : On entry runs EnsureProviderFunds
22 : On entry runs WaitForFunding
24 : On entry runs PublishDeal
25 : On entry runs WaitForPublish
18 : On entry runs RestartDataTransfer
21 : On entry runs VerifyData
22 : On entry runs EnsureProviderFunds
24 : On entry runs WaitForFunding
26 : On entry runs PublishDeal
27 : On entry runs WaitForPublish
[*] --> 0
note right of 0
The following events are not shown cause they can trigger from any state.
Expand All @@ -41,24 +43,27 @@ stateDiagram-v2
0 --> 14 : ProviderEventOpen
14 --> 10 : ProviderEventDealRejected
15 --> 10 : ProviderEventDealRejected
19 --> 10 : ProviderEventDealRejected
21 --> 10 : ProviderEventDealRejected
10 --> 11 : ProviderEventRejectionSent
14 --> 15 : ProviderEventDealDeciding
15 --> 18 : ProviderEventDataRequested
15 --> 20 : ProviderEventDataRequested
17 --> 11 : ProviderEventDataTransferFailed
18 --> 17 : ProviderEventDataTransferInitiated
17 --> 19 : ProviderEventDataTransferCompleted
19 --> 11 : ProviderEventDataVerificationFailed
18 --> 20 : ProviderEventVerifiedData
19 --> 20 : ProviderEventVerifiedData
20 --> 22 : ProviderEventFundingInitiated
20 --> 24 : ProviderEventFunded
22 --> 24 : ProviderEventFunded
24 --> 25 : ProviderEventDealPublishInitiated
25 --> 11 : ProviderEventDealPublishError
20 --> 17 : ProviderEventDataTransferInitiated
18 --> 11 : ProviderEventDataTransferRestartFailed
18 --> 17 : ProviderEventDataTransferRestarted
20 --> 17 : ProviderEventDataTransferRestarted
17 --> 21 : ProviderEventDataTransferCompleted
21 --> 11 : ProviderEventDataVerificationFailed
20 --> 22 : ProviderEventVerifiedData
21 --> 22 : ProviderEventVerifiedData
22 --> 24 : ProviderEventFundingInitiated
22 --> 26 : ProviderEventFunded
24 --> 26 : ProviderEventFunded
26 --> 27 : ProviderEventDealPublishInitiated
27 --> 11 : ProviderEventDealPublishError
10 --> 11 : ProviderEventSendResponseFailed
15 --> 11 : ProviderEventSendResponseFailed
25 --> 4 : ProviderEventDealPublished
27 --> 4 : ProviderEventDealPublished
4 --> 11 : ProviderEventFileStoreErrored
5 --> 11 : ProviderEventFileStoreErrored
7 --> 11 : ProviderEventFileStoreErrored
Expand All @@ -70,24 +75,28 @@ stateDiagram-v2
6 --> 7 : ProviderEventCleanupFinished
7 --> 9 : ProviderEventDealSlashed
7 --> 8 : ProviderEventDealExpired
7 --> 26 : ProviderEventDealCompletionFailed
11 --> 26 : ProviderEventFailed
10 --> 26 : ProviderEventRestart
14 --> 26 : ProviderEventRestart
15 --> 26 : ProviderEventRestart
20 --> 11 : ProviderEventTrackFundsFailed
7 --> 28 : ProviderEventDealCompletionFailed
11 --> 28 : ProviderEventFailed
10 --> 28 : ProviderEventRestart
14 --> 28 : ProviderEventRestart
15 --> 28 : ProviderEventRestart
17 --> 18 : ProviderEventRestart
22 --> 11 : ProviderEventTrackFundsFailed

note left of 4 : The following events only record in this state.<br><br>ProviderEventPieceStoreErrored


note left of 11 : The following events only record in this state.<br><br>ProviderEventFundsReleased


note left of 20 : The following events only record in this state.<br><br>ProviderEventFundsReserved
note left of 17 : The following events only record in this state.<br><br>ProviderEventDataTransferRestarted


note left of 25 : The following events only record in this state.<br><br>ProviderEventFundsReleased
note left of 22 : The following events only record in this state.<br><br>ProviderEventFundsReserved

26 --> [*]

note left of 27 : The following events only record in this state.<br><br>ProviderEventFundsReleased

28 --> [*]
9 --> [*]
8 --> [*]
Binary file modified docs/storageprovider.mmd.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
6 changes: 3 additions & 3 deletions docs/storageprovider.mmd.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
6 changes: 3 additions & 3 deletions go.mod
Original file line number Diff line number Diff line change
Expand Up @@ -8,11 +8,11 @@ require (
github.com/filecoin-project/filecoin-ffi v0.30.4-0.20200716204036-cddc56607e1d
github.com/filecoin-project/go-address v0.0.3
github.com/filecoin-project/go-cbor-util v0.0.0-20191219014500-08c40a1e63a2
github.com/filecoin-project/go-data-transfer v0.6.7
github.com/filecoin-project/go-data-transfer v0.6.8-0.20201012061237-d181ba9cacad
github.com/filecoin-project/go-ds-versioning v0.1.0
github.com/filecoin-project/go-multistore v0.0.3
github.com/filecoin-project/go-padreader v0.0.0-20200903213702-ed5fae088b20
github.com/filecoin-project/go-state-types v0.0.0-20200905071437-95828685f9df
github.com/filecoin-project/go-state-types v0.0.0-20200911004822-964d6c679cfc
github.com/filecoin-project/go-statemachine v0.0.0-20200925024713-05bd7c71fbfe
github.com/filecoin-project/go-statestore v0.1.0
github.com/filecoin-project/go-storedcounter v0.0.0-20200421200003-1c99c62e8a5b
Expand All @@ -35,7 +35,7 @@ require (
github.com/ipfs/go-log/v2 v2.0.5
github.com/ipfs/go-merkledag v0.3.2
github.com/ipfs/go-unixfs v0.2.4
github.com/ipld/go-car v0.1.1-0.20200923150018-8cdef32e2da4
github.com/ipld/go-car v0.1.1-0.20200923145034-fcc7bb8f1440
github.com/ipld/go-ipld-prime v0.5.1-0.20200828233916-988837377a7f
github.com/jbenet/go-random v0.0.0-20190219211222-123a90aedc0c
github.com/jpillora/backoff v1.0.0
Expand Down
11 changes: 6 additions & 5 deletions go.sum
Original file line number Diff line number Diff line change
Expand Up @@ -104,8 +104,8 @@ github.com/filecoin-project/go-cbor-util v0.0.0-20191219014500-08c40a1e63a2 h1:a
github.com/filecoin-project/go-cbor-util v0.0.0-20191219014500-08c40a1e63a2/go.mod h1:pqTiPHobNkOVM5thSRsHYjyQfq7O5QSCMhvuu9JoDlg=
github.com/filecoin-project/go-crypto v0.0.0-20191218222705-effae4ea9f03 h1:2pMXdBnCiXjfCYx/hLqFxccPoqsSveQFxVLvNxy9bus=
github.com/filecoin-project/go-crypto v0.0.0-20191218222705-effae4ea9f03/go.mod h1:+viYnvGtUTgJRdy6oaeF4MTFKAfatX071MPDPBL11EQ=
github.com/filecoin-project/go-data-transfer v0.6.7 h1:Kacr5qz2YWtd3sensU6aXFtES7joeapVDeXApeUD35I=
github.com/filecoin-project/go-data-transfer v0.6.7/go.mod h1:C++k1U6+jMQODOaen5OPDo9XQbth9Yq3ie94vNjBJbk=
github.com/filecoin-project/go-data-transfer v0.6.8-0.20201012061237-d181ba9cacad h1:yO7pQMXjM1i6IGkYOx4Q3v3hXCGc4Agn0bapsr/twcU=
github.com/filecoin-project/go-data-transfer v0.6.8-0.20201012061237-d181ba9cacad/go.mod h1:QvXh2HwVSuKAmIkqZGuqW7VBwO1Yj1F03WdrM76mJ/s=
github.com/filecoin-project/go-ds-versioning v0.1.0 h1:y/X6UksYTsK8TLCI7rttCKEvl8btmWxyFMEeeWGUxIQ=
github.com/filecoin-project/go-ds-versioning v0.1.0/go.mod h1:mp16rb4i2QPmxBnmanUx8i/XANp+PFCCJWiAb+VW4/s=
github.com/filecoin-project/go-fil-commcid v0.0.0-20200716160307-8f644712406f h1:GxJzR3oRIMTPtpZ0b7QF8FKPK6/iPAc7trhlL5k/g+s=
Expand All @@ -119,7 +119,8 @@ github.com/filecoin-project/go-state-types v0.0.0-20200904021452-1883f36ca2f4 h1
github.com/filecoin-project/go-state-types v0.0.0-20200904021452-1883f36ca2f4/go.mod h1:IQ0MBPnonv35CJHtWSN3YY1Hz2gkPru1Q9qoaYLxx9I=
github.com/filecoin-project/go-state-types v0.0.0-20200905071437-95828685f9df h1:m2esXSuGBkuXlRyCsl1a/7/FkFam63o1OzIgzaHtOfI=
github.com/filecoin-project/go-state-types v0.0.0-20200905071437-95828685f9df/go.mod h1:IQ0MBPnonv35CJHtWSN3YY1Hz2gkPru1Q9qoaYLxx9I=
github.com/filecoin-project/go-statemachine v0.0.0-20200714194326-a77c3ae20989/go.mod h1:FGwQgZAt2Gh5mjlwJUlVB62JeYdo+if0xWxSEfBD9ig=
github.com/filecoin-project/go-state-types v0.0.0-20200911004822-964d6c679cfc h1:1vr/LoqGq5m5g37Q3sNSAjfwF1uJY0zmiHcvnxY6hik=
github.com/filecoin-project/go-state-types v0.0.0-20200911004822-964d6c679cfc/go.mod h1:ezYnPf0bNkTsDibL/psSz5dy4B5awOJ/E7P2Saeep8g=
github.com/filecoin-project/go-statemachine v0.0.0-20200925024713-05bd7c71fbfe h1:dF8u+LEWeIcTcfUcCf3WFVlc81Fr2JKg8zPzIbBDKDw=
github.com/filecoin-project/go-statemachine v0.0.0-20200925024713-05bd7c71fbfe/go.mod h1:FGwQgZAt2Gh5mjlwJUlVB62JeYdo+if0xWxSEfBD9ig=
github.com/filecoin-project/go-statestore v0.1.0 h1:t56reH59843TwXHkMcwyuayStBIiWBRilQjQ+5IiwdQ=
Expand Down Expand Up @@ -349,8 +350,8 @@ github.com/ipfs/go-unixfs v0.2.4 h1:6NwppOXefWIyysZ4LR/qUBPvXd5//8J3jiMdvpbw6Lo=
github.com/ipfs/go-unixfs v0.2.4/go.mod h1:SUdisfUjNoSDzzhGVxvCL9QO/nKdwXdr+gbMUdqcbYw=
github.com/ipfs/go-verifcid v0.0.1 h1:m2HI7zIuR5TFyQ1b79Da5N9dnnCP1vcu2QqawmWlK2E=
github.com/ipfs/go-verifcid v0.0.1/go.mod h1:5Hrva5KBeIog4A+UpqlaIU+DEstipcJYQQZc0g37pY0=
github.com/ipld/go-car v0.1.1-0.20200923150018-8cdef32e2da4 h1:6phjU3kXvCEWOZpu+Ob0w6DzgPFZmDLgLPxJhD8RxEY=
github.com/ipld/go-car v0.1.1-0.20200923150018-8cdef32e2da4/go.mod h1:xrMEcuSq+D1vEwl+YAXsg/JfA98XGpXDwnkIL4Aimqw=
github.com/ipld/go-car v0.1.1-0.20200923145034-fcc7bb8f1440 h1:nlzFVymc5O7KAXH+YZQOjaZFg8L/FKbVyH+LiMqhoHo=
github.com/ipld/go-car v0.1.1-0.20200923145034-fcc7bb8f1440/go.mod h1:3MrpzmABZBRBfp5Lfr7h7vQXMg/L2QcvRQwV/EEX+rI=
github.com/ipld/go-ipld-prime v0.0.2-0.20200428162820-8b59dc292b8e h1:ZISbJlM0urTANR9KRfRaqlBmyOj5uUtxs2r4Up9IXsA=
github.com/ipld/go-ipld-prime v0.0.2-0.20200428162820-8b59dc292b8e/go.mod h1:uVIwe/u0H4VdKv3kaN1ck7uCb6yD9cFLS9/ELyXbsw8=
github.com/ipld/go-ipld-prime v0.5.1-0.20200828233916-988837377a7f h1:XpOuNQ5GbXxUcSukbQcW9jkE7REpaFGJU2/T00fo9kA=
Expand Down
2 changes: 1 addition & 1 deletion retrievalmarket/impl/dtutils/dtutils.go
Original file line number Diff line number Diff line change
Expand Up @@ -98,7 +98,7 @@ const noEvent = rm.ClientEvent(math.MaxUint64)

func clientEvent(event datatransfer.Event, channelState datatransfer.ChannelState) (rm.ClientEvent, []interface{}) {
switch event.Code {
case datatransfer.Progress:
case datatransfer.DataReceived:
return rm.ClientEventBlocksReceived, []interface{}{channelState.Received()}
case datatransfer.FinishTransfer:
return rm.ClientEventAllBlocksReceived, nil
Expand Down
6 changes: 4 additions & 2 deletions retrievalmarket/impl/dtutils/dtutils_test.go
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,7 @@ import (
"math/rand"
"testing"

"github.com/ipfs/go-cid"
"github.com/ipld/go-ipld-prime"
peer "github.com/libp2p/go-libp2p-core/peer"
"github.com/stretchr/testify/require"
Expand Down Expand Up @@ -147,7 +148,7 @@ func TestClientDataTransferSubscriber(t *testing.T) {
ignored: true,
},
"progress": {
code: datatransfer.Progress,
code: datatransfer.DataReceived,
state: shared_testutil.TestChannelParams{
Vouchers: []datatransfer.Voucher{&dealProposal},
Status: datatransfer.Ongoing,
Expand Down Expand Up @@ -433,7 +434,8 @@ func (fsg *fakeStoreGetter) Get(otherPeer peer.ID, dealID rm.DealID) (*multistor

type fakeTransport struct{}

func (ft *fakeTransport) OpenChannel(ctx context.Context, dataSender peer.ID, channelID datatransfer.ChannelID, root ipld.Link, stor ipld.Node, msg datatransfer.Message) error {
func (ft *fakeTransport) OpenChannel(ctx context.Context, dataSender peer.ID, channelID datatransfer.ChannelID, root ipld.Link, stor ipld.Node,
doNotSend []cid.Cid, msg datatransfer.Message) error {
return nil
}

Expand Down
18 changes: 14 additions & 4 deletions retrievalmarket/impl/integration_test.go
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,8 @@ import (
"github.com/ipfs/go-cid"
"github.com/ipfs/go-datastore"
"github.com/ipfs/go-datastore/namespace"
graphsyncimpl "github.com/ipfs/go-graphsync/impl"
"github.com/ipfs/go-graphsync/network"
"github.com/ipld/go-ipld-prime"
cidlink "github.com/ipld/go-ipld-prime/linking/cid"
basicnode "github.com/ipld/go-ipld-prime/node/basic"
Expand Down Expand Up @@ -97,7 +99,9 @@ func requireSetupTestClientAndProvider(ctx context.Context, t *testing.T, payChA
CreatePaychCID: cids[0],
AddFundsCID: cids[1],
})
dtTransport1 := dtgstransport.NewTransport(testData.Host1.ID(), testData.GraphSync1)

gs1 := graphsyncimpl.New(ctx, network.NewFromLibp2pHost(testData.Host1), testData.Loader1, testData.Storer1)
dtTransport1 := dtgstransport.NewTransport(testData.Host1.ID(), gs1)
dt1, err := dtimpl.NewDataTransfer(testData.DTStore1, testData.DTNet1, dtTransport1, testData.DTStoredCounter1)
require.NoError(t, err)
err = dt1.Start(ctx)
Expand Down Expand Up @@ -135,7 +139,9 @@ func requireSetupTestClientAndProvider(ctx context.Context, t *testing.T, payChA
}

paymentAddress := address.TestAddress2
dtTransport2 := dtgstransport.NewTransport(testData.Host2.ID(), testData.GraphSync2)

gs2 := graphsyncimpl.New(ctx, network.NewFromLibp2pHost(testData.Host2), testData.Loader2, testData.Storer2)
dtTransport2 := dtgstransport.NewTransport(testData.Host2.ID(), gs2)
dt2, err := dtimpl.NewDataTransfer(testData.DTStore2, testData.DTNet2, dtTransport2, testData.DTStoredCounter2)
require.NoError(t, err)
err = dt2.Start(ctx)
Expand Down Expand Up @@ -589,7 +595,9 @@ func setupClient(
IntegrationTest: true,
ChannelAvailableFunds: channelAvailableFunds,
})
dtTransport1 := dtgstransport.NewTransport(testData.Host1.ID(), testData.GraphSync1)

gs1 := graphsyncimpl.New(ctx, network.NewFromLibp2pHost(testData.Host1), testData.Loader1, testData.Storer1)
dtTransport1 := dtgstransport.NewTransport(testData.Host1.ID(), gs1)
dt1, err := dtimpl.NewDataTransfer(testData.DTStore1, testData.DTNet1, dtTransport1, testData.DTStoredCounter1)
require.NoError(t, err)
err = dt1.Start(ctx)
Expand Down Expand Up @@ -624,7 +632,9 @@ func setupProvider(
}
pieceStore.ExpectCID(payloadCID, cidInfo)
pieceStore.ExpectPiece(expectedPiece, pieceInfo)
dtTransport2 := dtgstransport.NewTransport(testData.Host2.ID(), testData.GraphSync2)

gs2 := graphsyncimpl.New(ctx, network.NewFromLibp2pHost(testData.Host2), testData.Loader2, testData.Storer2)
dtTransport2 := dtgstransport.NewTransport(testData.Host2.ID(), gs2)
dt2, err := dtimpl.NewDataTransfer(testData.DTStore2, testData.DTNet2, dtTransport2, testData.DTStoredCounter2)
require.NoError(t, err)
err = dt2.Start(ctx)
Expand Down
3 changes: 2 additions & 1 deletion retrievalmarket/storage_retrieval_integration_test.go
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,8 @@ import (

func TestStorageRetrieval(t *testing.T) {
bgCtx := context.Background()
sh := testharness.NewHarness(t, bgCtx, true, testnodes.DelayFakeCommonNode{}, false)
sh := testharness.NewHarness(t, bgCtx, true, testnodes.DelayFakeCommonNode{},
testnodes.DelayFakeCommonNode{}, false)
shared_testutil.StartAndWaitForReady(bgCtx, t, sh.Client)
shared_testutil.StartAndWaitForReady(bgCtx, t, sh.Provider)

Expand Down
Loading