Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase the number of times precommit2 is attempted before moving back to precommit1 #3720

Merged
merged 1 commit into from
Sep 10, 2020

Conversation

lanzafame
Copy link
Contributor

Because restarting a precommit2 worker twice during sector data transfer has resulted in them being sent back to precommit1.

Ideally, there would be a subset of errors that cause this counter to increment and not things like the user restarting a worker.

@magik6k magik6k merged commit f64bd55 into master Sep 10, 2020
@magik6k magik6k deleted the fix/increase-precommit2-retry-counter branch September 10, 2020 09:52
@RobQuistNL
Copy link
Contributor

I think this partially fixes #3563 and #3585

This might just make my mining setup about 20% more efficient <3

@RobQuistNL
Copy link
Contributor

Unfortunately it looks like it just retries 3 times and fails instantly (because the files were partially moved?) and then ends up being the same end result :P

Event Log:
0.	2020-09-13 23:44:02 +0000 UTC:	[event;sealing.SectorStart]	{"User":{"ID":214,"SectorType":3}}
1.	2020-09-13 23:44:02 +0000 UTC:	[event;sealing.SectorAddPiece]	{"User":{"NewPiece":{"Piece":{"Size":131072,"PieceCID":{"/":"baga6ea4seaqe5mrbltsbvek3awsbjh4qygzw4bwnfsgndlxwxjxgfwagzvmlgmq"}},"DealInfo":{"PublishCid":{"/":"bafy2bzaceddzac2ozsrxfc2jy23q4kmkbrds3d5bs7rnwmfs24gi4uhq54ec4"},"DealID":133467,"DealSchedule":{"StartEpoch":63554,"EndEpoch":766969},"KeepUnsealed":true}}}}
2.	2020-09-14 00:41:01 +0000 UTC:	[event;sealing.SectorAddPiece]	{"User":{"NewPiece":{"Piece":{"Size":131072,"PieceCID":{"/":"baga6ea4seaqd2fvj5q5flfvpsc2u34fru3vcp2fbpiblgznivzvisxu3x4mtqoy"}},"DealInfo":{"PublishCid":{"/":"bafy2bzacebnbajm54eu2ufgby7zwk52jaqmszkjiupgnimi72xgka3bqr5fkg"},"DealID":133961,"DealSchedule":{"StartEpoch":63669,"EndEpoch":766969},"KeepUnsealed":true}}}}
3.	2020-09-14 01:44:32 +0000 UTC:	[event;sealing.SectorAddPiece]	{"User":{"NewPiece":{"Piece":{"Size":131072,"PieceCID":{"/":"baga6ea4seaqg5u5caaflpqrro2bf5kodbfgbfzmowxibokf3w6e4sswbyfy5cai"}},"DealInfo":{"PublishCid":{"/":"bafy2bzaceai3nmjdzfpdmkivviikbj3rf26dmfsxktaficc3lz7xat3nnlirq"},"DealID":134339,"DealSchedule":{"StartEpoch":63792,"EndEpoch":766969},"KeepUnsealed":true}}}}
4.	2020-09-14 02:44:02 +0000 UTC:	[event;sealing.SectorStartPacking]	{"User":{}}
5.	2020-09-14 02:53:38 +0000 UTC:	[event;sealing.SectorPacked]	{"User":{"FillerPieces":[{"Size":131072,"PieceCID":{"/":"baga6ea4seaqi5hrea(.....)dt3w7qpbikpa"}}]}}
6.	2020-09-14 06:56:11 +0000 UTC:	[event;sealing.SectorPreCommit1]	{"User":{"PreCommit1Out":"eyJyZWdpc3(...)wxMF19","TicketValue":"MTZgw2ABZTKbHqp1seO6nrDT5gxsntTrUl2M6w6RKrc=","TicketEpoch":57287}}
7.	2020-09-14 07:03:39 +0000 UTC:	[event;sealing.SectorSealPreCommit2Failed]	{"User":{}}
	seal pre commit(2) failed: failed to acquire sector {2388 214} from remote (tried [{8811b30c-557d-4dec-9ce7-f4c7505643d8 [http://192.168.2.100:2345/remote/cache/s-t02388-214] 10 true false false}]): 1 error occurred:
	* fetch error http://192.168.2.100:2345/remote/cache/s-t02388-214 (storage 8811b30c-557d-4dec-9ce7-f4c7505643d8) -> /home/sealer2/.lotusworker/cache/fetching/s-t02388-214: read tcp 192.168.2.6:54866->192.168.2.100:2345: read: connection timed out


8.	2020-09-14 07:04:39 +0000 UTC:	[event;sealing.SectorRetrySealPreCommit2]	{"User":{}}
9.	2020-09-14 07:04:39 +0000 UTC:	[event;sealing.SectorSealPreCommit2Failed]	{"User":{}}
	seal pre commit(2) failed: allocate local sector for fetching: couldn't find a suitable path for a sector
10.	2020-09-14 07:05:39 +0000 UTC:	[event;sealing.SectorRetrySealPreCommit2]	{"User":{}}
11.	2020-09-14 07:05:39 +0000 UTC:	[event;sealing.SectorSealPreCommit2Failed]	{"User":{}}
	seal pre commit(2) failed: allocate local sector for fetching: couldn't find a suitable path for a sector
12.	2020-09-14 07:06:39 +0000 UTC:	[event;sealing.SectorRetrySealPreCommit2]	{"User":{}}
13.	2020-09-14 07:06:39 +0000 UTC:	[event;sealing.SectorSealPreCommit2Failed]	{"User":{}}
	seal pre commit(2) failed: allocate local sector for fetching: couldn't find a suitable path for a sector
14.	2020-09-14 07:07:39 +0000 UTC:	[event;sealing.SectorRetrySealPreCommit1]	{"User":{}}
15.	2020-09-14 11:34:23 +0000 UTC:	[event;sealing.SectorSealPreCommit1Failed]	{"User":{}}
	seal pre commit(1) failed: handler: websocket connection closed
16.	2020-09-14 11:35:23 +0000 UTC:	[event;sealing.SectorRetrySealPreCommit1]	{"User":{}}
17.	2020-09-14 21:32:04 +0000 UTC:	[event;sealing.SectorPreCommit1]	{"User":{"PreCommit1Out":"ey(...)EsMTkxLDE0MiwxMF19","TicketValue":"4dYJFFxyz8UKg709Ba5V91E+1aCLk7ezzj542cMDcx8=","TicketEpoch":58330}}
18.	2020-09-14 22:04:51 +0000 UTC:	[event;sealing.SectorPreCommit2]	{"User":{"Sealed":{"/":"bagboea4b5abcbdxrtbv4xqoucshnvhb6rsgnvn3k5pflfigm2odikr4qv7d3ikkf"},"Unsealed":{"/":"baga6ea4seaqdokw4voysy3hntqerrn3xr4hmpmgrniiyzvp5agtknlptd67y4cq"}}}
19.	2020-09-14 22:04:51 +0000 UTC:	[event;sealing.SectorPreCommitted]	{"User":{"Message":{"/":"bafy2bzacedfiz26qdkw2xgfalbrvlvr6cswdv2aaabbpls4dbl6njldrkgv4e"},"PreCommitDeposit":"352567768484325152","PreCommitInfo":{"SealProof":3,"SectorNumber":214,"SealedCID":{"/":"bagboea4b5abcbdxrtbv4xqoucshnvhb6rsgnvn3k5pflfigm2odikr4qv7d3ikkf"},"SealRandEpoch":58330,"DealIDs":[133467,133961,134339],"Expiration":769849,"ReplaceCapacity":false,"ReplaceSectorDeadline":0,"ReplaceSectorPartition":0,"ReplaceSectorNumber":0}}}
20.	2020-09-14 22:08:30 +0000 UTC:	[event;sealing.SectorPreCommitLanded]	{"User":{"TipSet":"AXGg5AIgpehHoznKyobRG/v4ozEhqSzUybVz4ykMr2cXUfFEI0sBcaDkAiB38YYgyNfDju7Y0qUMgZscYxJxF2Tx3Mbw3mULKSiClA=="}}
21.	2020-09-14 23:23:30 +0000 UTC:	[event;sealing.SectorSeedReady]	{"User":{"SeedValue":"EoVi7SXbE5Fd1Sb+KuPNV7JjuEYoa+TeGryAij96j14=","SeedEpoch":60641}}
22.	2020-09-15 01:09:59 +0000 UTC:	[event;sealing.SectorCommitted]	{"User":{"Proof":"mSlg(....)sn+rSWkzN5BvFVS/B"}}
23.	2020-09-15 01:09:59 +0000 UTC:	[event;sealing.SectorCommitSubmitted]	{"User":{"Message":{"/":"bafy2bzacedf5daecchodllqvfgxosxfs2jm7qrzy4p3v2zbmwqkzep2v5zer6"}}}
24.	2020-09-15 01:13:31 +0000 UTC:	[event;sealing.SectorProving]	{"User":{}}
25.	2020-09-15 01:53:51 +0000 UTC:	[event;sealing.SectorFinalized]	{"User":{}}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants