Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

borevents files producing infinity loop #10299

Closed
AskAlexSharov opened this issue May 13, 2024 · 3 comments
Closed

borevents files producing infinity loop #10299

AskAlexSharov opened this issue May 13, 2024 · 3 comments
Assignees
@mh0lt
Labels
imp1 High importance polygon
Milestone
3.0.0-alpha1

Comments

@AskAlexSharov
Copy link
Collaborator

main

[INFO] [05-13|13:35:03.294] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=22.3GB sys=36.1GB
[DBUG] [05-13|13:35:03.491] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:03.492] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:03.501] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:03.502] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:03.502] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:03.506] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:03.507] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:03.516] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:03.516] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:03.516] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:03.715] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=22.6GB sys=36.1GB
[DBUG] [05-13|13:35:03.823] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:03.825] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:03.834] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:03.835] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:03.835] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:03.838] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:03.840] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:03.845] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:03.846] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:03.846] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:04.042] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=22.8GB sys=36.1GB

[DBUG] [05-13|13:35:04.231] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:04.232] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:04.235] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:04.235] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:04.235] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:04.239] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:04.240] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:04.243] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:04.243] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:04.243] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:04.420] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=23.1GB sys=36.1GB
[DBUG] [05-13|13:35:04.533] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:04.534] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:04.543] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:04.544] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:04.544] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:04.548] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:04.549] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:04.558] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:04.558] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:04.558] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:04.756] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=23.3GB sys=36.1GB

[DBUG] [05-13|13:35:04.967] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:04.969] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:04.978] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:04.978] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:04.978] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:04.982] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:04.983] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:04.992] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:04.992] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:04.992] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:05.170] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=23.6GB sys=36.1GB
[DBUG] [05-13|13:35:05.278] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:05.280] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:05.289] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:05.289] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:05.289] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:05.293] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:05.295] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:05.303] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:05.304] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:05.304] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:05.344] [p2p] GoodPeers                          eth68=3 eth67=5
[INFO] [05-13|13:35:06.505] [mem] memory stats                       Rss=14.9GB Size=0B Pss=14.9GB SharedClean=1.1MB SharedDirty=0B PrivateClean=14.7GB PrivateDirty=210.7MB Referenced=11.4GB Anonymous=210.6MB Swap=0B alloc=23.7GB sys=36.1GB
[INFO] [05-13|13:35:06.660] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=23.8GB sys=36.1GB
[DBUG] [05-13|13:35:06.875] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:06.877] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:06.885] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:06.886] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:06.886] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:06.889] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:06.891] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:06.900] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:06.900] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:06.900] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:07.102] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=24.1GB sys=36.1GB
[DBUG] [05-13|13:35:07.211] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:07.213] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:07.224] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:07.224] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:07.224] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:07.228] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:07.230] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:07.238] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:07.239] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:07.239] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:07.443] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=24.3GB sys=36.1GB
[DBUG] [05-13|13:35:07.660] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:07.662] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:07.671] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:07.671] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:07.671] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:07.676] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:07.678] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:07.687] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:07.687] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:07.687] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:07.885] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=24.6GB sys=36.1GB
[DBUG] [05-13|13:35:07.995] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:07.997] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:08.006] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:08.006] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:08.006] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:08.010] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:08.012] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:08.021] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:08.021] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:08.021] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:08.171] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=24.9GB sys=36.1GB
[DBUG] [05-13|13:35:08.333] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:08.334] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:08.337] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:08.337] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:08.337] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:08.340] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:08.341] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:08.344] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:08.344] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:08.344] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:08.473] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=25.1GB sys=36.1GB
[DBUG] [05-13|13:35:08.564] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:08.566] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:08.578] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:08.578] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:08.578] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:08.583] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:08.585] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:08.594] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:08.594] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:08.594] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:08.799] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=25.4GB sys=36.1GB
[DBUG] [05-13|13:35:09.018] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:09.019] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:09.029] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:09.030] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:09.030] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:09.034] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:09.035] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:09.044] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:09.044] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:09.044] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:09.247] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=25.6GB sys=36.1GB
[DBUG] [05-13|13:35:09.359] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:09.360] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:09.369] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:09.370] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:09.370] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:09.374] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:09.375] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:09.384] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:09.384] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:09.384] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:09.589] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=25.9GB sys=36.1GB
[DBUG] [05-13|13:35:09.812] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:09.814] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:09.823] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:09.824] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:09.824] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:09.828] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:09.829] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:09.838] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:09.838] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:09.838] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:10.039] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=26.2GB sys=36.1GB
[DBUG] [05-13|13:35:10.148] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:10.150] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:10.159] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:10.159] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:10.159] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:10.163] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:10.166] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:10.176] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:10.176] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:10.176] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:10.377] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=26.4GB sys=36.1GB
[DBUG] [05-13|13:35:10.595] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:10.596] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:10.606] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:10.606] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:10.606] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:10.610] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:10.612] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:10.621] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:10.621] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:10.621] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:10.825] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=26.7GB sys=36.1GB
[DBUG] [05-13|13:35:10.935] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:10.937] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:10.946] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:10.946] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:10.946] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:10.950] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:10.952] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:10.960] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:10.960] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:10.960] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:11.160] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=26.9GB sys=36.1GB
[DBUG] [05-13|13:35:11.378] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:11.380] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:11.388] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:11.388] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:11.388] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:11.393] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:11.394] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:11.403] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:11.403] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:11.403] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:11.612] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=27.2GB sys=36.1GB
[DBUG] [05-13|13:35:11.723] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:11.725] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:11.734] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:11.735] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:11.735] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:11.739] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:11.741] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:11.750] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:11.750] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:11.750] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:11.955] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=27.4GB sys=36.1GB
[DBUG] [05-13|13:35:12.181] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:12.183] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:12.193] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:12.193] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:12.193] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:12.197] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:12.199] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:12.208] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:12.208] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:12.208] [index] write                            file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:12.372] [p2p] Server                             protocol=67 peers=5 trusted=0 inbound=0 LOG15_ERROR= LOG15_ERROR= LOG15_ERROR= LOG15_ERROR= LOG15_ERROR= i/o timeout=3 too many peers=30 EOF=10 already connected=1 closed by remote=199010
[DBUG] [05-13|13:35:12.372] [p2p] Dial scheduler                     protocol=67 peers=5/33 tried=205304 static=0 connect: connection refused=90 i/o timeout=5979 connect: connection reset by peer=4 connect: no route to host=1 connect: network is unreachable=126
[DBUG] [05-13|13:35:12.372] [p2p] Discovery table                    protocol=67 version=v4 len=160 live=160 unsol=242 ips=240 db=0 reval=2973 RPC timeout=24 unsolicited reply=23
[DBUG] [05-13|13:35:12.393] [p2p] Discovery table                    protocol=68 version=v4 len=160 live=160 unsol=24 ips=241 db=0 reval=2971 RPC timeout=20 unsolicited reply=3
[DBUG] [05-13|13:35:12.393] [p2p] Dial scheduler                     protocol=68 peers=3/33 tried=216872 static=0 connect: connection refused=92 connect: network is unreachable=135 i/o timeout=7788 connect: no route to host=1
[DBUG] [05-13|13:35:12.393] [p2p] Server                             protocol=68 peers=3 trusted=0 inbound=0 LOG15_ERROR= LOG15_ERROR= LOG15_ERROR= LOG15_ERROR= LOG15_ERROR= closed by remote=208767 i/o timeout=7 EOF=6 too many peers=40 already connected=1
[INFO] [05-13|13:35:12.418] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=27.7GB sys=36.1GB
[DBUG] [05-13|13:35:12.529] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:12.531] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:12.540] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:12.540] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:12.540] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:12.544] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:12.546] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:12.554] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:12.555] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:12.555] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:12.757] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=27.9GB sys=36.1GB
[DBUG] [05-13|13:35:12.979] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:12.981] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:12.990] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:12.991] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:12.991] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:12.995] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:12.996] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:13.005] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:13.006] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:13.006] [index] write                            file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:13.012] [bor.heimdall] Got new milestone         start=56921723 end=56921742
[DBUG] [05-13|13:35:13.012] [bor] current head block behind incoming block=milestone head=56516263 end block=56921742
[INFO] [05-13|13:35:14.324] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=23.7GB sys=36.1GB
[DBUG] [05-13|13:35:14.433] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:14.434] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:14.437] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:14.437] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:14.437] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:14.441] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:14.442] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:14.445] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:14.445] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:14.445] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:14.593] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=14.4GB sys=36.1GB
[DBUG] [05-13|13:35:14.756] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:14.757] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:14.760] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:14.760] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:14.760] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:14.763] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:14.765] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:14.767] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:14.767] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:14.767] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:14.899] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=14.7GB sys=36.1GB
[DBUG] [05-13|13:35:14.983] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:14.984] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:14.987] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:14.987] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:14.987] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:14.990] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:14.992] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:14.994] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:14.994] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:14.994] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:15.120] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=14.9GB sys=36.1GB
[DBUG] [05-13|13:35:15.280] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:15.282] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:15.284] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:15.284] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:15.284] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:15.288] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:15.289] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:15.291] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:15.291] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:15.291] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:15.421] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=15.2GB sys=36.1GB
[DBUG] [05-13|13:35:15.506] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:15.507] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:15.510] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:15.510] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:15.510] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:15.514] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:15.515] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:15.518] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:15.518] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:15.518] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:15.651] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=15.4GB sys=36.1GB
[DBUG] [05-13|13:35:15.812] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:15.814] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:15.816] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:15.816] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:15.816] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:15.820] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:15.821] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:15.823] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:15.823] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:15.823] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:15.951] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=15.7GB sys=36.1GB
[DBUG] [05-13|13:35:16.034] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:16.035] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:16.038] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:16.038] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:16.038] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:16.041] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
[DBUG] [05-13|13:35:16.042] [snapshots] Compression start            file=v1-056339-056340-borspans workers=7
[DBUG] [05-13|13:35:16.045] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borspans.idx.tmp
[DBUG] [05-13|13:35:16.045] [index] calculating                      file=v1-056339-056340-borspans.idx
[DBUG] [05-13|13:35:16.045] [index] write                            file=v1-056339-056340-borspans.idx
[INFO] [05-13|13:35:16.172] [snapshots:bor:retire] Stat              blocks=56340k indices=56340k alloc=15.9GB sys=36.1GB
[DBUG] [05-13|13:35:16.339] [bor snapshots] Retire Bor Blocks        type=borevents range=56339k-56340k
[DBUG] [05-13|13:35:16.340] [snapshots] Compression start            file=v1-056339-056340-borevents workers=7
[DBUG] [05-13|13:35:16.344] [index] created                          file=/mnt/erigon/snapshots/v1-056339-056340-borevents.idx.tmp
[DBUG] [05-13|13:35:16.344] [index] calculating                      file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:16.344] [index] write                            file=v1-056339-056340-borevents.idx
[DBUG] [05-13|13:35:16.347] [bor snapshots] Retire Bor Blocks        type=borspans range=56339k-56340k
@AskAlexSharov AskAlexSharov added this to the 3.0.0-alpha1 milestone May 14, 2024
@AskAlexSharov AskAlexSharov mentioned this issue May 17, 2024
Closed
@yperbasis yperbasis added the imp1 High importance label May 24, 2024
@yperbasis yperbasis modified the milestones: 3.0.0-alpha1, 2.60.1-fixes May 24, 2024
@mh0lt mh0lt mentioned this issue May 24, 2024
Merged
AskAlexSharov pushed a commit that referenced this issue May 25, 2024
@mh0lt
add flag checking for pruning waypoints (#10468)
e83cd70 
This add a check for waypoint processing (checkpoints and milestones) to
prune operations.

It aims to fix:
 
#10327
#10299
#10328
@AskAlexSharov
Copy link
Collaborator Author

I tested after merging #10468

There is 2 problems:

  1. bor files retire process started before first staged sync cycle finished - see [1/15 Snapshots] MaxTxNums index is in progress
[DBUG] [05-25|03:54:11.676] [bor snapshots] Retire Bor Blocks        type=borevents range=54599k-54600k
[DBUG] [05-25|03:54:11.677] [snapshots] Compression start            file=v1-054599-054600-borevents workers=7
[DBUG] [05-25|03:54:11.693] [index] created                          file=/mnt/erigon/snapshots/v1-054599-054600-borevents.idx.tmp
[DBUG] [05-25|03:54:11.693] [index] calculating                      file=v1-054599-054600-borevents.idx
[DBUG] [05-25|03:54:11.693] [index] write                            file=v1-054599-054600-borevents.idx
[DBUG] [05-25|03:54:11.758] [bor snapshots] Retire Bor Blocks        type=borspans range=54599k-54600k
[DBUG] [05-25|03:54:11.760] [snapshots] Compression start            file=v1-054599-054600-borspans workers=7
[INFO] [05-25|03:54:11.822] [1/15 Snapshots] MaxTxNums index: 0k/56913k
[DBUG] [05-25|03:54:11.828] [index] created                          file=/mnt/erigon/snapshots/v1-054599-054600-borspans.idx.tmp
[DBUG] [05-25|03:54:11.828] [index] calculating                      file=v1-054599-054600-borspans.idx
[DBUG] [05-25|03:54:11.828] [index] write                            file=v1-054599-054600-borspans.idx
[INFO] [05-25|03:54:12.049] [snapshots:bor:retire] Stat              blocks=54600k indices=54600k alloc=22.1GB sys=32.5GB
[DBUG] [05-25|03:54:18.689] [bor.heimdall] Got new milestone         start=57359916 end=57359929
[DBUG] [05-25|03:54:18.689] [bor] current head block behind incoming block=milestone head=0 end block=57359929




[DBUG] [05-25|03:54:29.575] [bor.heimdall] Got new milestone         start=57359916 end=57359929
[DBUG] [05-25|03:54:29.575] [bor] current head block behind incoming block=milestone head=0 end block=57359929
[INFO] [05-25|03:54:30.980] [1/15 Snapshots] MaxTxNums index: 9459k/56913k
[DBUG] [05-25|03:54:41.503] [bor.heimdall] Got new milestone         start=57359916 end=57359929
[DBUG] [05-25|03:54:41.504] [bor] current head block behind incoming block=milestone head=0 end block=57359929
[DBUG] [05-25|03:54:45.563] [bor] current head block behind incoming block=checkpoint head=0 end block=57358501
[DBUG] [05-25|03:54:45.563] [bor.heimdall] Got new checkpoint        start=57357734 end=57358501 rootHash=0xad890e6e750fedf9e8657cb0be2488bc81b490f6d5c587c3b35045116f3073c8
[DBUG] [05-25|03:54:45.563] [bor.heimdall] Failed to whitelist checkpoint err="missing blocks"
[DBUG] [05-25|03:54:45.563] [bor] unable to handle whitelist checkpoint err="missing blocks"
[DBUG] [05-25|03:54:53.562] [bor.heimdall] Got new milestone         start=57359916 end=57359929
[DBUG] [05-25|03:54:53.562] [bor] current head block behind incoming block=milestone head=0 end block=57359929
[INFO] [05-25|03:55:00.980] [1/15 Snapshots] MaxTxNums index: 26398k/56913k
[DBUG] [05-25|03:55:05.384] [p2p] Discovery table                    protocol=67 version=v4 len=162 live=162 unsol=24 ips=248 db=0 reval=912 RPC timeout=25 unsolicited reply=3
[DBUG] [05-25|03:55:05.384] [p2p] Server                             protocol=67 peers=3 trusted=0 inbound=0 closed by remote=69341 too many peers=24 EOF=7
[DBUG] [05-25|03:55:05.384] [p2p] Dial scheduler                     protocol=67 peers=3/33 tried=72306 static=0 i/o timeout=2775 connect: connection reset by peer=3 connect: connection refused=129
[DBUG] [05-25|03:55:05.389] [p2p] Server                             protocol=68 peers=7 trusted=0 inbound=0 EOF=3 closed by remote=65285 too many peers=7
[DBUG] [05-25|03:55:05.389] [p2p] Dial scheduler                     protocol=68 peers=7/33 tried=67671 static=0 connect: connection refused=96 i/o timeout=2262 connect: connection reset by peer=4 connect: network is unreachable=1
[DBUG] [05-25|03:55:05.389] [p2p] Discovery table                    protocol=68 version=v4 len=162 live=162 unsol=38 ips=249 db=0 reval=914 RPC timeout=24 unsolicited reply=5
[DBUG] [05-25|03:55:05.509] [bor.heimdall] Got new milestone         start=57359930 end=57359949
[DBUG] [05-25|03:55:05.509] [bor] current head block behind incoming block=milestone head=0 end block=57359949
[WARN] [05-25|03:55:17.467] [bor.heimdall] an error while fetching   path=/milestone/latest queryParams= attempt=1 err="Get \"https://heimdall-api.polygon.technology/milestone/latest\": read tcp 10.132.15.225:43178->104.18.41.110:443: read: connection reset by peer"
[WARN] [05-25|03:55:17.467] [bor.heimdall] an error while fetching   path=/milestone/lastNoAck queryParams= attempt=1 err="Get \"https://heimdall-api.polygon.technology/milestone/lastNoAck\": read tcp 10.132.15.225:43178->104.18.41.110:443: read: connection reset by peer"
[DBUG] [05-25|03:55:19.544] [bor.heimdall] Got new milestone         start=57359930 end=57359949
[DBUG] [05-25|03:55:19.544] [bor] current head block behind incoming block=milestone head=0 end block=57359949
[DBUG] [05-25|03:55:29.496] [bor.heimdall] Got new milestone         start=57359950 end=57359963
[DBUG] [05-25|03:55:29.496] [bor] current head block behind incoming block=milestone head=0 end block=57359963
[INFO] [05-25|03:55:30.981] [1/15 Snapshots] MaxTxNums index: 43713k/56913k
[DBUG] [05-25|03:55:41.523] [bor.heimdall] Got new milestone         start=57359950 end=57359963
[DBUG] [05-25|03:55:41.523] [bor] current head block behind incoming block=milestone head=0 end block=57359963
[DBUG] [05-25|03:55:53.544] [bor.heimdall] Got new milestone         start=57359950 end=57359963
[DBUG] [05-25|03:55:53.544] [bor] current head block behind incoming block=milestone head=0 end block=57359963
[INFO] [05-25|03:55:53.776] [snapshots:download] Stat                blocks=56914k indices=56914k alloc=26.6GB sys=32.5GB
[INFO] [05-25|03:55:53.778] [snapshots] History Stat                 blocks=56912k txs=4095m txNum2blockNum="2048=49361K,2560=56030K,2592=56471K,2608=56715K,2616=56832K,2620=56900K,2621=56912K" first_history_idx_in_db=0 last_comitment_block=56912765 last_comitment_tx_num=4095312500 alloc=26.6GB sys=32.5GB
[DBUG] [05-25|03:55:53.968] [bor snapshots] Retire Bor Blocks        type=borevents range=54599k-54600k
[DBUG] [05-25|03:55:53.970] [snapshots] Compression start            file=v1-054599-054600-borevents workers=7
[DBUG] [05-25|03:55:54.170] [index] created                          file=/mnt/erigon/snapshots/v1-054599-054600-borevents.idx.tmp
[DBUG] [05-25|03:55:54.170] [index] calculating                      file=v1-054599-054600-borevents.idx
[DBUG] [05-25|03:55:54.170] [index] write                            file=v1-054599-054600-borevents.idx
[DBUG] [05-25|03:55:54.387] [bor snapshots] Retire Bor Blocks        type=borspans range=54599k-54600k
[DBUG] [05-25|03:55:54.389] [snapshots] Compression start            file=v1-054599-054600-borspans workers=7
[DBUG] [05-25|03:55:54.484] [index] created                          file=/mnt/erigon/snapshots/v1-054599-054600-borspans.idx.tmp
[DBUG] [05-25|03:55:54.484] [index] calculating                      file=v1-054599-054600-borspans.idx
[DBUG] [05-25|03:55:54.484] [index] write                            file=v1-054599-054600-borspans.idx
[INFO] [05-25|03:55:54.705] [snapshots:bor:retire] Stat              blocks=54600k indices=54600k alloc=26.8GB sys=32.5GB
[DBUG] [05-25|03:55:54.771] [bor snapshots] Retire Bor Blocks        type=borevents range=54599k-54600k
[DBUG] [05-25|03:55:54.772] [snapshots] Compression start            file=v1-054599-054600-borevents workers=7
[DBUG] [05-25|03:55:54.844] [index] created                          file=/mnt/erigon/snapshots/v1-054599-054600-borevents.idx.tmp
[DBUG] [05-25|03:55:54.844] [index] calculating                      file=v1-054599-054600-borevents.idx
[DBUG] [05-25|03:55:54.844] [index] write                            file=v1-054599-054600-borevents.idx
[DBUG] [05-25|03:55:54.912] [bor snapshots] Retire Bor Blocks        type=borspans range=54599k-54600k
[DBUG] [05-25|03:55:54.913] [snapshots] Compression start            file=v1-054599-054600-borspans workers=7
[DBUG] [05-25|03:55:55.002] [index] created                          file=/mnt/erigon/snapshots/v1-054599-054600-borspans.idx.tmp
[DBUG] [05-25|03:55:55.002] [index] calculating                      file=v1-054599-054600-borspans.idx
[DBUG] [05-25|03:55:55.002] [index] write                            file=v1-054599-054600-borspans.idx
[INFO] [05-25|03:55:55.009] [1/15 Snapshots] DONE                    in=14m35.589952325s block=56913999
[INFO] [05-25|03:55:55.012] [2/15 Headers] Waiting for headers...    from=56913999
[DBUG] [05-25|03:55:55.016] [2/15 Headers] Requested header          from=56916716 length=192
[INFO] [05-25|03:55:55.025] [2/15 Headers] Processed                 highest=56914101 age=1w4d19h headers=102 in=0.014 blk/sec=7261
[DBUG] [05-25|03:55:55.026] [2/15 Headers] DONE                      in=17.257551ms
[INFO] [05-25|03:55:55.027] [3/15 BorHeimdall] Processing spans...   from=8532 to=8893
[INFO] [05-25|03:55:55.129] [snapshots:bor:retire] Stat              blocks=54600k indices=54600k alloc=27.0GB sys=32.5GB
[DBUG] [05-25|03:55:55.293] [bor snapshots] Retire Bor Blocks        type=borevents range=54599k-54600k
[DBUG] [05-25|03:55:55.293] [snapshots] Compression start            file=v1-054599-054600-borevents workers=7
[DBUG] [05-25|03:55:55.296] [index] created                          file=/mnt/erigon/snapshots/v1-054599-054600-borevents.idx.tmp
[DBUG] [05-25|03:55:55.296] [index] calculating                      file=v1-054599-054600-borevents.idx
[DBUG] [05-25|03:55:55.296] [index] write                            file=v1-054599-054600-borevents.idx
[DBUG] [05-25|03:55:55.299] [bor snapshots] Retire Bor Blocks        type=borspans range=54599k-54600k
[DBUG] [05-25|03:55:55.300] [snapshots] Compression start            file=v1-054599-054600-borspans workers=7
[DBUG] [05-25|03:55:55.302] [index] created                          file=/mnt/erigon/snapshots/v1-054599-054600-borspans.idx.tmp
[DBUG] [05-25|03:55:55.302] [index] calculating                      file=v1-054599-054600-borspans.idx
[DBUG] [05-25|03:55:55.302] [index] write                            file=v1-054599-054600-borspans.idx
[INFO] [05-25|03:55:55.421] [snapshots:bor:retire] Stat              blocks=54600k indices=54600k alloc=27.3GB sys=32.5GB
[DBUG] [05-25|03:55:55.490] [bor snapshots] Retire Bor Blocks        type=borevents range=54599k-54600k
[DBUG] [05-25|03:55:55.491] [snapshots] Compression start            file=v1-054599-054600-borevents workers=7
[DBUG] [05-25|03:55:55.494] [index] created                          file=/mnt/erigon/snapshots/v1-054599-054600-borevents.idx.tmp
[DBUG] [05-25|03:55:55.494] [index] calculating                      file=v1-054599-054600-borevents.idx
[DBUG] [05-25|03:55:55.494] [index] write                            file=v1-054599-054600-borevents.idx
[DBUG] [05-25|03:55:55.497] [bor snapshots] Retire Bor Blocks        type=borspans range=54599k-54600k
[DBUG] [05-25|03:55:55.497] [snapshots] Compression start            file=v1-054599-054600-borspans workers=7
[DBUG] [05-25|03:55:55.500] [index] created                          file=/mnt/erigon/snapshots/v1-054599-054600-borspans.idx.tmp
[DBUG] [05-25|03:55:55.500] [index] calculating                      file=v1-054599-054600-borspans.idx
[DBUG] [05-25|03:55:55.500] [index] write                            file=v1-054599-054600-borspans.idx
[INFO] [05-25|03:55:55.622] [snapshots:bor:retire] Stat              blocks=54600k indices=54600k alloc=27.6GB sys=32.5GB
[DBUG] [05-25|03:55:55.783] [bor snapshots] Retire Bor Blocks        type=borevents range=54599k-54600k
[DBUG] [05-25|03:55:55.784] [snapshots] Compression start            file=v1-054599-054600-borevents workers=7
[DBUG] [05-25|03:55:55.787] [index] created                          file=/mnt/erigon/snapshots/v1-054599-054600-borevents.idx.tmp
[DBUG] [05-25|03:55:55.787] [index] calculating                      file=v1-054599-054600-borevents.idx
[DBUG] [05-25|03:55:55.787] [index] write                            file=v1-054599-054600-borevents.idx
  1. my node has [snapshots:bor] Stat blocks=54600k indices=54600k alloc=14.2GB sys=14.4GB - 54.6M of bor files. but node still created empty v1-054599-054600-borevents file.

@mh0lt
Copy link
Contributor

mh0lt commented May 25, 2024 •
edited
Loading

I think this implies that https://github.com/ledgerwatch/erigon/blob/e83cd70958e23cace05c9b4582f27cbf2fece2e1/eth/stagedsync/stage_snapshots.go#L432 is called too soon ?

or are you expecting this code:

https://github.com/ledgerwatch/erigon/blob/e83cd70958e23cace05c9b4582f27cbf2fece2e1/turbo/snapshotsync/freezeblocks/block_snapshots.go#L1441

and/or this code

https://github.com/ledgerwatch/erigon/blob/e83cd70958e23cace05c9b4582f27cbf2fece2e1/turbo/snapshotsync/freezeblocks/block_snapshots.go#L1454

to do something special ?

I'll try to reproduce it with Amoy - or I can try to reproduce it on bor-mainnet - but I'll need to sync a node.

@yperbasis yperbasis removed the erigon3 label May 28, 2024
@yperbasis yperbasis modified the milestones: 2.60.1-fixes, 3.0.0-alpha1 May 30, 2024
@mh0lt mh0lt mentioned this issue May 30, 2024
Closed
@mh0lt
Copy link
Contributor

mh0lt commented May 30, 2024 •
edited
Loading

I have moved Alex's follow-up issue to: #10554

I will continue to test there - I believe these are e3 related.

@mh0lt mh0lt closed this as completed May 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@mh0lt mh0lt

Labels
imp1 High importance polygon
Projects
None yet
Milestone
3.0.0-alpha1
Development

No branches or pull requests
3 participants
@yperbasis @AskAlexSharov @mh0lt