Error in log: "Nonce not matching. That should never happen."

[phytohydra]

Getting this error regularly in the log running haveno-reto current (1.0.14)

Dec-13 19:10:23.909 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=1621339598 / requestNonce=-474283716 
Dec-13 19:10:24.245 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=84399485 / requestNonce=1290554195 
Dec-13 19:10:24.246 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-172501263 / requestNonce=1623740782 
Dec-13 19:10:24.707 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-1484413363 / requestNonce=-741922057 
Dec-13 19:10:24.710 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=1148375002 / requestNonce=2099968002 
Dec-13 19:10:25.302 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-510280841 / requestNonce=1197692842 
Dec-13 19:10:25.357 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-702760936 / requestNonce=-144646472 
Dec-13 19:10:25.370 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-1144968416 / requestNonce=-284485975 
Dec-13 19:10:25.416 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=517124155 / requestNonce=-1641372142 
Dec-13 19:10:25.426 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-475173033 / requestNonce=-706864398 
Dec-13 19:10:25.688 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=1050155831 / requestNonce=1047834403 
Dec-13 19:10:25.831 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-2054980902 / requestNonce=-1215530197 
Dec-13 19:10:25.906 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-483059050 / requestNonce=2054211054 
Dec-13 19:10:25.934 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-1168613514 / requestNonce=834774094 
Dec-13 19:10:25.981 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=418612377 / requestNonce=-1827136097 
Dec-13 19:10:25.993 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-959795992 / requestNonce=-1920076496 
Dec-13 19:10:26.167 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=1299328134 / requestNonce=1884661190 
Dec-13 19:10:26.448 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=1616876771 / requestNonce=1198195756 
Dec-13 19:10:26.449 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=688085074 / requestNonce=49801105 
Dec-13 19:10:26.453 [Connection] WARN  h.n.p2p.peers.keepalive.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-1812799384 / requestNonce=42229568

[woodser]

Are you still seeing it?

[woodser]

It looks like a peer is spamming you. This PR throttles the warnings: #1469

[phytohydra]

I've been running for a while every day with --maxConnections=300 to gauge the size of the network, so I'm more likely to see a single peer out of the network misbehaving than someone with max 12 connections. I'll leave it up longer today to see if I get it again. Maybe it should log the peer address to make it easier to track them down?

[woodser]

Added the peer node address to the log.

[woodser]

Logging merged in #1469

[phytohydra]

Got some more of them. I put in the peer logging but not the suppression, so I got to see that it happens in a burst, but from all different peers:

Dec-16 02:24:22.646 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=346204708, requestNonce=-247165601, peerNodeAddress=tgplvhzgagop2ruw5l4lsgjv7exqapn3qhfbfrvaetdhnrua6pxsm4ad.onion:9999
Dec-16 02:24:23.314 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=1288282111, requestNonce=-1822665368, peerNodeAddress=buogeo4nxeaig4spp5dqe7e73veze7hzmviqdlbzzcb3mppa6dxansyd.onion:9999
Dec-16 02:24:25.728 [NetworkNode.connectionExecutor:SendMessage-to-hc4hvxr3myb5...] INFO  h.n.p.n.NetworkNode: Socket creation to peersNodeAddress hc4hvxr3myb5u4kq3pdlrml3zmq7zxp26htsqphh46hncbzrqxxdlryd.onion:9999 took 2670 ms
Dec-16 02:24:26.256 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=387000999, requestNonce=1580261316, peerNodeAddress=fygijbpqlvcfdmcqneduszxfcf6cri75x2tulgbd4obmzkk2nxvm22yd.onion:9999
Dec-16 02:24:27.181 [InputHandler-xfwe4efuux63...] WARN  h.n.p.n.Connection: proto is null because protoInputStream.read()=-1 (EOF). That is expected if client got stopped without proper shutdown.
Dec-16 02:24:27.182 [InputHandler-xfwe4efuux63...] WARN  h.n.p.n.Connection: We received 1 other log warnings since the last log entry
Dec-16 02:24:27.290 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=942537595, requestNonce=360691027, peerNodeAddress=5y2srgj6anttlqblcigjn5thmreb5l5jsvzn5j4hh75etqxurcbiv2qd.onion:9999
Dec-16 02:24:27.808 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=171293810, requestNonce=1610502600, peerNodeAddress=tdzexbf74jugnft3tdd7k7zstwsusreok7tfih65tfps3ztrq3oujtad.onion:9999
Dec-16 02:24:27.813 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=1104960369, requestNonce=868996329, peerNodeAddress=hsln7uj36nrb5ggokflq6fvuqv2ddztmnrefte3a3lzcy6yqpf4bjmqd.onion:9999
Dec-16 02:24:28.107 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=2086221310, requestNonce=395946198, peerNodeAddress=p6gokifyshtrx32ttqnnkajz64qa4l5a5u65xnb6mr6exl6cb35sorid.onion:9999
Dec-16 02:24:28.196 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-1353032795, requestNonce=-607973547, peerNodeAddress=mbzn6udbzu4ofysnatxvzwzwmet5rvavl4js75eypfecyt5xmxj5feyd.onion:9999
Dec-16 02:24:28.197 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-150444912, requestNonce=-325508870, peerNodeAddress=o33lxuamcpoowwr23f2xzfkdb7ha4leci3qct43jbqhmpmghnknvq7yd.onion:9999
Dec-16 02:24:28.361 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=816351248, requestNonce=728076362, peerNodeAddress=vkdjacflpjziimhrhysxhnzdzqv4m4fb6upsjss4lg2iuiwlhylem4id.onion:9999
Dec-16 02:24:31.034 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=1491178924, requestNonce=1956516523, peerNodeAddress=37f5i3teybzp6sl2rfa3ryl2od7wkw7p7l6na4r4wzzjhgbwr2h3whad.onion:9999
Dec-16 02:24:31.329 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=1575945817, requestNonce=1025184275, peerNodeAddress=gq3im7beyrsdkdjja25fwwwwrzvwkhylpaukc3fkv5h5ddmin4edarqd.onion:9999
Dec-16 02:24:31.330 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-334741605, requestNonce=1924683161, peerNodeAddress=25jq4svwciqqy3zodnr5j2jh3rg52aceqagmeww3rlq7ftz2i6bgz4qd.onion:9999

[phytohydra]

It takes a couple days of continuous running to see it again. I got two more batches so far; I include one below. All different addresses, all within a few seconds of each other.

Dec-18 22:49:50.511 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-1631914064, requestNonce=356095002, peerNodeAddress=o33lxuamcpoowwr23f2xzfkdb7ha4leci3qct43jbqhmpmghnknvq7yd.onion:9999
Dec-18 22:49:50.929 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-1220301868, requestNonce=-1027844903, peerNodeAddress=2z6mdav4ntj3s4lutle2bu7y3v2oy7qf7dsnlf2jlmvxx4uskjx7hsyd.onion:9999
Dec-18 22:49:51.229 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-1154569200, requestNonce=2069925468, peerNodeAddress=5yzmfggwkhvu2gmskzzmmh5pfccnmxr3khqove4ozblvmxoyjfjouzad.onion:9999
Dec-18 22:49:51.229 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=883736792, requestNonce=-1712211927, peerNodeAddress=k7a4wznriipwvshvnhjbs3boes4dtta57kxi3k7optgccr6hmxfhn5qd.onion:9999
Dec-18 22:49:51.244 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=1792499313, requestNonce=1639130318, peerNodeAddress=ca5zsndrfi5syiyv663gaeaapm2qlmdkrlubgulq23pjppetymas3pad.onion:9999
Dec-18 22:49:51.539 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=770346233, requestNonce=-708512004, peerNodeAddress=hgdtf7lbfnnei4lyetkd32gzfea4v6e6ry4xlhs6uqzbtqyjljsmuzqd.onion:9999
Dec-18 22:49:51.767 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=313091805, requestNonce=206633245, peerNodeAddress=oxb2yya76bk6jvg5mj7gvpaqlmg4kh4irm5fm2brwo4pj5vqdncuoiyd.onion:9999
Dec-18 22:49:51.901 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=477682687, requestNonce=1651190490, peerNodeAddress=xy5zhoqqlzmlk6alvp2qtkjc4gvbrfvubw3qotf4zndfte46wk4sg5qd.onion:9999
Dec-18 22:49:52.061 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=1248641026, requestNonce=-17269292, peerNodeAddress=c4nsvnyz3lbxvatobdegilze7j3ormqmpvipbbxqqdq7nmdrnslr5qqd.onion:9999
Dec-18 22:49:52.209 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-1936485402, requestNonce=2046269617, peerNodeAddress=zshos3ou4mvsjlnemyttctsxqqkzs32ugpxvd42mefl2yo276mvibwyd.onion:9999
Dec-18 22:49:52.989 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=786870834, requestNonce=-262365044, peerNodeAddress=ylkyak2yt2jsf6w3r3f5gfcdzwfgiz3meenhvjrad2fby54p3qzyhqqd.onion:9999
Dec-18 22:49:52.990 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=366853807, requestNonce=950970691, peerNodeAddress=ojbffecd2kh7dmtbty4x5xhirv3ayhqngxjb7vcurgl2kb24hshqncyd.onion:9999
Dec-18 22:49:53.306 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-357852586, requestNonce=-741390208, peerNodeAddress=kvewia2hrqwl3d3jspv4dvnbfar5iolbjgkvh3v4e3daiqcvtc3emsqd.onion:9999
Dec-18 22:49:53.780 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-1903743823, requestNonce=-689195030, peerNodeAddress=udomnsmnvb55oqb6uqrjhvdvnme6lnzwvc2udln6tsfkbmrpwzau27yd.onion:9999
Dec-18 22:49:53.867 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-1916480105, requestNonce=-1082666411, peerNodeAddress=tdzexbf74jugnft3tdd7k7zstwsusreok7tfih65tfps3ztrq3oujtad.onion:9999
Dec-18 22:49:54.641 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-1629597582, requestNonce=-1945577945, peerNodeAddress=5xrp2axvqy3fivok4tvxt65sld3psmpdluvtqfkrjcvxgzxtjakxb7yd.onion:9999
Dec-18 22:49:54.641 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-985944565, requestNonce=-1486822925, peerNodeAddress=craoitfdrefxsll3t5frh3zxgx7gkcy67s25ihd3k5xugkqkcdbp77id.onion:9999
Dec-18 22:49:55.217 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=1417641139, requestNonce=-1797694093, peerNodeAddress=w7s5rc7vieleeolb6sgbqi635p7hsutig45trfm5pu5fvlmcyrgjrlqd.onion:9999
Dec-18 22:49:55.304 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-862703096, requestNonce=-812403631, peerNodeAddress=fygijbpqlvcfdmcqneduszxfcf6cri75x2tulgbd4obmzkk2nxvm22yd.onion:9999
Dec-18 22:49:55.467 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-798504338, requestNonce=595600131, peerNodeAddress=spabjqxftcfaa5oe4r2kkrpj2lhizy6vzb7oawhjg2kq4hmscb3gd4id.onion:9999
Dec-18 22:49:55.622 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-239403068, requestNonce=1798542344, peerNodeAddress=r4gmnrkcw6nohnhdwxusokobmnzkeup4r7wqy3vmd5ji3pa6fqolcdqd.onion:9999
Dec-18 22:49:56.301 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=481376900, requestNonce=1648004909, peerNodeAddress=j4h75rjqqmo6tk2nz4chvdy6wxofkbk6nqi3vuepflz3zir5zejuq7ad.onion:9999
Dec-18 22:49:56.793 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=-314029806, requestNonce=-2031609212, peerNodeAddress=bjlrljw43v3zzuy6l65t6ddv2g2b3eju4wxydzhpb3vzhvpb4phrzcyd.onion:9999
Dec-18 22:49:57.559 [Connection] WARN  h.n.p.p.k.KeepAliveHandler: Nonce not matching. That should never happen.
        We drop that message. nonce=436085855, requestNonce=-594079232, peerNodeAddress=vzrg53leynvo52hjt6kqv6mjlqdbonkhir6gpdkjvlun4euswiynwjad.onion:9999