Delegate not forging

docker logs

[2020-02-07 14:11:30.197] ERROR: Couldn't find any common blocks.
[2020-02-07 14:11:30.209] INFO : 51.15.218.206 has downloaded 10 blocks from height 65,082
[2020-02-07 14:11:30.485] INFO : Broadcasting block 65,648 to 5 peers
[2020-02-07 14:11:44.357] ERROR: Couldn't find any common blocks.
[2020-02-07 14:11:44.374] INFO : 51.15.218.206 has downloaded 10 blocks from height 65,082
[2020-02-07 14:11:54.300] ERROR: Couldn't find any common blocks.
[2020-02-07 14:11:54.317] INFO : 51.15.218.206 has downloaded 10 blocks from height 65,082
[2020-02-07 14:12:02.183] ERROR: Couldn't find any common blocks.
[2020-02-07 14:12:02.202] INFO : 51.15.218.206 has downloaded 10 blocks from height 65,082
[2020-02-07 14:12:10.334] ERROR: Couldn't find any common blocks.
[2020-02-07 14:12:10.353] INFO : 51.15.218.206 has downloaded 10 blocks from height 65,082
[2020-02-07 14:12:18.287] ERROR: Couldn't find any common blocks.
[2020-02-07 14:12:18.302] INFO : 51.15.218.206 has downloaded 10 blocks from height 65,082
[2020-02-07 14:12:29.460] INFO : 51.68.199.89 has downloaded 0 blocks from height 66,049
[2020-02-07 14:12:29.970] DEBUG: event 'WAKEUP': "idle" -> {"syncWithNetwork":"syncing"} -> actions: [checkLastDownloadedBlockSynced]
[2020-02-07 14:12:29.972] DEBUG: Queued chunks of blocks (process: 0)
[2020-02-07 14:12:29.975] DEBUG: event 'NOTSYNCED': {"syncWithNetwork":"syncing"} -> {"syncWithNetwork":"downloadBlocks"} -> actions: [downloadBlocks]
[2020-02-07 14:12:29.976] DEBUG: Downloading blocks in chunks: [65649, 66048], [66049, ..]
[2020-02-07 14:12:29.986] INFO : 51.158.113.20 has downloaded 0 blocks from height 66,049
[2020-02-07 14:12:29.989] ERROR: Could not download blocks [66049, ..] from any of 1 peer. Last attempt returned 0 blocks from peer 51.158.113.20:4002.
[2020-02-07 14:12:29.989] INFO : Could not download any blocks from any peer from height 65649
1 Like

Moved to uns.network blockchain

I’ve the same problem, and according to Delegate monitor, 6 nodes are “not forging”: https://sandbox.explorer.uns.network/delegate-monitor

Some elements I’ve found relevant in my node’s log:

uns-sandbox | [2020-02-07 15:44:33.482] INFO : Forged new block be85e2d9c73f40f32ce3490bf66141148edf4258888a2a447be875bd362ddd82 by delegate 38025c9fce2ad334d0aa39e7ee6ca4dc166143910533b6dabf187b6a056e90c9 (020f472925e7b07d7dc67ae146cc5342272313918cbd2da92cbf57c95f4a66a85c)
uns-sandbox | [2020-02-07 15:44:33.482] DEBUG: Broadcasting block 65,603 (be85e2d9c73f40f32ce3490bf66141148edf4258888a2a447be875bd362ddd82) with 0 transactions to 127.0.0.1
uns-sandbox | [2020-02-07 15:44:33.486] INFO : Received new block at height 65,603 with 0 transactions from 127.0.0.1
uns-sandbox | [2020-02-07 15:44:33.486] INFO : Previous block 65,602 pinged blockchain 0 times
uns-sandbox | [2020-02-07 15:44:33.486] DEBUG: event 'NEWBLOCK': "idle" -> "newBlock"
uns-sandbox | [2020-02-07 15:44:33.488] DEBUG: Delegate 38025c9fce2ad334d0aa39e7ee6ca4dc166143910533b6dabf187b6a056e90c9 (020f472925e7b07d7dc67ae146cc5342272313918cbd2da92cbf57c95f4a66a85c) allowed to forge block 65,603
uns-sandbox | [2020-02-07 15:44:33.488] DEBUG: Delegate genesis_5 (02653f836c05f24d6a286321eb8fb84982d7399fd106e6f63ac63f1cc74cc022d1) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.488] DEBUG: Delegate a99ee098dd4fd00ba513e1ca09abb8522a8ba94fa2a7a81dd674eac27ce66b94 (03d90ec50e59afe828f317efdc14ccf533e13a9a7f3d308b9f03b611b334a39d58) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.489] DEBUG: Delegate genesis_19 (021d8e708a7ab97d57448d6aa5a71d01d638afde5ee1ce5deacd157a65ac8691f1) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.490] DEBUG: Delegate genesis_20 (027f5786168d570a552bb069b42bc0100641559bf609439c3ebc8741d608f1bfa8) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.490] DEBUG: Delegate genesis_16 (035570ba75e0aff124b4adbe7e444b265834e9e45615378406659ec08ff1bef04d) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.490] DEBUG: Delegate genesis_13 (02334a13be3255fd0297569a6b97cab59f3a0ca0bd7751c224904c3d75d052a56b) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.490] DEBUG: Delegate genesis_22 (0318d6a314ca68a748a89370b458736694ab062d61df5e934345f6c81d01c8a527) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.490] DEBUG: Delegate genesis_12 (03bfca22b5f0841ad46ae4fbcc431057a2ac73a68c80d6f48a0a3c6299965fbd86) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.490] DEBUG: Delegate genesis_9 (03c2cb5d2667ce160c7d4898e60c888179a4e3d458f6131668706423a44953e1a5) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.491] DEBUG: Delegate genesis_4 (034333ead9714481646153086572d625f3c97981143e5d4eb3dcb1973307eef6ee) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.491] DEBUG: Delegate genesis_18 (02dc2c6433efbe771493c703c025b3f549bb805cfd6fac76128bb8b91c7c4145b3) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.491] DEBUG: Delegate 2cd2bd261f3f027819701e014c9aad11bdce65c7e9f83f9bc2cd668b150292a1 (03082dfa29139f4828108c73fdc59d8073a220e4e9a6f83f8dc0dc2725b0943c13) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.491] DEBUG: Delegate genesis_17 (02ce0e50600bf77371cb6ed94935f287df7eec04591a9f4c44b156c19443ddf43d) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.491] DEBUG: Delegate genesis_10 (03155ee35ae6fc435f4736b11ce7602ace9157ae5da395580d4eec6281b0aa49dc) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.491] DEBUG: Delegate genesis_3 (0371ab19c6aa40885fd3681cdc4210c84e3eee6d13592a1f74854a61abc2add950) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.492] DEBUG: Delegate genesis_21 (03197b2ea7c5c8e62a91be38e75c539121431e52f99b896db9cef64f40dcbd09ab) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.492] DEBUG: Delegate genesis_2 (036e6ffb37b784ef7d3e2bd48c7877bf5e7f9c0e9debcd027f844423bda8ba86ab) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.492] DEBUG: Delegate genesis_11 (034fe6daa939fc9a1830d88e035dda8a6759d0e0edc747ea82f26c73863b11913d) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.492] DEBUG: Delegate genesis_6 (02df1cec36cd050a73a9508716c07bfd883d95d81097518289ed5305e6f07c7b75) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.492] DEBUG: Delegate genesis_8 (03bafb6e11e0354476828b90b6d1e3fe1febbf2ba20819d70afa6827bd4d56d803) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.492] DEBUG: Delegate genesis_14 (02514056cc9109a016064d9381dc4cbef9fc3b895d75fb2661188f3a6e0d40923e) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.492] DEBUG: Delegate genesis_1 (02b750c6696c9d7c1cc7b4241dd540e11d8153ec2eece82a51ed11cde8929b8259) just missed a block.
uns-sandbox | [2020-02-07 15:44:33.539] DEBUG: event 'PROCESSFINISHED': "newBlock" -> "idle" -> actions: [checkLater, blockchainReady]
uns-sandbox | [2020-02-07 15:44:34.038] INFO : Broadcasting block 65,603 to 6 peers
uns-sandbox | [2020-02-07 15:44:39.491] INFO : 51.158.113.20 has downloaded 0 blocks from height 65,679
uns-sandbox | [2020-02-07 15:44:40.362] ERROR: Couldn't find any common blocks.
uns-sandbox | [2020-02-07 15:44:40.393] INFO : 51.15.218.206 has downloaded 10 blocks from height 65,082
uns-sandbox | [2020-02-07 15:44:40.525] INFO : 51.158.113.20 has downloaded 0 blocks from height 65,679
uns-sandbox | [2020-02-07 15:44:41.636] INFO : 51.158.113.20 has downloaded 0 blocks from height 65,679
uns-sandbox | [2020-02-07 15:44:42.666] INFO : 51.158.113.20 has downloaded 0 blocks from height 65,679
uns-sandbox | [2020-02-07 15:44:43.763] INFO : 51.158.113.20 has downloaded 0 blocks from height 65,679
uns-sandbox | [2020-02-07 15:44:44.802] INFO : 51.158.113.20 has downloaded 0 blocks from height 65,679
uns-sandbox | [2020-02-07 15:44:50.339] ERROR: Couldn't find any common blocks.
uns-sandbox | [2020-02-07 15:44:50.362] INFO : 51.15.218.206 has downloaded 10 blocks from height 65,082
uns-sandbox | [2020-02-07 15:44:58.260] ERROR: Couldn't find any common blocks.
uns-sandbox | [2020-02-07 15:44:58.298] INFO : 51.158.99.6 has downloaded 10 blocks from height 65,082
uns-sandbox | [2020-02-07 15:45:06.246] ERROR: Couldn't find any common blocks.
uns-sandbox | [2020-02-07 15:45:06.273] INFO : 51.15.218.206 has downloaded 10 blocks from height 65,082
uns-sandbox | [2020-02-07 15:45:14.233] ERROR: Couldn't find any common blocks.
uns-sandbox | [2020-02-07 15:45:14.257] INFO : 51.15.218.206 has downloaded 10 blocks from height 65,082
uns-sandbox | [2020-02-07 15:45:22.428] ERROR: Couldn't find any common blocks.
uns-sandbox | [2020-02-07 15:45:22.453] INFO : 51.15.218.206 has downloaded 10 blocks from height 65,082

Apparently my node (38025c9fce2ad334d0aa39e7ee6ca4dc166143910533b6dabf187b6a056e90c9) forged a block (Forged new block be85e2d9c73f40f32ce3490bf66141148edf4258888a2a447be875bd362ddd82) with 0 transactions and broadcasted it to itself (Broadcasting block 65,603 (be85e2d9c73f40f32ce3490bf66141148edf4258888a2a447be875bd362ddd82) with 0 transactions to 127.0.0.1).

But then the log shows that the 22 others active delegates “just missed a block” (is it the forged block mentionned before ?), and we see afterward multiple “ERROR: Couldn’t find any common blocks.” messages.

Also while the log indicates: uns-sandbox | [2020-02-07 15:57:55.948] INFO : Blockchain 100% in sync, it seems that the block numbers (656xx) processed by my node are significantly behind the last block number in the explorer (77663 at time of writing).

It seems there is download problems from some peers:

uns-sandbox | [2020-02-07 16:03:58.396] ERROR: Could not download blocks [65610, ..] from any of 1 peer. Last attempt returned 0 blocks from peer 212.47.247.171:4002.
uns-sandbox | [2020-02-07 16:03:58.396] INFO : Could not download any blocks from any peer from height 65610

Find the complete log at this url: https://www.cloud-libre.eu/index.php/s/42fPyoPjfYB5NP8

1 Like

We are investigating this issue, stay tuned

1 Like

Hi @bpresles @yannis @rigwild,

After investigating, we observe that issues come from a synchronization problem between some nodes.
Now, the problem is solved.

You can restart your nodes with the following instructions :

  [sudo] docker-compose down -v 
  [sudo] docker-compose up -d

If you continue to encounter issues, keep us informed. :slight_smile:

1 Like

It works! Thanks :slight_smile:

I still encounter the issue even after having executed the docker-compose down -v command than up -d (which I already tried with no success earlier this afternoon)

Same error messages. I will try it again to see if it make it work after several attempts.
Additionally to highlighted errors mentioned above, I’ve noticed the following list g entry:

uns-sandbox | [2020-02-07 21:29:06.683] INFO : Tried to sync 5 times to different nodes, looks like the network is missing blocks

EDIT: After 4 successive attempts it finally synced correctly!