Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

'tokio-runtime-worker' panicked at 'Digest item must match that calculated #645

Closed
kadubarral opened this issue May 18, 2022 · 6 comments
Closed

'tokio-runtime-worker' panicked at 'Digest item must match that calculated #645

kadubarral opened this issue May 18, 2022 · 6 comments
Labels
bug Something isn't working Stale

Comments

@kadubarral
Copy link

kadubarral commented May 18, 2022 •
edited
Loading

My full node stopped at block 1024960

Here are my parameters

      - '--pruning'
      - 'archive'
      - '--rpc-cors'
      - 'all'
      - '--name'
      - '"klever-astar"'
      - '--chain'
      - 'astar'
      - '--parachain-id'
      - '2006'
      - '--base-path'
      - '/data'
      - '--execution' 
      - 'Native'
      - '--pool-limit'
      - '65536'
      - '--unsafe-rpc-external'
      - '--ws-external'
      - '--prometheus-external'
      - '--state-cache-size'
      - '0' 

Thread 'tokio-runtime-worker' panicked at 'Digest item must match that calculated.', /home/astar-admin/.cargo/git/checkouts/substrate-7e08433d4c370a21/174735e/frame/executive/src/lib.rs:482

2022-05-18 15:30:49 [Parachain] Block prepare storage changes error: Error at calling runtime api: Execution failed: Runtime panicked: Digest item must match that calculated.    
2022-05-18 15:30:49 [Parachain] 💔 Error importing block 0x3d14d5f2ce299f83d2d7619b007c9a8c62669ce79e19988be0bdb878b6c663ce: consensus error: Import failed: Error at calling runtime api: Execution failed: Runtime panicked: Digest item must match that calculated.    
2022-05-18 15:30:49 [Parachain] 💔 Error importing block 0xe562d67d6fdd060f9d7bd3eb7926752592fe52797f1b741d9a942ca4b402b1f7: block has an unknown parent    
2022-05-18 15:30:49 [Parachain] 💔 Error importing block 0xade585750400023d45ab90dc68e18c880edb3aa8ca4a76c4ccefa454201304d1: block has an unknown parent    
2022-05-18 15:30:49 [Parachain] 💔 Error importing block 0x40c8678f5ba685d3b3a56fef008b6657e12368a46261b19ca21e632c0734f178: block has an unknown parent    
2022-05-18 15:30:49 [Parachain] 💔 Error importing block 0xa4243c66394c0eb881fc668441a5961b627a8043d1e22383f38436acc2a9296c: block has an unknown parent    
2022-05-18 15:30:49 [Parachain] 💔 Error importing block 0xda4630b5436db3a4f3275400312326375eb4d1e33a5cecf0916b20324ac1fec7: block has an unknown parent    

Version: 3.25.0-ecdca1c-x86_64-linux-gnu

   0: sp_panic_handler::set::{{closure}}
   1: std::panicking::rust_panic_with_hook
             at /rustc/db9d361a4731ca0bb48533fab6297a8fea75696f/library/std/src/panicking.rs:610:17
   2: std::panicking::begin_panic_handler::{{closure}}
             at /rustc/db9d361a4731ca0bb48533fab6297a8fea75696f/library/std/src/panicking.rs:500:13
   3: std::sys_common::backtrace::__rust_end_short_backtrace
             at /rustc/db9d361a4731ca0bb48533fab6297a8fea75696f/library/std/src/sys_common/backtrace.rs:139:18
   4: rust_begin_unwind
             at /rustc/db9d361a4731ca0bb48533fab6297a8fea75696f/library/std/src/panicking.rs:498:5
   5: core::panicking::panic_fmt
             at /rustc/db9d361a4731ca0bb48533fab6297a8fea75696f/library/core/src/panicking.rs:107:14
   6: <astar_runtime::Runtime as sp_api::runtime_decl_for_Core::Core<sp_runtime::generic::block::Block<sp_runtime::generic::header::Header<u32,sp_runtime::traits::BlakeTwo256>,fp_self_contained::unchecked_extrinsic::UncheckedExtrinsic<sp_runtime::multiaddress::MultiAddress<<<sp_runtime::MultiSignature as sp_runtime::traits::Verify>::Signer as sp_runtime::traits::IdentifyAccount>::AccountId,()>,astar_runtime::Call,sp_runtime::MultiSignature,(frame_system::extensions::check_spec_version::CheckSpecVersion<astar_runtime::Runtime>,frame_system::extensions::check_tx_version::CheckTxVersion<astar_runtime::Runtime>,frame_system::extensions::check_genesis::CheckGenesis<astar_runtime::Runtime>,frame_system::extensions::check_mortality::CheckMortality<astar_runtime::Runtime>,frame_system::extensions::check_nonce::CheckNonce<astar_runtime::Runtime>,frame_system::extensions::check_weight::CheckWeight<astar_runtime::Runtime>,pallet_transaction_payment::ChargeTransactionPayment<astar_runtime::Runtime>)>>>>::execute_block
   7: sp_api::runtime_decl_for_Core::execute_block_native_call_generator::{{closure}}
   8: sc_executor::native_executor::WasmExecutor<H>::with_instance::{{closure}}
   9: sp_state_machine::execution::StateMachine<B,H,Exec>::execute_aux
  10: <astar_runtime::RuntimeApiImpl<__SR_API_BLOCK__,RuntimeApiImplCall> as sp_api::Core<__SR_API_BLOCK__>>::Core_execute_block_runtime_api_impl
  11: <core::future::from_generator::GenFuture<T> as core::future::future::Future>::poll
  12: <core::future::from_generator::GenFuture<T> as core::future::future::Future>::poll
  13: <core::future::from_generator::GenFuture<T> as core::future::future::Future>::poll
  14: <core::future::from_generator::GenFuture<T> as core::future::future::Future>::poll
  15: <core::future::from_generator::GenFuture<T> as core::future::future::Future>::poll
  16: sc_consensus::import_queue::basic_queue::BlockImportWorker<B>::new::{{closure}}
  17: <core::future::from_generator::GenFuture<T> as core::future::future::Future>::poll
  18: <futures_util::future::future::Map<Fut,F> as core::future::future::Future>::poll
  19: <tracing_futures::Instrumented<T> as core::future::future::Future>::poll
  20: tokio::runtime::task::raw::poll
  21: std::sys_common::backtrace::__rust_begin_short_backtrace
  22: core::ops::function::FnOnce::call_once{{vtable.shim}}
  23: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once
             at /rustc/db9d361a4731ca0bb48533fab6297a8fea75696f/library/alloc/src/boxed.rs:1694:9
      <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once
             at /rustc/db9d361a4731ca0bb48533fab6297a8fea75696f/library/alloc/src/boxed.rs:1694:9
      std::sys::unix::thread::Thread::new::thread_start
             at /rustc/db9d361a4731ca0bb48533fab6297a8fea75696f/library/std/src/sys/unix/thread.rs:108:17
  24: start_thread
  25: clone
@ashWhiteHat
Copy link

ashWhiteHat commented Jun 16, 2022 •
edited
Loading

My Shibuya node stopped at block #1633644

[ec2-user@ip-10-0-4-115 artree-api-demo]$ docker-compose -f docker-node.yml up
Starting astar ... done
Attaching to astar
astar    | 2022-06-16 10:13:55 Astar Collator
astar    | 2022-06-16 10:13:55 ✌️  version 3.31.0-b3e7be3-x86_64-linux-gnu
astar    | 2022-06-16 10:13:55 ❤️  by Stake Technologies <devops@stake.co.jp>, 2019-2022
astar    | 2022-06-16 10:13:55 📋 Chain specification: Shibuya Testnet
astar    | 2022-06-16 10:13:55 🏷  Node name: artree
astar    | 2022-06-16 10:13:55 👤 Role: FULL
astar    | 2022-06-16 10:13:55 💾 Database: RocksDb at /data/chains/shibuya/db/full
astar    | 2022-06-16 10:13:55 ⛓  Native runtime: shibuya-52 (shibuya-0.tx2.au1)
astar    | 2022-06-16 10:13:55 Parachain id: Id(2007)
astar    | 2022-06-16 10:13:55 Parachain Account: 5Ec4AhPWLk3F66UZSgFGwVVWkCB35rrC3RPBs3BySbjzB588
astar    | 2022-06-16 10:13:55 Parachain genesis state: 0x0000000000000000000000000000000000000000000000000000000000000000005573e7afb9b20990e6d69d28e5d21e921130163f323b2552b8050230e716d4b303170a2e7597b7b7e3d84c05391d139a62b157e78786d8c082f29dcf4c11131400
astar    | 2022-06-16 10:13:55 Is collating: no
astar    | 2022-06-16 10:14:08 [Relaychain] 🏷  Local node identity is: 12D3KooWFsp8VzagyEh7YXxqURzBrK9GVWXeGdRaPskNscx6uaTu
astar    | 2022-06-16 10:14:08 [Relaychain] 📦 Highest known block at #487804
astar    | 2022-06-16 10:14:08 [Relaychain] 〽️ Prometheus exporter started at 127.0.0.1:9616
astar    | 2022-06-16 10:14:08 [Relaychain] Listening for new connections on 127.0.0.1:9945.
astar    | 2022-06-16 10:14:08 [Relaychain] 🥩 run BEEFY worker, best grandpa: #487800.
astar    | 2022-06-16 10:14:08 [Parachain] 🏷  Local node identity is: 12D3KooWC76pzvMkEFz1beZVd14wEhsXqggkEHcnP7RBtENAbBY2
astar    | 2022-06-16 10:14:08 [Parachain] 📦 Highest known block at #1633644
astar    | 2022-06-16 10:14:08 [Parachain] 〽️ Prometheus exporter started at 127.0.0.1:9615
astar    | 2022-06-16 10:14:08 [Parachain] Listening for new connections on 0.0.0.0:9944.
astar    | 2022-06-16 10:14:09 [Parachain] 🔍 Discovered new external address for our node: /ip4/52.197.236.147/tcp/30333/ws/p2p/12D3KooWC76pzvMkEFz1beZVd14wEhsXqggkEHcnP7RBtENAbBY2
astar    | 2022-06-16 10:14:09 [Relaychain] 🔍 Discovered new external address for our node: /ip4/52.197.236.147/tcp/30334/ws/p2p/12D3KooWFsp8VzagyEh7YXxqURzBrK9GVWXeGdRaPskNscx6uaTu
astar    | 2022-06-16 10:14:10 [Relaychain] ✨ Imported #487805 (0xa4d8…0c21)
astar    | 2022-06-16 10:14:10 [Relaychain] ✨ Imported #487806 (0xddbe…f689)
astar    | 2022-06-16 10:14:10 [Relaychain] ✨ Imported #487807 (0x4bbd…be65)
astar    | 2022-06-16 10:14:13 [Relaychain] 💤 Idle (0 peers), best: #487807 (0x4bbd…be65), finalized #487800 (0xbb96…9589), ⬇ 9.3kiB/s ⬆ 1.6kiB/s
astar    | 2022-06-16 10:14:13 [Parachain] 💤 Idle (0 peers), best: #1633644 (0xbb9d…a460), finalized #0 (0xddb8…7019), ⬇ 3.9kiB/s ⬆ 1.9kiB/s
astar    | 2022-06-16 10:14:17 [Relaychain] ✨ Imported #487808 (0xcba7…b08a)
astar    | 2022-06-16 10:14:18 [Relaychain] 💤 Idle (0 peers), best: #487808 (0xcba7…b08a), finalized #487800 (0xbb96…9589), ⬇ 6.1kiB/s ⬆ 1.1kiB/s
astar    | 2022-06-16 10:14:18 [Parachain] 💤 Idle (1 peers), best: #1633644 (0xbb9d…a460), finalized #0 (0xddb8…7019), ⬇ 13.1kiB/s ⬆ 83.3kiB/s
astar    | 2022-06-16 10:14:23 [Relaychain] 💤 Idle (0 peers), best: #487808 (0xcba7…b08a), finalized #487800 (0xbb96…9589), ⬇ 5.6kiB/s ⬆ 0.5kiB/s
astar    | 2022-06-16 10:14:24 [Parachain] 💤 Idle (1 peers), best: #1633644 (0xbb9d…a460), finalized #0 (0xddb8…7019), ⬇ 4.6kiB/s ⬆ 438.0kiB/s
astar    | DigestItem: given=DigestItem::Consensus([102, 114, 111, 110], [1, 8, 5, 44, 74, 137, 55, 134, 223, 102, 150, 125, 54, 221, 214, 159, 153, 39, 51, 31, 12, 130, 210, 248, 239, 83, 16, 174, 77, 223, 125, 67, 128, 4, 114, 190, 215, 9, 30, 238, 7, 212, 89, 118, 84, 201, 15, 89, 48, 113, 63, 176, 65, 29, 240, 9, 247, 200, 134, 213, 245, 220, 213, 0, 82, 206]), expected=DigestItem::Consensus([102, 114, 111, 110], [1, 135, 11, 8, 211, 99, 176, 180, 140, 104, 247, 238, 191, 61, 78, 7, 214, 163, 49, 26, 138, 21, 246, 20, 97, 242, 116, 68, 10, 175, 85, 225, 182, 4, 114, 190, 215, 9, 30, 238, 7, 212, 89, 118, 84, 201, 15, 89, 48, 113, 63, 176, 65, 29, 240, 9, 247, 200, 134, 213, 245, 220, 213, 0, 82, 206])
astar    |
astar    | ====================
astar    |
astar    | Version: 3.31.0-b3e7be3-x86_64-linux-gnu
astar    |
astar    |    0: sp_panic_handler::set::{{closure}}
astar    |    1: std::panicking::rust_panic_with_hook
astar    |              at rustc/db9d361a4731ca0bb48533fab6297a8fea75696f/library/std/src/panicking.rs:610:17
astar    |    2: std::panicking::begin_panic_handler::{{closure}}
astar    |              at rustc/db9d361a4731ca0bb48533fab6297a8fea75696f/library/std/src/panicking.rs:500:13
astar    |    3: std::sys_common::backtrace::__rust_end_short_backtrace
astar    |              at rustc/db9d361a4731ca0bb48533fab6297a8fea75696f/library/std/src/sys_common/backtrace.rs:139:18
astar    |    4: rust_begin_unwind
astar    |              at rustc/db9d361a4731ca0bb48533fab6297a8fea75696f/library/std/src/panicking.rs:498:5
astar    |    5: core::panicking::panic_fmt
astar    |              at rustc/db9d361a4731ca0bb48533fab6297a8fea75696f/library/core/src/panicking.rs:107:14
astar    |    6: <shibuya_runtime::Runtime as sp_api::runtime_decl_for_Core::Core<sp_runtime::generic::block::Block<sp_runtime::generic::header::Header<u32,sp_runtime::traits::BlakeTwo256>,fp_self_contained::unchecked_extrinsic::UncheckedExtrinsic<sp_runtime::multiaddress::MultiAddress<<<sp_runtime::MultiSignature as sp_runtime::traits::Verify>::Signer as sp_runtime::traits::IdentifyAccount>::AccountId,()>,shibuya_runtime::Call,sp_runtime::MultiSignature,(frame_system::extensions::check_spec_version::CheckSpecVersion<shibuya_runtime::Runtime>,frame_system::extensions::check_tx_version::CheckTxVersion<shibuya_runtime::Runtime>,frame_system::extensions::check_genesis::CheckGenesis<shibuya_runtime::Runtime>,frame_system::extensions::check_mortality::CheckMortality<shibuya_runtime::Runtime>,frame_system::extensions::check_nonce::CheckNonce<shibuya_runtime::Runtime>,frame_system::extensions::check_weight::CheckWeight<shibuya_runtime::Runtime>,pallet_transaction_payment::ChargeTransactionPayment<shibuya_runtime::Runtime>)>>>>::execute_block
astar    |    7: sp_api::runtime_decl_for_Core::execute_block_native_call_generator::{{closure}}
astar    |    8: sc_executor::native_executor::WasmExecutor<H>::with_instance::{{closure}}
astar    |    9: sp_state_machine::execution::StateMachine<B,H,Exec>::execute_aux
astar    |   10: <shibuya_runtime::RuntimeApiImpl<__SR_API_BLOCK__,RuntimeApiImplCall> as sp_api::Core<__SR_API_BLOCK__>>::Core_execute_block_runtime_api_impl
astar    |   11: <core::future::from_generator::GenFuture<T> as core::future::future::Future>::poll
astar    |   12: <core::future::from_generator::GenFuture<T> as core::future::future::Future>::poll
astar    |   13: <core::future::from_generator::GenFuture<T> as core::future::future::Future>::poll
astar    |   14: <core::future::from_generator::GenFuture<T> as core::future::future::Future>::poll
astar    |   15: <core::future::from_generator::GenFuture<T> as core::future::future::Future>::poll
astar    |   16: sc_consensus::import_queue::basic_queue::BlockImportWorker<B>::new::{{closure}}
astar    |   17: <core::future::from_generator::GenFuture<T> as core::future::future::Future>::poll
astar    |   18: <futures_util::future::future::Map<Fut,F> as core::future::future::Future>::poll
astar    |   19: <tracing_futures::Instrumented<T> as core::future::future::Future>::poll
astar    |   20: tokio::runtime::task::raw::poll
astar    |   21: std::sys_common::backtrace::__rust_begin_short_backtrace
astar    |   22: core::ops::function::FnOnce::call_once{{vtable.shim}}
astar    |   23: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once
astar    |              at rustc/db9d361a4731ca0bb48533fab6297a8fea75696f/library/alloc/src/boxed.rs:1694:9
astar    |       <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once
astar    |              at rustc/db9d361a4731ca0bb48533fab6297a8fea75696f/library/alloc/src/boxed.rs:1694:9
astar    |       std::sys::unix::thread::Thread::new::thread_start
astar    |              at rustc/db9d361a4731ca0bb48533fab6297a8fea75696f/library/std/src/sys/unix/thread.rs:108:17
astar    |   24: start_thread
astar    |   25: clone
astar    |
astar    |
astar    | Thread 'tokio-runtime-worker' panicked at 'Digest item must match that calculated.', /home/astar-admin/.cargo/git/checkouts/substrate-7e08433d4c370a21/174735e/frame/executive/src/lib.rs:482
astar    |
astar    | This is a bug. Please report it at:
astar    |
astar    | 	https://github.com/AstarNetwork/Astar/issues/new

With command astar-collator --chain shibuya --name test --execution Native --pool-limit 65536 --base-path /data --rpc-cors=all --unsafe-rpc-external --ws-external --state-cache-size 1

@ashWhiteHat
Copy link

ashWhiteHat commented Jun 16, 2022 •
edited
Loading

Related Issues

#503
#542
#624

It seems wiping DB worked.
#542 (comment)

I wiped the DB and started to sync again.
Will report whether it works.

@ashWhiteHat
Copy link

It didn't change.
The syncing was stopped at same block #1633644.

@ashWhiteHat ashWhiteHat added the bug Something isn't working label Jun 17, 2022
@ashWhiteHat
Copy link

Replacing --execution Native with --execution Wasm works for me.

@github-actions
Copy link

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 7 days.

@github-actions github-actions bot added the Stale label Jul 18, 2022
@github-actions
Copy link

This issue was closed because it has been stalled for 7 days with no activity.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working Stale
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@kadubarral @ashWhiteHat