API tools faq
paste
Advertisement
iron-from-sf

juno bug after update

iron-from-sf
Mar 29th, 2024
46
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 316.99 KB | Cryptocurrency | 0 0
raw download clone embed print report
  1. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: 2:12PM INF client state updated client-id=07-tendermint-0 heights=[{"revision_height":14567545,"revision_number":1}] module=x/ibc/client
  2. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: SIGABRT: abort
  3. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: PC=0x2d20401 m=14 sigcode=18446744073709551610
  4. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: signal arrived during cgo execution
  5. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 1079 [syscall]:
  6. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.cgocall(0x22a49a0, 0xc00347bb50)
  7. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/cgocall.go:157 +0x4b fp=0xc00347bb28 sp=0xc00347baf0 pc=0x456f4b
  8. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmvm/internal/api._C2func_execute(0x7fa7a1610830, {0x0, 0xc20a7bc040, 0x20}, {0x0, 0xc0822f01a0, 0xc1}, {0x0, 0xc0f7465260, 0x57}, ...)
  9. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: _cgo_gotypes.go:315 +0x71 fp=0xc00347bb50 sp=0xc00347bb28 pc=0x1349f11
  10. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmvm/internal/api.Execute.func1({0x2f03820?}, {0x40?, 0xc20a7bc040?, 0xc02b7e9a20?}, {0x58?, 0xc0822f01a0?, 0x1?}, {0x0, 0xc0f7465260, 0x57}, ...)
  11. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmvm@v1.5.2/internal/api/lib.go:235 +0x238 fp=0xc00347bce0 sp=0xc00347bb50 pc=0x1352c58
  12. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmvm/internal/api.Execute({0x40291a0?}, {0xc20a7bc040?, 0x3fe0058?, 0xc08a97b6e0?}, {0xc0822f01a0?, 0xc00347c100?, 0x4600c5?}, {0xc0f7465260, 0x57, 0x60}, ...)
  13. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmvm@v1.5.2/internal/api/lib.go:235 +0x6b3 fp=0xc00347c018 sp=0xc00347bce0 pc=0x1352613
  14. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmvm.(*VM).Execute(0xc006c2f5b0, {0xc20a7bc040, 0x20, 0x20}, {{0xe5db66, 0x17c141ab1b18fe4f, {0xc10be68ab2, 0x6}}, 0xc20848cd10, {{0xc0652a2780, ...}}}, ...)
  15. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmvm@v1.5.2/lib.go:181 +0x276 fp=0xc00347c148 sp=0xc00347c018 pc=0x135c9b6
  16. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/keeper.Keeper.execute({{0x3ff5bf0, 0xc006bbb790}, {0x40389b0, 0xc0061010a0}, {0x3ffa960, 0xc006107cc0}, {0x3feb280, 0xc006c2f5e0}, {0x3feb140, 0xc006bd6dc0}, ...}, ...)
  17. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd@v0.45.0/x/wasm/keeper/keeper.go:392 +0xba2 fp=0xc00347dc00 sp=0xc00347c148 pc=0x1ed7002
  18. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/keeper.msgServer.ExecuteContract({0x45e0da?}, {0x4016b98, 0xc2242c6db0}, 0xc065230960)
  19. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd@v0.45.0/x/wasm/keeper/msg_server.go:128 +0x1eb fp=0xc00347e418 sp=0xc00347dc00 pc=0x1ee99cb
  20. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/keeper.(*msgServer).ExecuteContract(0x45dba5?, {0x4016b98?, 0xc2242c6db0?}, 0x32ec1c0?)
  21. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: <autogenerated>:1 +0x2e fp=0xc00347e448 sp=0xc00347e418 pc=0x1f0414e
  22. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/types._Msg_ExecuteContract_Handler.func1({0x4016b98, 0xc2242c6db0}, {0x327ada0?, 0xc065230960})
  23. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd@v0.45.0/x/wasm/types/tx.pb.go:2263 +0x72 fp=0xc00347e488 sp=0xc00347e448 pc=0x15a7a52
  24. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk/baseapp.(*MsgServiceRouter).RegisterService.func2.1({0x4016a80, 0xc0652a6dc0}, {0xc00347e520?, 0x45dba5?}, 0x2a0?, 0xc065274558)
  25. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/baseapp/msg_service_router.go:118 +0x93 fp=0xc00347e4d8 sp=0xc00347e488 pc=0x120d853
  26. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/types._Msg_ExecuteContract_Handler({0x3239e80?, 0xc001511f30}, {0x4016a80, 0xc0652a6dc0}, 0x3adbe18, 0xc0651f9640)
  27. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd@v0.45.0/x/wasm/types/tx.pb.go:2265 +0x135 fp=0xc00347e530 sp=0xc00347e4d8 pc=0x15a7935
  28. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk/baseapp.(*MsgServiceRouter).RegisterService.func2({{0x4016b98, 0xc220776cf0}, {0x402d090, 0xc06528fc40}, {{0xb, 0x0}, {0xc10be68ab2, 0x6}, 0xe5db66, {0x1f6e7e4f, ...}, ...}, ...}, ...)
  29. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/baseapp/msg_service_router.go:139 +0x343 fp=0xc00347f058 sp=0xc00347e530 pc=0x120d5e3
  30. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/keeper.SDKMessageHandler.handleSdkMessage({{_, _}, {_, _}}, {{0x4016b98, 0xc220776cf0}, {0x402d090, 0xc06528fc40}, {{0xb, 0x0}, ...}, ...}, ...)
  31. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd@v0.45.0/x/wasm/keeper/handler_plugin.go:103 +0x228 fp=0xc00347f360 sp=0xc00347f058 pc=0x1eceba8
  32. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/keeper.SDKMessageHandler.DispatchMsg({{_, _}, {_, _}}, {{0x4016b98, 0xc220776cf0}, {0x402d090, 0xc06528fc40}, {{0xb, 0x0}, ...}, ...}, ...)
  33. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd@v0.45.0/x/wasm/keeper/handler_plugin.go:73 +0x2d2 fp=0xc00347f760 sp=0xc00347f360 pc=0x1ece632
  34. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/keeper.(*SDKMessageHandler).DispatchMsg(_, {{0x4016b98, 0xc220776cf0}, {0x402d090, 0xc06528fc40}, {{0xb, 0x0}, {0xc10be68ab2, 0x6}, 0xe5db66, ...}, ...}, ...)
  35. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: <autogenerated>:1 +0xbf fp=0xc00347faa8 sp=0xc00347f760 pc=0x1f022df
  36. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/keeper.MessageHandlerChain.DispatchMsg({{_, _, _}}, {{0x4016b98, 0xc220776cf0}, {0x402d090, 0xc06528fc40}, {{0xb, 0x0}, {0xc10be68ab2, ...}, ...}, ...}, ...)
  37. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd@v0.45.0/x/wasm/keeper/handler_plugin.go:135 +0x12d fp=0xc00347fe30 sp=0xc00347faa8 pc=0x1ecef4d
  38. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/keeper.(*MessageHandlerChain).DispatchMsg(_, {{0x4016b98, 0xc220776cf0}, {0x402d090, 0xc06528fc40}, {{0xb, 0x0}, {0xc10be68ab2, 0x6}, 0xe5db66, ...}, ...}, ...)
  39. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: <autogenerated>:1 +0xb0 fp=0xc003480170 sp=0xc00347fe30 pc=0x1f02810
  40. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmosContracts/juno/v21/x/tokenfactory/bindings.(*CustomMessenger).DispatchMsg(_, {{0x4016b98, 0xc220776cf0}, {0x402d090, 0xc06528fc40}, {{0xb, 0x0}, {0xc10be68ab2, 0x6}, 0xe5db66, ...}, ...}, ...)
  41. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmosContracts/juno/v21/x/tokenfactory/bindings/message_plugin.go:68 +0x1a2 fp=0xc0034804a8 sp=0xc003480170 pc=0x2231782
  42. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/keeper.MessageHandlerChain.DispatchMsg({{_, _, _}}, {{0x4016b98, 0xc220776cf0}, {0x402d090, 0xc06528fc40}, {{0xb, 0x0}, {0xc10be68ab2, ...}, ...}, ...}, ...)
  43. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd@v0.45.0/x/wasm/keeper/handler_plugin.go:135 +0x12d fp=0xc003480830 sp=0xc0034804a8 pc=0x1ecef4d
  44. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/keeper.(*MessageHandlerChain).DispatchMsg(_, {{0x4016b98, 0xc220776cf0}, {0x402d090, 0xc06528fc40}, {{0xb, 0x0}, {0xc10be68ab2, 0x6}, 0xe5db66, ...}, ...}, ...)
  45. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: <autogenerated>:1 +0xb0 fp=0xc003480b70 sp=0xc003480830 pc=0x1f02810
  46. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/keeper.MessageDispatcher.DispatchSubmessages({{_, _}, {_, _}}, {{0x4016b98, 0xc220776cf0}, {0x402d090, 0xc0651a8f80}, {{0xb, 0x0}, ...}, ...}, ...)
  47. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd@v0.45.0/x/wasm/keeper/msg_dispatcher.go:106 +0x4a9 fp=0xc003482348 sp=0xc003480b70 pc=0x1ee7b69
  48. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/keeper.(*MessageDispatcher).DispatchSubmessages(_, {{0x4016b98, 0xc220776cf0}, {0x402d090, 0xc0651a8f80}, {{0xb, 0x0}, {0xc10be68ab2, 0x6}, 0xe5db66, ...}, ...}, ...)
  49. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: <autogenerated>:1 +0xbc fp=0xc003482658 sp=0xc003482348 pc=0x1f03f3c
  50. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/keeper.DefaultWasmVMContractResponseHandler.Handle({{_, _}}, {{0x4016b98, 0xc220776cf0}, {0x402d090, 0xc0651a8f80}, {{0xb, 0x0}, {0xc10be68ab2, 0x6}, ...}, ...}, ...)
  51. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd@v0.45.0/x/wasm/keeper/keeper.go:1245 +0xa2 fp=0xc003482950 sp=0xc003482658 pc=0x1ee5202
  52. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/keeper.(*DefaultWasmVMContractResponseHandler).Handle(_, {{0x4016b98, 0xc220776cf0}, {0x402d090, 0xc0651a8f80}, {{0xb, 0x0}, {0xc10be68ab2, 0x6}, 0xe5db66, ...}, ...}, ...)
  53. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: <autogenerated>:1 +0xd8 fp=0xc003482c68 sp=0xc003482950 pc=0x1f03bf8
  54. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/keeper.(*Keeper).handleContractResponse(_, {{0x4016b98, 0xc220776cf0}, {0x402d090, 0xc0651a8f80}, {{0xb, 0x0}, {0xc10be68ab2, 0x6}, 0xe5db66, ...}, ...}, ...)
  55. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd@v0.45.0/x/wasm/keeper/keeper.go:1034 +0x4a5 fp=0xc0034837c8 sp=0xc003482c68 pc=0x1ee3705
  56. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/keeper.Keeper.execute({{0x3ff5bf0, 0xc006bbb790}, {0x40389b0, 0xc0061010a0}, {0x3ffa960, 0xc006107cc0}, {0x3feb280, 0xc006c2f5e0}, {0x3feb140, 0xc006bd6dc0}, ...}, ...)
  57. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd@v0.45.0/x/wasm/keeper/keeper.go:403 +0x1105 fp=0xc003485280 sp=0xc0034837c8 pc=0x1ed7565
  58. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/keeper.msgServer.ExecuteContract({0x45e0da?}, {0x4016b98, 0xc20d604ab0}, 0xc0651a3360)
  59. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd@v0.45.0/x/wasm/keeper/msg_server.go:128 +0x1eb fp=0xc003485a98 sp=0xc003485280 pc=0x1ee99cb
  60. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/keeper.(*msgServer).ExecuteContract(0x45dba5?, {0x4016b98?, 0xc20d604ab0?}, 0x32ec1c0?)
  61. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: <autogenerated>:1 +0x2e fp=0xc003485ac8 sp=0xc003485a98 pc=0x1f0414e
  62. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/types._Msg_ExecuteContract_Handler.func1({0x4016b98, 0xc20d604ab0}, {0x327ada0?, 0xc0651a3360})
  63. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd@v0.45.0/x/wasm/types/tx.pb.go:2263 +0x72 fp=0xc003485b08 sp=0xc003485ac8 pc=0x15a7a52
  64. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk/baseapp.(*MsgServiceRouter).RegisterService.func2.1({0x4016a80, 0xc0651b4b00}, {0xc003485ba0?, 0x45dba5?}, 0x2a0?, 0xc06514bbc0)
  65. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/baseapp/msg_service_router.go:118 +0x93 fp=0xc003485b58 sp=0xc003485b08 pc=0x120d853
  66. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd/x/wasm/types._Msg_ExecuteContract_Handler({0x3239e80?, 0xc001511f30}, {0x4016a80, 0xc0651b4b00}, 0x3adbe18, 0xc06519bac0)
  67. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmWasm/wasmd@v0.45.0/x/wasm/types/tx.pb.go:2265 +0x135 fp=0xc003485bb0 sp=0xc003485b58 pc=0x15a7935
  68. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk/baseapp.(*MsgServiceRouter).RegisterService.func2({{0x4016b98, 0xc220776cf0}, {0x402d090, 0xc0651a8f80}, {{0xb, 0x0}, {0xc10be68ab2, 0x6}, 0xe5db66, {0x1f6e7e4f, ...}, ...}, ...}, ...)
  69. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/baseapp/msg_service_router.go:139 +0x343 fp=0xc0034866d8 sp=0xc003485bb0 pc=0x120d5e3
  70. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk/baseapp.(*BaseApp).runMsgs(_, {{0x4016b98, 0xc220776cf0}, {0x402d090, 0xc0651a8f80}, {{0xb, 0x0}, {0xc10be68ab2, 0x6}, 0xe5db66, ...}, ...}, ...)
  71. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/baseapp/baseapp.go:806 +0x271 fp=0xc003486c40 sp=0xc0034866d8 pc=0x1209f31
  72. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk/baseapp.(*BaseApp).runTx(0xc0015390e0, 0x3, {0xc02b7e9a20, 0x158, 0x158})
  73. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/baseapp/baseapp.go:749 +0xe65 fp=0xc003489e58 sp=0xc003486c40 pc=0x1208fe5
  74. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk/baseapp.(*BaseApp).DeliverTx(0xc0015390e0, {{0xc02b7e9a20?, 0x461227?, 0xc060b12240?}})
  75. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/baseapp/abci.go:413 +0x178 fp=0xc00348a0a8 sp=0xc003489e58 pc=0x1200258
  76. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmosContracts/juno/v21/app.(*App).DeliverTx(0x20?, {{0xc02b7e9a20?, 0x60?, 0x7fa78c4ca6e8?}})
  77. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: <autogenerated>:1 +0x68 fp=0xc00348a1c8 sp=0xc00348a0a8 pc=0x22847a8
  78. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/abci/client.(*localClient).DeliverTxAsync(0xc00ba83e00, {{0xc02b7e9a20?, 0x0?, 0x0?}})
  79. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/abci/client/local_client.go:82 +0xf9 fp=0xc00348a350 sp=0xc00348a1c8 pc=0x101ce79
  80. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/proxy.(*appConnConsensus).DeliverTxAsync(0xc000736438, {{0xc02b7e9a20?, 0x20?, 0xb?}})
  81. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/proxy/app_conn.go:106 +0x162 fp=0xc00348a3f0 sp=0xc00348a350 pc=0x1024de2
  82. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/state.execBlockOnProxyApp({0x4016d20?, 0xc00e074020}, {0x4029ce0, 0xc000736438}, 0xc0fccdc960, {0x402daa8, 0xc00e06f158}, 0xe5db65?)
  83. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/state/execution.go:376 +0x6b6 fp=0xc00348a818 sp=0xc00348a3f0 pc=0x102bdf6
  84. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/state.(*BlockExecutor).ApplyBlock(_, {{{0xb, 0x0}, {0xc00db43520, 0x8}}, {0xc00db43528, 0x6}, 0x3f1e54, 0xe5db65, {{0xc243793740, ...}, ...}, ...}, ...)
  85. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/state/execution.go:197 +0x165 fp=0xc00348ace8 sp=0xc00348a818 pc=0x102a465
  86. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*State).finalizeCommit(0xc00e1b0000, 0xe5db66)
  87. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/state.go:1710 +0xa65 fp=0xc00348b5f8 sp=0xc00348ace8 pc=0x10a79c5
  88. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*State).tryFinalizeCommit(0xc00e1b0000, 0xe5db66)
  89. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/state.go:1619 +0x2f6 fp=0xc00348b6f8 sp=0xc00348b5f8 pc=0x10a6e76
  90. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*State).enterCommit.func1()
  91. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/state.go:1554 +0x9c fp=0xc00348b730 sp=0xc00348b6f8 pc=0x10a6b5c
  92. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*State).enterCommit(0xc00e1b0000, 0xe5db66, 0x0)
  93. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/state.go:1592 +0xc5b fp=0xc00348b8b0 sp=0xc00348b730 pc=0x10a6a5b
  94. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*State).addVote(0xc00e1b0000, 0xc0e73ecbe0, {0xc20aaae5d0, 0x28})
  95. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/state.go:2223 +0x18ed fp=0xc00348bb60 sp=0xc00348b8b0 pc=0x10abd8d
  96. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*State).tryAddVote(0xc00e1b0000, 0xc0e73ecbe0, {0xc20aaae5d0?, 0xc00348bc08?})
  97. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/state.go:2012 +0x26 fp=0xc00348bbc8 sp=0xc00348bb60 pc=0x10aa006
  98. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*State).handleMsg(0xc00e1b0000, {{0x3ff09c0, 0xc0437b2720}, {0xc20aaae5d0, 0x28}})
  99. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/state.go:865 +0x3ce fp=0xc00348bc98 sp=0xc00348bbc8 pc=0x109f68e
  100. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*State).receiveRoutine(0xc00e1b0000, 0x0)
  101. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/state.go:772 +0x3d1 fp=0xc00348bfc0 sp=0xc00348bc98 pc=0x109ed91
  102. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*State).OnStart.func1()
  103. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/state.go:383 +0x25 fp=0xc00348bfe0 sp=0xc00348bfc0 pc=0x109cb25
  104. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  105. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00348bfe8 sp=0xc00348bfe0 pc=0x4c16a1
  106. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*State).OnStart in goroutine 166
  107. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/state.go:383 +0x10c
  108. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 1 [chan receive, 119 minutes]:
  109. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc001ce5530?, 0x7c4a25?, 0x1?, 0xcc?, 0xc001ce55a8?)
  110. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc001ce5518 sp=0xc001ce54f8 pc=0x48df0e
  111. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.chanrecv(0xc001501980, 0xc001ce55e0, 0x1)
  112. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/chan.go:583 +0x3cd fp=0xc001ce5590 sp=0xc001ce5518 pc=0x45956d
  113. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.chanrecv1(0xc001501980?, 0xc001ce55f0?)
  114. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/chan.go:442 +0x12 fp=0xc001ce55b8 sp=0xc001ce5590 pc=0x459172
  115. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk/server.WaitForQuitSignals()
  116. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/server/util.go:391 +0x86 fp=0xc001ce5620 sp=0xc001ce55b8 pc=0x1342006
  117. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk/server.wrapCPUProfile(0xc000a73c60, 0xc000f1dd00)
  118. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/server/start.go:627 +0x2f2 fp=0xc001ce5708 sp=0xc001ce5620 pc=0x133ee12
  119. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk/server.StartCmd.func2(0xc000e36b00?, {0xc001418360?, 0x0?, 0x3?})
  120. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/server/start.go:152 +0x2c5 fp=0xc001ce5c70 sp=0xc001ce5708 pc=0x133b105
  121. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/spf13/cobra.(*Command).execute(0xc00124cc00, {0xc0014182d0, 0x3, 0x3})
  122. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/spf13/cobra@v1.7.0/command.go:940 +0x87c fp=0xc001ce5da8 sp=0xc001ce5c70 pc=0x81c7fc
  123. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/spf13/cobra.(*Command).ExecuteC(0xc00120ef00)
  124. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc001ce5e60 sp=0xc001ce5da8 pc=0x81d025
  125. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/spf13/cobra.(*Command).Execute(...)
  126. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/spf13/cobra@v1.7.0/command.go:992
  127. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/spf13/cobra.(*Command).ExecuteContext(...)
  128. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/spf13/cobra@v1.7.0/command.go:985
  129. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk/server/cmd.Execute(0xc00101ff30?, {0x32fd566, 0x5}, {0xc000a2e2b0, 0x10})
  130. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/server/cmd/execute.go:33 +0x171 fp=0xc001ce5ed8 sp=0xc001ce5e60 pc=0x1343e51
  131. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: main.main()
  132. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/CosmosContracts/juno/v21/cmd/junod/main.go:18 +0x45 fp=0xc001ce5f40 sp=0xc001ce5ed8 pc=0x22a3fe5
  133. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.main()
  134. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:267 +0x2bb fp=0xc001ce5fe0 sp=0xc001ce5f40 pc=0x48da9b
  135. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  136. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc001ce5fe8 sp=0xc001ce5fe0 pc=0x4c16a1
  137. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2 [force gc (idle), 4 minutes]:
  138. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4e4793037f9?, 0x0?, 0x0?, 0x0?, 0x0?)
  139. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000bcfa8 sp=0xc0000bcf88 pc=0x48df0e
  140. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goparkunlock(...)
  141. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:404
  142. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.forcegchelper()
  143. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:322 +0xb3 fp=0xc0000bcfe0 sp=0xc0000bcfa8 pc=0x48dd73
  144. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  145. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000bcfe8 sp=0xc0000bcfe0 pc=0x4c16a1
  146. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.init.6 in goroutine 1
  147. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:310 +0x1a
  148. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 3 [GC sweep wait]:
  149. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x5a30701?, 0x0?, 0x0?, 0x0?, 0x0?)
  150. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000bd778 sp=0xc0000bd758 pc=0x48df0e
  151. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goparkunlock(...)
  152. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:404
  153. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.bgsweep(0x0?)
  154. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgcsweep.go:321 +0xdf fp=0xc0000bd7c8 sp=0xc0000bd778 pc=0x477fff
  155. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcenable.func1()
  156. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:200 +0x25 fp=0xc0000bd7e0 sp=0xc0000bd7c8 pc=0x46d165
  157. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  158. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000bd7e8 sp=0xc0000bd7e0 pc=0x4c16a1
  159. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcenable in goroutine 1
  160. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:200 +0x66
  161. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 4 [GC scavenge wait]:
  162. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x33c78f?, 0x1ab0b4?, 0x0?, 0x0?, 0x0?)
  163. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000bdf70 sp=0xc0000bdf50 pc=0x48df0e
  164. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goparkunlock(...)
  165. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:404
  166. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.(*scavengerState).park(0x5a39940)
  167. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgcscavenge.go:425 +0x49 fp=0xc0000bdfa0 sp=0xc0000bdf70 pc=0x475889
  168. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.bgscavenge(0x0?)
  169. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgcscavenge.go:658 +0x59 fp=0xc0000bdfc8 sp=0xc0000bdfa0 pc=0x475e39
  170. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcenable.func2()
  171. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:201 +0x25 fp=0xc0000bdfe0 sp=0xc0000bdfc8 pc=0x46d105
  172. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  173. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000bdfe8 sp=0xc0000bdfe0 pc=0x4c16a1
  174. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcenable in goroutine 1
  175. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:201 +0xa5
  176. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 18 [select, 119 minutes]:
  177. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0000bc7b0?, 0x2?, 0x8?, 0x0?, 0xc0000bc78c?)
  178. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000bc620 sp=0xc0000bc600 pc=0x48df0e
  179. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0000bc7b0, 0xc0000bc788, 0x0?, 0x0, 0x101000000000000?, 0x1)
  180. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0000bc740 sp=0xc0000bc620 pc=0x49e3e5
  181. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/desertbit/timer.timerRoutine()
  182. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/desertbit/timer@v0.0.0-20180107155436-c41aec40b27f/timers.go:119 +0xb2 fp=0xc0000bc7e0 sp=0xc0000bc740 pc=0x12efd72
  183. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  184. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000bc7e8 sp=0xc0000bc7e0 pc=0x4c16a1
  185. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/desertbit/timer.init.0 in goroutine 1
  186. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/desertbit/timer@v0.0.0-20180107155436-c41aec40b27f/timers.go:15 +0x1a
  187. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 19 [finalizer wait, 119 minutes]:
  188. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
  189. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000b8620 sp=0xc0000b8600 pc=0x48df0e
  190. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.runfinq()
  191. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mfinal.go:193 +0x107 fp=0xc0000b87e0 sp=0xc0000b8620 pc=0x46c107
  192. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  193. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b87e8 sp=0xc0000b87e0 pc=0x4c16a1
  194. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.createfing in goroutine 1
  195. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mfinal.go:163 +0x3d
  196. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 20 [GC worker (idle)]:
  197. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x5a72ee0?, 0x1?, 0x69?, 0xe1?, 0x0?)
  198. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000b8f50 sp=0xc0000b8f30 pc=0x48df0e
  199. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  200. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0000b8fe0 sp=0xc0000b8f50 pc=0x46ece5
  201. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  202. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b8fe8 sp=0xc0000b8fe0 pc=0x4c16a1
  203. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  204. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  205. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 5 [GC worker (idle)]:
  206. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x5a72ee0?, 0x1?, 0xd0?, 0xf0?, 0x0?)
  207. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000be750 sp=0xc0000be730 pc=0x48df0e
  208. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  209. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0000be7e0 sp=0xc0000be750 pc=0x46ece5
  210. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  211. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000be7e8 sp=0xc0000be7e0 pc=0x4c16a1
  212. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  213. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  214. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 34 [GC worker (idle)]:
  215. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4fd7499c23c?, 0x1?, 0x1e?, 0x96?, 0x0?)
  216. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000488750 sp=0xc000488730 pc=0x48df0e
  217. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  218. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0004887e0 sp=0xc000488750 pc=0x46ece5
  219. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  220. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0004887e8 sp=0xc0004887e0 pc=0x4c16a1
  221. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  222. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  223. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 21 [GC worker (idle)]:
  224. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4fd7828a884?, 0x1?, 0x4?, 0x1?, 0x0?)
  225. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000b9750 sp=0xc0000b9730 pc=0x48df0e
  226. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  227. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0000b97e0 sp=0xc0000b9750 pc=0x46ece5
  228. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  229. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b97e8 sp=0xc0000b97e0 pc=0x4c16a1
  230. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  231. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  232. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 35 [GC worker (idle)]:
  233. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4fd74a3f377?, 0x3?, 0x2a?, 0x19?, 0x0?)
  234. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000488f50 sp=0xc000488f30 pc=0x48df0e
  235. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  236. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc000488fe0 sp=0xc000488f50 pc=0x46ece5
  237. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  238. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc000488fe8 sp=0xc000488fe0 pc=0x4c16a1
  239. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  240. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  241. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 36 [GC worker (idle)]:
  242. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4fd74a3fcbd?, 0x1?, 0x80?, 0x64?, 0x0?)
  243. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000489750 sp=0xc000489730 pc=0x48df0e
  244. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  245. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0004897e0 sp=0xc000489750 pc=0x46ece5
  246. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  247. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0004897e8 sp=0xc0004897e0 pc=0x4c16a1
  248. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  249. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  250. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 22 [GC worker (idle)]:
  251. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4fd749a17d2?, 0x1?, 0x32?, 0xc9?, 0x0?)
  252. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000b9f50 sp=0xc0000b9f30 pc=0x48df0e
  253. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  254. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0000b9fe0 sp=0xc0000b9f50 pc=0x46ece5
  255. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  256. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b9fe8 sp=0xc0000b9fe0 pc=0x4c16a1
  257. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  258. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  259. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 6 [GC worker (idle)]:
  260. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4fd7499f6e9?, 0x3?, 0x0?, 0x98?, 0x0?)
  261. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000bef50 sp=0xc0000bef30 pc=0x48df0e
  262. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  263. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0000befe0 sp=0xc0000bef50 pc=0x46ece5
  264. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  265. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000befe8 sp=0xc0000befe0 pc=0x4c16a1
  266. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  267. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  268. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 23 [GC worker (idle), 4 minutes]:
  269. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x5a72ee0?, 0x3?, 0xd5?, 0xe8?, 0x0?)
  270. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000ba750 sp=0xc0000ba730 pc=0x48df0e
  271. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  272. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0000ba7e0 sp=0xc0000ba750 pc=0x46ece5
  273. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  274. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ba7e8 sp=0xc0000ba7e0 pc=0x4c16a1
  275. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  276. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  277. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 7 [GC worker (idle), 4 minutes]:
  278. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4c887f5fd86?, 0x3?, 0x1f?, 0x4c?, 0x0?)
  279. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000bf750 sp=0xc0000bf730 pc=0x48df0e
  280. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  281. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0000bf7e0 sp=0xc0000bf750 pc=0x46ece5
  282. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  283. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000bf7e8 sp=0xc0000bf7e0 pc=0x4c16a1
  284. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  285. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  286. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 24 [GC worker (idle)]:
  287. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4fd7499b045?, 0x1?, 0x43?, 0x33?, 0x0?)
  288. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000baf50 sp=0xc0000baf30 pc=0x48df0e
  289. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  290. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0000bafe0 sp=0xc0000baf50 pc=0x46ece5
  291. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  292. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000bafe8 sp=0xc0000bafe0 pc=0x4c16a1
  293. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  294. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  295. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 25 [GC worker (idle)]:
  296. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4fd74a3f634?, 0x1?, 0x8c?, 0x3a?, 0x0?)
  297. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000bb750 sp=0xc0000bb730 pc=0x48df0e
  298. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  299. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0000bb7e0 sp=0xc0000bb750 pc=0x46ece5
  300. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  301. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000bb7e8 sp=0xc0000bb7e0 pc=0x4c16a1
  302. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  303. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  304. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 26 [GC worker (idle)]:
  305. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x5a72ee0?, 0x1?, 0x4a?, 0x8d?, 0x0?)
  306. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000bbf50 sp=0xc0000bbf30 pc=0x48df0e
  307. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  308. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0000bbfe0 sp=0xc0000bbf50 pc=0x46ece5
  309. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  310. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000bbfe8 sp=0xc0000bbfe0 pc=0x4c16a1
  311. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  312. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  313. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 27 [GC worker (idle)]:
  314. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4fd787c7db2?, 0x1?, 0x9b?, 0x9d?, 0x0?)
  315. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000484750 sp=0xc000484730 pc=0x48df0e
  316. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  317. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0004847e0 sp=0xc000484750 pc=0x46ece5
  318. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  319. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0004847e8 sp=0xc0004847e0 pc=0x4c16a1
  320. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  321. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  322. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 8 [GC worker (idle), 4 minutes]:
  323. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4c887f5ef97?, 0x3?, 0xa5?, 0xda?, 0x0?)
  324. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000bff50 sp=0xc0000bff30 pc=0x48df0e
  325. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  326. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0000bffe0 sp=0xc0000bff50 pc=0x46ece5
  327. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  328. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000bffe8 sp=0xc0000bffe0 pc=0x4c16a1
  329. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  330. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  331. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 28 [GC worker (idle)]:
  332. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x5a72ee0?, 0x1?, 0x6c?, 0xd2?, 0x0?)
  333. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000484f50 sp=0xc000484f30 pc=0x48df0e
  334. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  335. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc000484fe0 sp=0xc000484f50 pc=0x46ece5
  336. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  337. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc000484fe8 sp=0xc000484fe0 pc=0x4c16a1
  338. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  339. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  340. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 9 [GC worker (idle), 4 minutes]:
  341. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4c887f5f0a6?, 0x1?, 0xcd?, 0x5f?, 0x0?)
  342. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000504750 sp=0xc000504730 pc=0x48df0e
  343. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  344. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0005047e0 sp=0xc000504750 pc=0x46ece5
  345. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  346. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0005047e8 sp=0xc0005047e0 pc=0x4c16a1
  347. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  348. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  349. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 29 [GC worker (idle)]:
  350. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4fd7499c32c?, 0x1?, 0x99?, 0xb6?, 0x0?)
  351. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000485750 sp=0xc000485730 pc=0x48df0e
  352. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  353. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0004857e0 sp=0xc000485750 pc=0x46ece5
  354. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  355. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0004857e8 sp=0xc0004857e0 pc=0x4c16a1
  356. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  357. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  358. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 10 [GC worker (idle)]:
  359. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4fd74a4007f?, 0x3?, 0x32?, 0x2d?, 0x0?)
  360. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000504f50 sp=0xc000504f30 pc=0x48df0e
  361. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  362. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc000504fe0 sp=0xc000504f50 pc=0x46ece5
  363. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  364. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc000504fe8 sp=0xc000504fe0 pc=0x4c16a1
  365. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  366. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  367. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 30 [GC worker (idle)]:
  368. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x5a72ee0?, 0x1?, 0xb1?, 0x3b?, 0x0?)
  369. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000485f50 sp=0xc000485f30 pc=0x48df0e
  370. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  371. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc000485fe0 sp=0xc000485f50 pc=0x46ece5
  372. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  373. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc000485fe8 sp=0xc000485fe0 pc=0x4c16a1
  374. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  375. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  376. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 11 [GC worker (idle), 4 minutes]:
  377. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4c887a8ea06?, 0x3?, 0xa8?, 0x6f?, 0x0?)
  378. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000505750 sp=0xc000505730 pc=0x48df0e
  379. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  380. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0005057e0 sp=0xc000505750 pc=0x46ece5
  381. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  382. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0005057e8 sp=0xc0005057e0 pc=0x4c16a1
  383. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  384. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  385. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 31 [GC worker (idle)]:
  386. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x5a72ee0?, 0x1?, 0x53?, 0x94?, 0x0?)
  387. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000486750 sp=0xc000486730 pc=0x48df0e
  388. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  389. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0004867e0 sp=0xc000486750 pc=0x46ece5
  390. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  391. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0004867e8 sp=0xc0004867e0 pc=0x4c16a1
  392. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  393. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  394. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 32 [GC worker (idle)]:
  395. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4fd749a1226?, 0x1?, 0x77?, 0xa1?, 0x0?)
  396. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000486f50 sp=0xc000486f30 pc=0x48df0e
  397. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  398. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc000486fe0 sp=0xc000486f50 pc=0x46ece5
  399. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  400. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc000486fe8 sp=0xc000486fe0 pc=0x4c16a1
  401. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  402. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  403. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 37 [GC worker (idle), 4 minutes]:
  404. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4c887f5fe58?, 0x3?, 0xb7?, 0x3e?, 0x0?)
  405. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000489f50 sp=0xc000489f30 pc=0x48df0e
  406. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  407. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc000489fe0 sp=0xc000489f50 pc=0x46ece5
  408. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  409. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc000489fe8 sp=0xc000489fe0 pc=0x4c16a1
  410. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  411. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  412. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 12 [GC worker (idle)]:
  413. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x5a72ee0?, 0x1?, 0x92?, 0x71?, 0x0?)
  414. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000505f50 sp=0xc000505f30 pc=0x48df0e
  415. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  416. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc000505fe0 sp=0xc000505f50 pc=0x46ece5
  417. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  418. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc000505fe8 sp=0xc000505fe0 pc=0x4c16a1
  419. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  420. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  421. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 13 [GC worker (idle)]:
  422. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x5a72ee0?, 0x1?, 0xd6?, 0x7c?, 0x0?)
  423. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000506750 sp=0xc000506730 pc=0x48df0e
  424. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  425. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0005067e0 sp=0xc000506750 pc=0x46ece5
  426. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  427. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0005067e8 sp=0xc0005067e0 pc=0x4c16a1
  428. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  429. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  430. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 14 [GC worker (idle)]:
  431. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4fd7499bcc1?, 0x1?, 0xa4?, 0x26?, 0x0?)
  432. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000506f50 sp=0xc000506f30 pc=0x48df0e
  433. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  434. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc000506fe0 sp=0xc000506f50 pc=0x46ece5
  435. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  436. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc000506fe8 sp=0xc000506fe0 pc=0x4c16a1
  437. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  438. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  439. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 15 [GC worker (idle)]:
  440. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4fd749a1887?, 0x1?, 0xb3?, 0x62?, 0x0?)
  441. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000507750 sp=0xc000507730 pc=0x48df0e
  442. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  443. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0005077e0 sp=0xc000507750 pc=0x46ece5
  444. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  445. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0005077e8 sp=0xc0005077e0 pc=0x4c16a1
  446. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  447. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  448. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 16 [GC worker (idle), 2 minutes]:
  449. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x5a72ee0?, 0x1?, 0x4f?, 0x5e?, 0x0?)
  450. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000507f50 sp=0xc000507f30 pc=0x48df0e
  451. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  452. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc000507fe0 sp=0xc000507f50 pc=0x46ece5
  453. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  454. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc000507fe8 sp=0xc000507fe0 pc=0x4c16a1
  455. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  456. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  457. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 50 [GC worker (idle), 9 minutes]:
  458. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f47b95e4c494?, 0x3?, 0x70?, 0x2e?, 0x0?)
  459. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000500750 sp=0xc000500730 pc=0x48df0e
  460. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  461. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0005007e0 sp=0xc000500750 pc=0x46ece5
  462. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  463. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0005007e8 sp=0xc0005007e0 pc=0x4c16a1
  464. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  465. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  466. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 51 [GC worker (idle), 4 minutes]:
  467. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4c887f60238?, 0x3?, 0xab?, 0x55?, 0x0?)
  468. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000500f50 sp=0xc000500f30 pc=0x48df0e
  469. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  470. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc000500fe0 sp=0xc000500f50 pc=0x46ece5
  471. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  472. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc000500fe8 sp=0xc000500fe0 pc=0x4c16a1
  473. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  474. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  475. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 52 [GC worker (idle)]:
  476. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f4fd74a7842a?, 0x1?, 0xc4?, 0xdb?, 0x0?)
  477. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000501750 sp=0xc000501730 pc=0x48df0e
  478. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gcBgMarkWorker()
  479. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1295 +0xe5 fp=0xc0005017e0 sp=0xc000501750 pc=0x46ece5
  480. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  481. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0005017e8 sp=0xc0005017e0 pc=0x4c16a1
  482. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.gcBgMarkStartWorkers in goroutine 1
  483. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/mgc.go:1219 +0x1c
  484. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 53 [select]:
  485. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc000503788?, 0x3?, 0x90?, 0x1e?, 0xc000503772?)
  486. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000503618 sp=0xc0005035f8 pc=0x48df0e
  487. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc000503788, 0xc00050376c, 0xc00085fa00?, 0x0, 0x0?, 0x1)
  488. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc000503738 sp=0xc000503618 pc=0x49e3e5
  489. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: go.opencensus.io/stats/view.(*worker).start(0xc00085fa00)
  490. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: go.opencensus.io@v0.24.0/stats/view/worker.go:292 +0x9f fp=0xc0005037c8 sp=0xc000503738 pc=0x1c20d9f
  491. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: go.opencensus.io/stats/view.init.0.func1()
  492. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: go.opencensus.io@v0.24.0/stats/view/worker.go:34 +0x25 fp=0xc0005037e0 sp=0xc0005037c8 pc=0x1c200c5
  493. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  494. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0005037e8 sp=0xc0005037e0 pc=0x4c16a1
  495. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by go.opencensus.io/stats/view.init.0 in goroutine 1
  496. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: go.opencensus.io@v0.24.0/stats/view/worker.go:34 +0x8d
  497. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 54 [chan receive]:
  498. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc001492000?, 0x0?, 0x0?, 0x0?, 0xf49380?)
  499. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000502708 sp=0xc0005026e8 pc=0x48df0e
  500. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.chanrecv(0xc00026c060, 0x0, 0x1)
  501. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/chan.go:583 +0x3cd fp=0xc000502780 sp=0xc000502708 pc=0x45956d
  502. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.chanrecv1(0x0?, 0x0?)
  503. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/chan.go:442 +0x12 fp=0xc0005027a8 sp=0xc000502780 pc=0x459172
  504. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/rcrowley/go-metrics.(*meterArbiter).tick(0x5a31340)
  505. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/rcrowley/go-metrics@v0.0.0-20201227073835-cf1acfcdf475/meter.go:239 +0x25 fp=0xc0005027c8 sp=0xc0005027a8 pc=0xf49205
  506. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/rcrowley/go-metrics.NewMeter.func2()
  507. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/rcrowley/go-metrics@v0.0.0-20201227073835-cf1acfcdf475/meter.go:46 +0x25 fp=0xc0005027e0 sp=0xc0005027c8 pc=0xf487e5
  508. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  509. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0005027e8 sp=0xc0005027e0 pc=0x4c16a1
  510. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/rcrowley/go-metrics.NewMeter in goroutine 1
  511. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/rcrowley/go-metrics@v0.0.0-20201227073835-cf1acfcdf475/meter.go:46 +0xc5
  512. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 55 [chan receive, 118 minutes]:
  513. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0fa986aa8?, 0x7c4a25?, 0x1?, 0xcc?, 0xc0fa986b20?)
  514. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc255afaa90 sp=0xc255afaa70 pc=0x48df0e
  515. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.chanrecv(0xc24b97e720, 0xc0fa986b58, 0x1)
  516. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/chan.go:583 +0x3cd fp=0xc255afab08 sp=0xc255afaa90 pc=0x45956d
  517. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.chanrecv1(0xc24b97e720?, 0xc0fa986b68?)
  518. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/chan.go:442 +0x12 fp=0xc255afab30 sp=0xc255afab08 pc=0x459172
  519. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk/server.WaitForQuitSignals()
  520. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/server/util.go:391 +0x86 fp=0xc255afab98 sp=0xc255afab30 pc=0x1342006
  521. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk/server.startInProcess(_, {{0x0, 0x0, 0x0}, {0x402e120, 0xc0027f0840}, 0x0, {0x0, 0x0}, {0x40389b0, ...}, ...}, ...)
  522. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/server/start.go:515 +0x13a5 fp=0xc255afbdd8 sp=0xc255afab98 pc=0x133d545
  523. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk/server.StartCmd.func2.2()
  524. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/server/start.go:153 +0x45 fp=0xc255afbfa8 sp=0xc255afbdd8 pc=0x133b245
  525. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk/server.wrapCPUProfile.func2()
  526. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/server/start.go:617 +0x22 fp=0xc255afbfe0 sp=0xc255afbfa8 pc=0x133ef02
  527. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  528. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc255afbfe8 sp=0xc255afbfe0 pc=0x4c16a1
  529. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cosmos/cosmos-sdk/server.wrapCPUProfile in goroutine 1
  530. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/server/start.go:616 +0x22f
  531. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 56 [select]:
  532. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc001ce1d90?, 0x7?, 0x5?, 0x7?, 0xc001ce19b2?)
  533. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc001ce17f8 sp=0xc001ce17d8 pc=0x48df0e
  534. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc001ce1d90, 0xc001ce19a4, 0x2b58?, 0x0, 0x1?, 0x1)
  535. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc001ce1918 sp=0xc001ce17f8 pc=0x49e3e5
  536. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*session).refLoop(0xc000f9a1e0)
  537. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/session_util.go:189 +0x59e fp=0xc001ce1fc8 sp=0xc001ce1918 pc=0xcffade
  538. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.newSession.func1()
  539. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/session.go:93 +0x25 fp=0xc001ce1fe0 sp=0xc001ce1fc8 pc=0xcf95c5
  540. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  541. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc001ce1fe8 sp=0xc001ce1fe0 pc=0x4c16a1
  542. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.newSession in goroutine 55
  543. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/session.go:93 +0x2a6
  544. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 57 [select]:
  545. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc000501f28?, 0x2?, 0x0?, 0x0?, 0xc000501ed0?)
  546. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000501d60 sp=0xc000501d40 pc=0x48df0e
  547. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc000501f28, 0xc000501ecc, 0x0?, 0x0, 0x10?, 0x1)
  548. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc000501e80 sp=0xc000501d60 pc=0x49e3e5
  549. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc001242000)
  550. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_compaction.go:91 +0x12a fp=0xc000501fc8 sp=0xc000501e80 pc=0xce89aa
  551. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func1()
  552. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:148 +0x25 fp=0xc000501fe0 sp=0xc000501fc8 pc=0xce2d05
  553. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  554. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc000501fe8 sp=0xc000501fe0 pc=0x4c16a1
  555. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  556. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:148 +0x456
  557. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 58 [select]:
  558. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc000503f98?, 0x2?, 0x70?, 0x84?, 0xc000503f64?)
  559. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc000503e08 sp=0xc000503de8 pc=0x48df0e
  560. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc000503f98, 0xc000503f60, 0x0?, 0x0, 0x0?, 0x1)
  561. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc000503f28 sp=0xc000503e08 pc=0x49e3e5
  562. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc001242000)
  563. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_state.go:101 +0x9c fp=0xc000503fc8 sp=0xc000503f28 pc=0xcf1afc
  564. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func2()
  565. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:149 +0x25 fp=0xc000503fe0 sp=0xc000503fc8 pc=0xce2ca5
  566. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  567. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc000503fe8 sp=0xc000503fe0 pc=0x4c16a1
  568. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  569. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:149 +0x496
  570. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 59 [runnable]:
  571. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb/comparer.(*bytesComparer).Compare(0x5a70340?, {0xc062d5b0c0?, 0x2e?, 0x40?}, {0xc065486000?, 0x2e?, 0x40?})
  572. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: <autogenerated>:1 +0x79 fp=0xc0052c76c8 sp=0xc0052c76c0 pc=0xcc8439
  573. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*iComparer).uCompare(...)
  574. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/comparer.go:22
  575. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*tableCompactionBuilder).run(0xc37596e320, 0xc101f58778)
  576. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_compaction.go:463 +0x590 fp=0xc0052c7908 sp=0xc0052c76c8 pc=0xceb090
  577. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).compactionTransact(0xc001242000, {0x3307e88, 0xb}, {0x3ff7f40?, 0xc37596e320})
  578. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_compaction.go:186 +0x20b fp=0xc0052c7b18 sp=0xc0052c7908 pc=0xce8f0b
  579. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).tableCompaction(0xc001242000, 0xc0630d3560, 0x0)
  580. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_compaction.go:580 +0x545 fp=0xc0052c7db8 sp=0xc0052c7b18 pc=0xcebe65
  581. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).tableAutoCompaction(0xc001242000)
  582. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_compaction.go:644 +0x34 fp=0xc0052c7de0 sp=0xc0052c7db8 pc=0xceca34
  583. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc001242000)
  584. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_compaction.go:863 +0x465 fp=0xc0052c7fc8 sp=0xc0052c7de0 pc=0xcede05
  585. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func3()
  586. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:155 +0x25 fp=0xc0052c7fe0 sp=0xc0052c7fc8 pc=0xce2c45
  587. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  588. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0052c7fe8 sp=0xc0052c7fe0 pc=0x4c16a1
  589. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  590. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:155 +0x505
  591. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 60 [select]:
  592. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc006c0ff90?, 0x2?, 0x80?, 0xa3?, 0xc006c0ff54?)
  593. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc006c0fdf8 sp=0xc006c0fdd8 pc=0x48df0e
  594. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc006c0ff90, 0xc006c0ff50, 0x0?, 0x0, 0x0?, 0x1)
  595. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc006c0ff18 sp=0xc006c0fdf8 pc=0x49e3e5
  596. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc001242000)
  597. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_compaction.go:773 +0x105 fp=0xc006c0ffc8 sp=0xc006c0ff18 pc=0xced825
  598. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func4()
  599. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:156 +0x25 fp=0xc006c0ffe0 sp=0xc006c0ffc8 pc=0xce2be5
  600. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  601. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc006c0ffe8 sp=0xc006c0ffe0 pc=0x4c16a1
  602. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  603. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:156 +0x545
  604. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 38 [select, 4 minutes]:
  605. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc004d3ed90?, 0x7?, 0x87?, 0xe5?, 0xc004d3e9b2?)
  606. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc004d3e7f8 sp=0xc004d3e7d8 pc=0x48df0e
  607. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc004d3ed90, 0xc004d3e9a4, 0x1?, 0x0, 0xd?, 0x1)
  608. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc004d3e918 sp=0xc004d3e7f8 pc=0x49e3e5
  609. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*session).refLoop(0xc001512000)
  610. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/session_util.go:189 +0x59e fp=0xc004d3efc8 sp=0xc004d3e918 pc=0xcffade
  611. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.newSession.func1()
  612. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/session.go:93 +0x25 fp=0xc004d3efe0 sp=0xc004d3efc8 pc=0xcf95c5
  613. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  614. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc004d3efe8 sp=0xc004d3efe0 pc=0x4c16a1
  615. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.newSession in goroutine 55
  616. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/session.go:93 +0x2a6
  617. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 82 [select, 2 minutes]:
  618. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0060b4f28?, 0x2?, 0x98?, 0x59?, 0xc0060b4ed0?)
  619. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0060b4d60 sp=0xc0060b4d40 pc=0x48df0e
  620. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0060b4f28, 0xc0060b4ecc, 0xc005fb5a58?, 0x0, 0x12?, 0x1)
  621. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0060b4e80 sp=0xc0060b4d60 pc=0x49e3e5
  622. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc00b2d16c0)
  623. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_compaction.go:91 +0x12a fp=0xc0060b4fc8 sp=0xc0060b4e80 pc=0xce89aa
  624. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func1()
  625. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:148 +0x25 fp=0xc0060b4fe0 sp=0xc0060b4fc8 pc=0xce2d05
  626. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  627. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0060b4fe8 sp=0xc0060b4fe0 pc=0x4c16a1
  628. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  629. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:148 +0x456
  630. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 40 [select]:
  631. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0060b0f98?, 0x2?, 0xc5?, 0x0?, 0xc0060b0f64?)
  632. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0060b0e08 sp=0xc0060b0de8 pc=0x48df0e
  633. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0060b0f98, 0xc0060b0f60, 0x1f1b01?, 0x0, 0xc005fb3020?, 0x1)
  634. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0060b0f28 sp=0xc0060b0e08 pc=0x49e3e5
  635. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc001242380)
  636. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_state.go:101 +0x9c fp=0xc0060b0fc8 sp=0xc0060b0f28 pc=0xcf1afc
  637. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func2()
  638. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:149 +0x25 fp=0xc0060b0fe0 sp=0xc0060b0fc8 pc=0xce2ca5
  639. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  640. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0060b0fe8 sp=0xc0060b0fe0 pc=0x4c16a1
  641. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  642. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:149 +0x496
  643. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 39 [select, 119 minutes]:
  644. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc00048a728?, 0x2?, 0x60?, 0xa1?, 0xc00048a6d0?)
  645. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc00048a560 sp=0xc00048a540 pc=0x48df0e
  646. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc00048a728, 0xc00048a6cc, 0xc00048a6c0?, 0x0, 0xc001883a00?, 0x1)
  647. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc00048a680 sp=0xc00048a560 pc=0x49e3e5
  648. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc001242380)
  649. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_compaction.go:91 +0x12a fp=0xc00048a7c8 sp=0xc00048a680 pc=0xce89aa
  650. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func1()
  651. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:148 +0x25 fp=0xc00048a7e0 sp=0xc00048a7c8 pc=0xce2d05
  652. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  653. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00048a7e8 sp=0xc00048a7e0 pc=0x4c16a1
  654. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  655. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:148 +0x456
  656. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 41 [select, 119 minutes]:
  657. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0060b1710?, 0x3?, 0x4?, 0x0?, 0xc0060b165e?)
  658. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc004d3ccc0 sp=0xc004d3cca0 pc=0x48df0e
  659. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc004d3cf10, 0xc0060b1658, 0x4?, 0x0, 0x202427?, 0x1)
  660. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc004d3cde0 sp=0xc004d3ccc0 pc=0x49e3e5
  661. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc001242380)
  662. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_compaction.go:836 +0x698 fp=0xc004d3cfc8 sp=0xc004d3cde0 pc=0xcee038
  663. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func3()
  664. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:155 +0x25 fp=0xc004d3cfe0 sp=0xc004d3cfc8 pc=0xce2c45
  665. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  666. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc004d3cfe8 sp=0xc004d3cfe0 pc=0x4c16a1
  667. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  668. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:155 +0x505
  669. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 42 [select, 119 minutes]:
  670. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0060b1f90?, 0x2?, 0x12?, 0x0?, 0xc0060b1f54?)
  671. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0060b1df8 sp=0xc0060b1dd8 pc=0x48df0e
  672. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0060b1f90, 0xc0060b1f50, 0x12?, 0x0, 0x4?, 0x1)
  673. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0060b1f18 sp=0xc0060b1df8 pc=0x49e3e5
  674. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc001242380)
  675. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_compaction.go:773 +0x105 fp=0xc0060b1fc8 sp=0xc0060b1f18 pc=0xced825
  676. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func4()
  677. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:156 +0x25 fp=0xc0060b1fe0 sp=0xc0060b1fc8 pc=0xce2be5
  678. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  679. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0060b1fe8 sp=0xc0060b1fe0 pc=0x4c16a1
  680. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  681. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:156 +0x545
  682. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 67 [select]:
  683. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0060b2728?, 0x2?, 0x28?, 0x26?, 0xc0060b26d0?)
  684. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0060b2560 sp=0xc0060b2540 pc=0x48df0e
  685. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0060b2728, 0xc0060b26cc, 0xc0060b26b8?, 0x0, 0xc00fea2540?, 0x1)
  686. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0060b2680 sp=0xc0060b2560 pc=0x49e3e5
  687. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc00b2d1500)
  688. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_compaction.go:91 +0x12a fp=0xc0060b27c8 sp=0xc0060b2680 pc=0xce89aa
  689. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func1()
  690. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:148 +0x25 fp=0xc0060b27e0 sp=0xc0060b27c8 pc=0xce2d05
  691. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  692. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0060b27e8 sp=0xc0060b27e0 pc=0x4c16a1
  693. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  694. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:148 +0x456
  695. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 44 [select]:
  696. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc00233bd90?, 0x7?, 0x97?, 0x6?, 0xc00233b9b2?)
  697. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc00233b7f8 sp=0xc00233b7d8 pc=0x48df0e
  698. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc00233bd90, 0xc00233b9a4, 0xed?, 0x0, 0x0?, 0x1)
  699. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc00233b918 sp=0xc00233b7f8 pc=0x49e3e5
  700. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*session).refLoop(0xc00babb680)
  701. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/session_util.go:189 +0x59e fp=0xc00233bfc8 sp=0xc00233b918 pc=0xcffade
  702. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.newSession.func1()
  703. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/session.go:93 +0x25 fp=0xc00233bfe0 sp=0xc00233bfc8 pc=0xcf95c5
  704. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  705. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00233bfe8 sp=0xc00233bfe0 pc=0x4c16a1
  706. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.newSession in goroutine 55
  707. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/session.go:93 +0x2a6
  708. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 68 [select]:
  709. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0060b3798?, 0x2?, 0x70?, 0x84?, 0xc0060b3764?)
  710. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0060b3608 sp=0xc0060b35e8 pc=0x48df0e
  711. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0060b3798, 0xc0060b3760, 0xc005fb4ac8?, 0x0, 0x12?, 0x1)
  712. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0060b3728 sp=0xc0060b3608 pc=0x49e3e5
  713. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc00b2d1500)
  714. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_state.go:101 +0x9c fp=0xc0060b37c8 sp=0xc0060b3728 pc=0xcf1afc
  715. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func2()
  716. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:149 +0x25 fp=0xc0060b37e0 sp=0xc0060b37c8 pc=0xce2ca5
  717. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  718. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0060b37e8 sp=0xc0060b37e0 pc=0x4c16a1
  719. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  720. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:149 +0x496
  721. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 69 [select]:
  722. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc029b0ff10?, 0x3?, 0x14?, 0x0?, 0xc029b0fe5e?)
  723. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc029b0fcc0 sp=0xc029b0fca0 pc=0x48df0e
  724. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc029b0ff10, 0xc029b0fe58, 0x202f54?, 0x0, 0x12?, 0x1)
  725. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc029b0fde0 sp=0xc029b0fcc0 pc=0x49e3e5
  726. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc00b2d1500)
  727. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_compaction.go:836 +0x698 fp=0xc029b0ffc8 sp=0xc029b0fde0 pc=0xcee038
  728. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func3()
  729. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:155 +0x25 fp=0xc029b0ffe0 sp=0xc029b0ffc8 pc=0xce2c45
  730. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  731. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc029b0ffe8 sp=0xc029b0ffe0 pc=0x4c16a1
  732. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  733. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:155 +0x505
  734. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 70 [select]:
  735. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0298c1f90?, 0x2?, 0x80?, 0xa3?, 0xc0298c1f54?)
  736. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0298c1df8 sp=0xc0298c1dd8 pc=0x48df0e
  737. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0298c1f90, 0xc0298c1f50, 0x0?, 0x0, 0x201e33?, 0x1)
  738. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0298c1f18 sp=0xc0298c1df8 pc=0x49e3e5
  739. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc00b2d1500)
  740. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_compaction.go:773 +0x105 fp=0xc0298c1fc8 sp=0xc0298c1f18 pc=0xced825
  741. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func4()
  742. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:156 +0x25 fp=0xc0298c1fe0 sp=0xc0298c1fc8 pc=0xce2be5
  743. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  744. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0298c1fe8 sp=0xc0298c1fe0 pc=0x4c16a1
  745. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  746. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:156 +0x545
  747. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 71 [select, 2 minutes]:
  748. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc001ce3d90?, 0x7?, 0x5?, 0x7?, 0xc001ce39b2?)
  749. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc001ce37f8 sp=0xc001ce37d8 pc=0x48df0e
  750. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc001ce3d90, 0xc001ce39a4, 0x103?, 0x0, 0xe?, 0x1)
  751. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc001ce3918 sp=0xc001ce37f8 pc=0x49e3e5
  752. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*session).refLoop(0xc000f9aa50)
  753. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/session_util.go:189 +0x59e fp=0xc001ce3fc8 sp=0xc001ce3918 pc=0xcffade
  754. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.newSession.func1()
  755. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/session.go:93 +0x25 fp=0xc001ce3fe0 sp=0xc001ce3fc8 pc=0xcf95c5
  756. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  757. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc001ce3fe8 sp=0xc001ce3fe0 pc=0x4c16a1
  758. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.newSession in goroutine 55
  759. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/session.go:93 +0x2a6
  760. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 83 [select]:
  761. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0060b5f98?, 0x2?, 0xb8?, 0xcc?, 0xc0060b5f64?)
  762. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0060b5e08 sp=0xc0060b5de8 pc=0x48df0e
  763. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0060b5f98, 0xc0060b5f60, 0xc0060b5e88?, 0x0, 0x12?, 0x1)
  764. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0060b5f28 sp=0xc0060b5e08 pc=0x49e3e5
  765. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc00b2d16c0)
  766. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_state.go:101 +0x9c fp=0xc0060b5fc8 sp=0xc0060b5f28 pc=0xcf1afc
  767. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func2()
  768. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:149 +0x25 fp=0xc0060b5fe0 sp=0xc0060b5fc8 pc=0xce2ca5
  769. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  770. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0060b5fe8 sp=0xc0060b5fe0 pc=0x4c16a1
  771. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  772. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:149 +0x496
  773. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 84 [select, 2 minutes]:
  774. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0dbb55f10?, 0x3?, 0x6?, 0x0?, 0xc0dbb55e5e?)
  775. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0ef863cc0 sp=0xc0ef863ca0 pc=0x48df0e
  776. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0ef863f10, 0xc0dbb55e58, 0xc005fb4498?, 0x0, 0x12?, 0x1)
  777. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0ef863de0 sp=0xc0ef863cc0 pc=0x49e3e5
  778. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc00b2d16c0)
  779. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_compaction.go:836 +0x698 fp=0xc0ef863fc8 sp=0xc0ef863de0 pc=0xcee038
  780. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func3()
  781. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:155 +0x25 fp=0xc0ef863fe0 sp=0xc0ef863fc8 pc=0xce2c45
  782. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  783. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0ef863fe8 sp=0xc0ef863fe0 pc=0x4c16a1
  784. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  785. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:155 +0x505
  786. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 85 [select, 2 minutes]:
  787. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0dae25f90?, 0x2?, 0x80?, 0xa3?, 0xc0dae25f54?)
  788. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0f7a0fdf8 sp=0xc0f7a0fdd8 pc=0x48df0e
  789. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0f7a0ff90, 0xc0dae25f50, 0x0?, 0x0, 0xc0060b3e88?, 0x1)
  790. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0f7a0ff18 sp=0xc0f7a0fdf8 pc=0x49e3e5
  791. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc00b2d16c0)
  792. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_compaction.go:773 +0x105 fp=0xc0f7a0ffc8 sp=0xc0f7a0ff18 pc=0xced825
  793. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func4()
  794. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:156 +0x25 fp=0xc0f7a0ffe0 sp=0xc0f7a0ffc8 pc=0xce2be5
  795. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  796. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0f7a0ffe8 sp=0xc0f7a0ffe0 pc=0x4c16a1
  797. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  798. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:156 +0x545
  799. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 86 [select, 118 minutes, locked to thread]:
  800. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0060affa8?, 0x2?, 0x60?, 0xfe?, 0xc0060affa4?)
  801. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0060afe38 sp=0xc0060afe18 pc=0x48df0e
  802. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0060affa8, 0xc0060affa0, 0x0?, 0x0, 0x1f1877?, 0x1)
  803. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0060aff58 sp=0xc0060afe38 pc=0x49e3e5
  804. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.ensureSigM.func1()
  805. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/signal_unix.go:1014 +0x19f fp=0xc0060affe0 sp=0xc0060aff58 pc=0x4b7ebf
  806. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  807. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0060affe8 sp=0xc0060affe0 pc=0x4c16a1
  808. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by runtime.ensureSigM in goroutine 1
  809. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/signal_unix.go:997 +0xc8
  810. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 87 [syscall, 119 minutes]:
  811. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.notetsleepg(0x1f19c1?, 0x201c3e?)
  812. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/lock_futex.go:236 +0x29 fp=0xc0060b07a0 sp=0xc0060b0768 pc=0x45eb69
  813. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: os/signal.signal_recv()
  814. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/sigqueue.go:152 +0x29 fp=0xc0060b07c0 sp=0xc0060b07a0 pc=0x4bda49
  815. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: os/signal.loop()
  816. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: os/signal/signal_unix.go:23 +0x13 fp=0xc0060b07e0 sp=0xc0060b07c0 pc=0x7c5113
  817. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  818. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0060b07e8 sp=0xc0060b07e0 pc=0x4c16a1
  819. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by os/signal.Notify.func1.1 in goroutine 1
  820. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: os/signal/signal.go:151 +0x1f
  821. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 135 [select, 119 minutes]:
  822. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0060aef78?, 0x4?, 0xc6?, 0xc?, 0xc0060aef58?)
  823. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0060aee00 sp=0xc0060aede0 pc=0x48df0e
  824. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0060aef78, 0xc0060aef50, 0x2014df?, 0x0, 0x12?, 0x1)
  825. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0060aef20 sp=0xc0060aee00 pc=0x49e3e5
  826. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/proxy.(*multiAppConn).killTMOnClientError(0xc000b247e0)
  827. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/proxy/multi_app_conn.go:140 +0x110 fp=0xc0060aefc8 sp=0xc0060aef20 pc=0x1027d30
  828. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/proxy.(*multiAppConn).OnStart.func1()
  829. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/proxy/multi_app_conn.go:120 +0x25 fp=0xc0060aefe0 sp=0xc0060aefc8 pc=0x1027ba5
  830. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  831. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0060aefe8 sp=0xc0060aefe0 pc=0x4c16a1
  832. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/proxy.(*multiAppConn).OnStart in goroutine 55
  833. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/proxy/multi_app_conn.go:120 +0x3f6
  834. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 136 [chan receive]:
  835. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0823d9440?, 0xc030aa3ce0?, 0x0?, 0x0?, 0xc004d39db0?)
  836. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc004d39d58 sp=0xc004d39d38 pc=0x48df0e
  837. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.chanrecv(0xc002995ec0, 0xc004d39ea0, 0x1)
  838. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/chan.go:583 +0x3cd fp=0xc004d39dd0 sp=0xc004d39d58 pc=0x45956d
  839. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.chanrecv2(0xc004d39fc0?, 0x3095560?)
  840. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/chan.go:447 +0x12 fp=0xc004d39df8 sp=0xc004d39dd0 pc=0x459192
  841. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/libs/pubsub.(*Server).loop(0xc0011ef180, {0xc0047fe900, 0xc0047fe930})
  842. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/libs/pubsub/pubsub.go:323 +0x85 fp=0xc004d39fb8 sp=0xc004d39df8 pc=0xc29245
  843. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/libs/pubsub.(*Server).OnStart.func1()
  844. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/libs/pubsub/pubsub.go:309 +0x28 fp=0xc004d39fe0 sp=0xc004d39fb8 pc=0xc29168
  845. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  846. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc004d39fe8 sp=0xc004d39fe0 pc=0x4c16a1
  847. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/libs/pubsub.(*Server).OnStart in goroutine 55
  848. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/libs/pubsub/pubsub.go:309 +0x90
  849. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 137 [chan receive]:
  850. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x5faff7?, 0xc0011ef340?, 0x0?, 0xee?, 0x0?)
  851. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc00db938b0 sp=0xc00db93890 pc=0x48df0e
  852. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.chanrecv(0xc003b52000, 0xc00db93bc8, 0x1)
  853. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/chan.go:583 +0x3cd fp=0xc00db93928 sp=0xc00db938b0 pc=0x45956d
  854. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.chanrecv1(0xe5db65?, 0x331c593?)
  855. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/chan.go:442 +0x12 fp=0xc00db93950 sp=0xc00db93928 pc=0x459172
  856. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/state/txindex.(*IndexerService).OnStart.func1()
  857. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/state/txindex/indexer_service.go:62 +0x9f fp=0xc00db93fe0 sp=0xc00db93950 pc=0x104005f
  858. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  859. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00db93fe8 sp=0xc00db93fe0 pc=0x4c16a1
  860. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/state/txindex.(*IndexerService).OnStart in goroutine 55
  861. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/state/txindex/indexer_service.go:60 +0x1a6
  862. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 148 [select, 4 minutes]:
  863. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0000d3d90?, 0x7?, 0x87?, 0xe5?, 0xc0000d39b2?)
  864. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000d37f8 sp=0xc0000d37d8 pc=0x48df0e
  865. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0000d3d90, 0xc0000d39a4, 0x1?, 0x0, 0x100000000000000?, 0x1)
  866. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0000d3918 sp=0xc0000d37f8 pc=0x49e3e5
  867. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*session).refLoop(0xc00d4a9860)
  868. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/session_util.go:189 +0x59e fp=0xc0000d3fc8 sp=0xc0000d3918 pc=0xcffade
  869. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.newSession.func1()
  870. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/session.go:93 +0x25 fp=0xc0000d3fe0 sp=0xc0000d3fc8 pc=0xcf95c5
  871. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  872. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000d3fe8 sp=0xc0000d3fe0 pc=0x4c16a1
  873. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.newSession in goroutine 55
  874. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/session.go:93 +0x2a6
  875. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 149 [select, 119 minutes]:
  876. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc00db1b728?, 0x2?, 0x21?, 0x0?, 0xc00db1b6d0?)
  877. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc00db1b560 sp=0xc00db1b540 pc=0x48df0e
  878. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc00db1b728, 0xc00db1b6cc, 0x21?, 0x0, 0x21?, 0x1)
  879. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc00db1b680 sp=0xc00db1b560 pc=0x49e3e5
  880. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc000daa700)
  881. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_compaction.go:91 +0x12a fp=0xc00db1b7c8 sp=0xc00db1b680 pc=0xce89aa
  882. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func1()
  883. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:148 +0x25 fp=0xc00db1b7e0 sp=0xc00db1b7c8 pc=0xce2d05
  884. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  885. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00db1b7e8 sp=0xc00db1b7e0 pc=0x4c16a1
  886. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  887. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:148 +0x456
  888. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 150 [select]:
  889. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc00db1bf98?, 0x2?, 0xc8?, 0x18?, 0xc00db1bf64?)
  890. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc00db1be08 sp=0xc00db1bde8 pc=0x48df0e
  891. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc00db1bf98, 0xc00db1bf60, 0xc00a99c4b0?, 0x0, 0x21?, 0x1)
  892. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc00db1bf28 sp=0xc00db1be08 pc=0x49e3e5
  893. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc000daa700)
  894. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_state.go:101 +0x9c fp=0xc00db1bfc8 sp=0xc00db1bf28 pc=0xcf1afc
  895. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func2()
  896. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:149 +0x25 fp=0xc00db1bfe0 sp=0xc00db1bfc8 pc=0xce2ca5
  897. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  898. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00db1bfe8 sp=0xc00db1bfe0 pc=0x4c16a1
  899. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  900. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:149 +0x496
  901. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 151 [select, 119 minutes]:
  902. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc00db1c710?, 0x3?, 0x26?, 0xa?, 0xc00db1c65e?)
  903. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc002319cc0 sp=0xc002319ca0 pc=0x48df0e
  904. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc002319f10, 0xc00db1c658, 0x207bd0?, 0x0, 0x21?, 0x1)
  905. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc002319de0 sp=0xc002319cc0 pc=0x49e3e5
  906. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc000daa700)
  907. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_compaction.go:836 +0x698 fp=0xc002319fc8 sp=0xc002319de0 pc=0xcee038
  908. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func3()
  909. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:155 +0x25 fp=0xc002319fe0 sp=0xc002319fc8 pc=0xce2c45
  910. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  911. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc002319fe8 sp=0xc002319fe0 pc=0x4c16a1
  912. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  913. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:155 +0x505
  914. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 152 [select, 119 minutes]:
  915. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc00db1cf90?, 0x2?, 0x4?, 0x0?, 0xc00db1cf54?)
  916. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc00db1cdf8 sp=0xc00db1cdd8 pc=0x48df0e
  917. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc00db1cf90, 0xc00db1cf50, 0x4?, 0x0, 0x208171?, 0x1)
  918. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc00db1cf18 sp=0xc00db1cdf8 pc=0x49e3e5
  919. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc000daa700)
  920. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db_compaction.go:773 +0x105 fp=0xc00db1cfc8 sp=0xc00db1cf18 pc=0xced825
  921. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb/leveldb.openDB.func4()
  922. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:156 +0x25 fp=0xc00db1cfe0 sp=0xc00db1cfc8 pc=0xce2be5
  923. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  924. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00db1cfe8 sp=0xc00db1cfe0 pc=0x4c16a1
  925. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/syndtr/goleveldb/leveldb.openDB in goroutine 55
  926. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/syndtr/goleveldb@v1.0.1-0.20220721030215-126854af5e6d/leveldb/db.go:156 +0x545
  927. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 153 [IO wait, 119 minutes]:
  928. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc00db8fc18?, 0x4600c5?, 0x20?, 0xfc?, 0x504dbd?)
  929. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc004d3abb0 sp=0xc004d3ab90 pc=0x48df0e
  930. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.netpollblock(0x7fa7a543f750?, 0x4566e6?, 0x0?)
  931. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:564 +0xf7 fp=0xc004d3abe8 sp=0xc004d3abb0 pc=0x486857
  932. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.runtime_pollWait(0x7fa7a5de2e88, 0x72)
  933. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:343 +0x85 fp=0xc004d3ac08 sp=0xc004d3abe8 pc=0x4bb985
  934. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).wait(0xc00062a000?, 0xc00db8fcf0?, 0x0)
  935. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc004d3ac30 sp=0xc004d3ac08 pc=0x4fda27
  936. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).waitRead(...)
  937. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:89
  938. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*FD).Accept(0xc00062a000)
  939. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_unix.go:611 +0x2ac fp=0xc004d3acd8 sp=0xc004d3ac30 pc=0x502f0c
  940. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*netFD).accept(0xc00062a000)
  941. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/fd_unix.go:172 +0x29 fp=0xc004d3ad90 sp=0xc004d3acd8 pc=0x586149
  942. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*TCPListener).accept(0xc00230e1e0)
  943. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/tcpsock_posix.go:152 +0x1e fp=0xc004d3adb8 sp=0xc004d3ad90 pc=0x59e37e
  944. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*TCPListener).Accept(0xc00230e1e0)
  945. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/tcpsock.go:315 +0x30 fp=0xc004d3ade8 sp=0xc004d3adb8 pc=0x59d530
  946. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http.(*onceCloseListener).Accept(0x4016968?)
  947. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: <autogenerated>:1 +0x24 fp=0xc004d3ae00 sp=0xc004d3ade8 pc=0x7a16a4
  948. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http.(*Server).Serve(0xc00232e000, {0x40092c0, 0xc00230e1e0})
  949. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http/server.go:3056 +0x364 fp=0xc004d3af30 sp=0xc004d3ae00 pc=0x77d924
  950. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http.(*Server).ListenAndServe(0xc00232e000)
  951. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http/server.go:2985 +0x71 fp=0xc004d3af60 sp=0xc004d3af30 pc=0x77d591
  952. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http.ListenAndServe(...)
  953. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http/server.go:3239
  954. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/node.NewNodeWithContext.func1()
  955. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/node/node.go:1056 +0x12a fp=0xc004d3afe0 sp=0xc004d3af60 pc=0x115ef0a
  956. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  957. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc004d3afe8 sp=0xc004d3afe0 pc=0x4c16a1
  958. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/node.NewNodeWithContext in goroutine 55
  959. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/node/node.go:1053 +0x1511
  960. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 138 [IO wait, 118 minutes]:
  961. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x5?, 0xc00db95b28?, 0x50?, 0x5b?, 0x504dbd?)
  962. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc00db95ae0 sp=0xc00db95ac0 pc=0x48df0e
  963. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.netpollblock(0xc00db95b58?, 0x4566e6?, 0x0?)
  964. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:564 +0xf7 fp=0xc00db95b18 sp=0xc00db95ae0 pc=0x486857
  965. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.runtime_pollWait(0x7fa7a5de2d90, 0x72)
  966. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:343 +0x85 fp=0xc00db95b38 sp=0xc00db95b18 pc=0x4bb985
  967. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).wait(0xc00062a500?, 0x5a72ee0?, 0x0)
  968. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc00db95b60 sp=0xc00db95b38 pc=0x4fda27
  969. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).waitRead(...)
  970. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:89
  971. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*FD).Accept(0xc00062a500)
  972. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_unix.go:611 +0x2ac fp=0xc00db95c08 sp=0xc00db95b60 pc=0x502f0c
  973. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*netFD).accept(0xc00062a500)
  974. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/fd_unix.go:172 +0x29 fp=0xc00db95cc0 sp=0xc00db95c08 pc=0x586149
  975. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*TCPListener).accept(0xc00230e1a0)
  976. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/tcpsock_posix.go:152 +0x1e fp=0xc00db95ce8 sp=0xc00db95cc0 pc=0x59e37e
  977. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*TCPListener).Accept(0xc00230e1a0)
  978. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/tcpsock.go:315 +0x30 fp=0xc00db95d18 sp=0xc00db95ce8 pc=0x59d530
  979. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: golang.org/x/net/netutil.(*limitListener).Accept(0xc0060aacf0)
  980. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: golang.org/x/net@v0.19.0/netutil/listen.go:63 +0x85 fp=0xc00db95da8 sp=0xc00db95d18 pc=0xda2545
  981. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http.(*onceCloseListener).Accept(0x4016968?)
  982. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: <autogenerated>:1 +0x24 fp=0xc00db95dc0 sp=0xc00db95da8 pc=0x7a16a4
  983. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http.(*Server).Serve(0xc001512690, {0x400ac10, 0xc0060aacf0})
  984. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http/server.go:3056 +0x364 fp=0xc00db95ef0 sp=0xc00db95dc0 pc=0x77d924
  985. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/rpc/jsonrpc/server.Serve({0x400ac10, 0xc0060aacf0}, {0x3feb8e0, 0xc0108fe040}, {0x4016d20, 0xc00230c040}, 0xc00234e000)
  986. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/rpc/jsonrpc/server/http_server.go:62 +0x2b4 fp=0xc00db95f80 sp=0xc00db95ef0 pc=0xf6b3f4
  987. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/node.(*Node).startRPC.func3()
  988. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/node/node.go:1339 +0x3c fp=0xc00db95fe0 sp=0xc00db95f80 pc=0x11612bc
  989. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  990. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00db95fe8 sp=0xc00db95fe0 pc=0x4c16a1
  991. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/node.(*Node).startRPC in goroutine 55
  992. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/node/node.go:1338 +0x9e9
  993. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 142 [IO wait, 118 minutes]:
  994. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x4d9970?, 0xc004d38bf8?, 0x48?, 0x8c?, 0x504dbd?)
  995. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc004d38bd8 sp=0xc004d38bb8 pc=0x48df0e
  996. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.netpollblock(0x4bf712?, 0x4566e6?, 0x0?)
  997. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:564 +0xf7 fp=0xc004d38c10 sp=0xc004d38bd8 pc=0x486857
  998. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.runtime_pollWait(0x7fa7a5de2ba0, 0x72)
  999. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:343 +0x85 fp=0xc004d38c30 sp=0xc004d38c10 pc=0x4bb985
  1000. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).wait(0xc00088a800?, 0x4?, 0x0)
  1001. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc004d38c58 sp=0xc004d38c30 pc=0x4fda27
  1002. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).waitRead(...)
  1003. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:89
  1004. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*FD).Accept(0xc00088a800)
  1005. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_unix.go:611 +0x2ac fp=0xc004d38d00 sp=0xc004d38c58 pc=0x502f0c
  1006. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*netFD).accept(0xc00088a800)
  1007. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/fd_unix.go:172 +0x29 fp=0xc004d38db8 sp=0xc004d38d00 pc=0x586149
  1008. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*TCPListener).accept(0xc00fee4000)
  1009. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/tcpsock_posix.go:152 +0x1e fp=0xc004d38de0 sp=0xc004d38db8 pc=0x59e37e
  1010. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*TCPListener).Accept(0xc00fee4000)
  1011. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/tcpsock.go:315 +0x30 fp=0xc004d38e10 sp=0xc004d38de0 pc=0x59d530
  1012. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http.(*onceCloseListener).Accept(0xc0194f4bd0?)
  1013. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: <autogenerated>:1 +0x24 fp=0xc004d38e28 sp=0xc004d38e10 pc=0x7a16a4
  1014. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http.(*Server).Serve(0xc00baba000, {0x40092c0, 0xc00fee4000})
  1015. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http/server.go:3056 +0x364 fp=0xc004d38f58 sp=0xc004d38e28 pc=0x77d924
  1016. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http.(*Server).ListenAndServe(0xc00baba000)
  1017. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http/server.go:2985 +0x71 fp=0xc004d38f88 sp=0xc004d38f58 pc=0x77d591
  1018. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/node.(*Node).startPrometheusServer.func1()
  1019. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/node/node.go:1397 +0x25 fp=0xc004d38fe0 sp=0xc004d38f88 pc=0x1161ca5
  1020. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1021. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc004d38fe8 sp=0xc004d38fe0 pc=0x4c16a1
  1022. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/node.(*Node).startPrometheusServer in goroutine 55
  1023. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/node/node.go:1396 +0x211
  1024. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 143 [IO wait, 118 minutes]:
  1025. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x203357?, 0xc005fb1398?, 0xf0?, 0xe4?, 0x504dbd?)
  1026. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0060ae480 sp=0xc0060ae460 pc=0x48df0e
  1027. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.netpollblock(0x4?, 0x4566e6?, 0x0?)
  1028. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:564 +0xf7 fp=0xc0060ae4b8 sp=0xc0060ae480 pc=0x486857
  1029. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.runtime_pollWait(0x7fa7a5de2c98, 0x72)
  1030. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:343 +0x85 fp=0xc0060ae4d8 sp=0xc0060ae4b8 pc=0x4bb985
  1031. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).wait(0xc00062a580?, 0x1eef9b?, 0x0)
  1032. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0060ae500 sp=0xc0060ae4d8 pc=0x4fda27
  1033. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).waitRead(...)
  1034. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:89
  1035. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*FD).Accept(0xc00062a580)
  1036. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_unix.go:611 +0x2ac fp=0xc0060ae5a8 sp=0xc0060ae500 pc=0x502f0c
  1037. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*netFD).accept(0xc00062a580)
  1038. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/fd_unix.go:172 +0x29 fp=0xc0060ae660 sp=0xc0060ae5a8 pc=0x586149
  1039. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*TCPListener).accept(0xc00230e320)
  1040. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/tcpsock_posix.go:152 +0x1e fp=0xc0060ae688 sp=0xc0060ae660 pc=0x59e37e
  1041. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*TCPListener).Accept(0xc00230e320)
  1042. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/tcpsock.go:315 +0x30 fp=0xc0060ae6b8 sp=0xc0060ae688 pc=0x59d530
  1043. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: golang.org/x/net/netutil.(*limitListener).Accept(0xc0060ab290)
  1044. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: golang.org/x/net@v0.19.0/netutil/listen.go:63 +0x85 fp=0xc0060ae748 sp=0xc0060ae6b8 pc=0xda2545
  1045. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*MultiplexTransport).acceptPeers(0xc00c743e00)
  1046. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/transport.go:282 +0x3e fp=0xc0060ae7c8 sp=0xc0060ae748 pc=0xdb2cfe
  1047. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*MultiplexTransport).Listen.func1()
  1048. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/transport.go:262 +0x25 fp=0xc0060ae7e0 sp=0xc0060ae7c8 pc=0xdb2aa5
  1049. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1050. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0060ae7e8 sp=0xc0060ae7e0 pc=0x4c16a1
  1051. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p.(*MultiplexTransport).Listen in goroutine 55
  1052. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/transport.go:262 +0x1d6
  1053. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 144 [select, 2 minutes]:
  1054. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc03e415f90?, 0x2?, 0x1?, 0x0?, 0xc03e415f74?)
  1055. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc010e01e18 sp=0xc010e01df8 pc=0x48df0e
  1056. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc010e01f90, 0xc03e415f70, 0x25?, 0x0, 0xc0060b2e70?, 0x1)
  1057. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc010e01f38 sp=0xc010e01e18 pc=0x49e3e5
  1058. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/pex.(*addrBook).saveRoutine(0xc00c743f00)
  1059. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/pex/addrbook.go:500 +0xd3 fp=0xc010e01fc8 sp=0xc010e01f38 pc=0x10f6e73
  1060. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/pex.(*addrBook).OnStart.func1()
  1061. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/pex/addrbook.go:162 +0x25 fp=0xc010e01fe0 sp=0xc010e01fc8 pc=0x10f4765
  1062. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1063. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc010e01fe8 sp=0xc010e01fe0 pc=0x4c16a1
  1064. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/pex.(*addrBook).OnStart in goroutine 55
  1065. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/pex/addrbook.go:162 +0x85
  1066. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 164 [select]:
  1067. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc01ae17f98?, 0x2?, 0x0?, 0x0?, 0xc01ae17f84?)
  1068. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc01ae17e28 sp=0xc01ae17e08 pc=0x48df0e
  1069. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc01ae17f98, 0xc01ae17f80, 0x0?, 0x0, 0x0?, 0x1)
  1070. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc01ae17f48 sp=0xc01ae17e28 pc=0x49e3e5
  1071. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/pex.(*Reactor).ensurePeersRoutine(0xc00db0cb40)
  1072. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/pex/pex_reactor.go:438 +0xf7 fp=0xc01ae17fc8 sp=0xc01ae17f48 pc=0x10fcf57
  1073. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/pex.(*Reactor).OnStart.func2()
  1074. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/pex/pex_reactor.go:165 +0x25 fp=0xc01ae17fe0 sp=0xc01ae17fc8 pc=0x10fb605
  1075. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1076. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc01ae17fe8 sp=0xc01ae17fe0 pc=0x4c16a1
  1077. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/pex.(*Reactor).OnStart in goroutine 55
  1078. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/pex/pex_reactor.go:165 +0x17f
  1079. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 167 [select]:
  1080. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc00db18788?, 0x3?, 0x0?, 0x34?, 0xc00db1873a?)
  1081. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc00db185c8 sp=0xc00db185a8 pc=0x48df0e
  1082. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc00db18788, 0xc00db18734, 0xc03d2df2b0?, 0x0, 0x21?, 0x1)
  1083. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc00db186e8 sp=0xc00db185c8 pc=0x49e3e5
  1084. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).peerStatsRoutine(0xc00d37eab0)
  1085. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:941 +0xd5 fp=0xc00db187c8 sp=0xc00db186e8 pc=0x108fbd5
  1086. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).OnStart.func1()
  1087. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:78 +0x25 fp=0xc00db187e0 sp=0xc00db187c8 pc=0x1089645
  1088. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1089. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00db187e8 sp=0xc00db187e0 pc=0x4c16a1
  1090. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).OnStart in goroutine 55
  1091. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:78 +0xcf
  1092. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 168 [sync.RWMutex.RLock]:
  1093. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc000a96c00?, 0x48df0e?, 0x40?, 0x4b?, 0xc000074a00?)
  1094. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc00db18e88 sp=0xc00db18e68 pc=0x48df0e
  1095. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goparkunlock(...)
  1096. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:404
  1097. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.semacquire1(0xc00e1b009c, 0xc0?, 0x3, 0x0, 0x1?)
  1098. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/sema.go:160 +0x218 fp=0xc00db18ef0 sp=0xc00db18e88 pc=0x49f418
  1099. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: sync.runtime_SemacquireRWMutexR(0x459192?, 0x40?, 0xc00db18f98?)
  1100. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/sema.go:82 +0x25 fp=0xc00db18f28 sp=0xc00db18ef0 pc=0x4bd405
  1101. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: sync.(*RWMutex).RLock(...)
  1102. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: sync/rwmutex.go:71
  1103. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*State).GetRoundState(0xc00e1b0000)
  1104. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/state.go:241 +0x3d fp=0xc00db18f58 sp=0xc00db18f28 pc=0x109b85d
  1105. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).updateRoundStateRoutine(0xc00d37eab0)
  1106. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:529 +0xc6 fp=0xc00db18fc8 sp=0xc00db18f58 pc=0x108c926
  1107. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).OnStart.func2()
  1108. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:81 +0x25 fp=0xc00db18fe0 sp=0xc00db18fc8 pc=0x10895e5
  1109. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1110. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00db18fe8 sp=0xc00db18fe0 pc=0x4c16a1
  1111. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).OnStart in goroutine 55
  1112. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:81 +0x116
  1113. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 1432585 [select, 88 minutes]:
  1114. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc002ca0f80?, 0x2?, 0x9a?, 0xe?, 0xc002ca0f34?)
  1115. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc002ca0dc8 sp=0xc002ca0da8 pc=0x48df0e
  1116. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc002ca0f80, 0xc002ca0f30, 0xc0e619bce0?, 0x0, 0xc0e619bce0?, 0x1)
  1117. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc002ca0ee8 sp=0xc002ca0dc8 pc=0x49e3e5
  1118. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc04222b2f0, {0x4016bd0, 0xc0909fec80})
  1119. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: google.golang.org/grpc@v1.60.1/internal/grpcsync/callback_serializer.go:76 +0x115 fp=0xc002ca0fb8 sp=0xc002ca0ee8 pc=0xac6455
  1120. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer.func1()
  1121. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: google.golang.org/grpc@v1.60.1/internal/grpcsync/callback_serializer.go:52 +0x28 fp=0xc002ca0fe0 sp=0xc002ca0fb8 pc=0xac62a8
  1122. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1123. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc002ca0fe8 sp=0xc002ca0fe0 pc=0x4c16a1
  1124. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1432584
  1125. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: google.golang.org/grpc@v1.60.1/internal/grpcsync/callback_serializer.go:52 +0x129
  1126. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 314 [sleep]:
  1127. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f50654c89763?, 0xc258eb?, 0xf1?, 0x69?, 0x10763a0?)
  1128. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc002325d30 sp=0xc002325d10 pc=0x48df0e
  1129. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x5f5e100)
  1130. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc002325d70 sp=0xc002325d30 pc=0x4be4a5
  1131. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).gossipDataRoutine(0xc00d37eab0, {0x40404c0?, 0xc000e96820}, 0x0?)
  1132. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:644 +0x975 fp=0xc002325fb0 sp=0xc002325d70 pc=0x108d4f5
  1133. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func1()
  1134. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:203 +0x2c fp=0xc002325fe0 sp=0xc002325fb0 pc=0x108a30c
  1135. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1136. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc002325fe8 sp=0xc002325fe0 pc=0x4c16a1
  1137. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 179
  1138. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:203 +0xf6
  1139. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 311 [select]:
  1140. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc002314f40?, 0x7?, 0xd0?, 0x16?, 0xc002314eca?)
  1141. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc002314d58 sp=0xc002314d38 pc=0x48df0e
  1142. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc002314f40, 0xc002314ebc, 0xc0c3b9bf50?, 0x0, 0xc00124f540?, 0x1)
  1143. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc002314e78 sp=0xc002314d58 pc=0x49e3e5
  1144. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).sendRoutine(0xc006c2c000)
  1145. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:432 +0x1b9 fp=0xc002314fc8 sp=0xc002314e78 pc=0xd6cc99
  1146. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart.func1()
  1147. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:231 +0x25 fp=0xc002314fe0 sp=0xc002314fc8 pc=0xd6b9c5
  1148. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1149. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc002314fe8 sp=0xc002314fe0 pc=0x4c16a1
  1150. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart in goroutine 179
  1151. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:231 +0x21b
  1152. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 169 [select, 118 minutes]:
  1153. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0000ccc80?, 0x2?, 0x50?, 0xcb?, 0xc0000ccc7c?)
  1154. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000ccad8 sp=0xc0000ccab8 pc=0x48df0e
  1155. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0000ccc80, 0xc0000ccc78, 0x0?, 0x0, 0x2?, 0x1)
  1156. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0000ccbf8 sp=0xc0000ccad8 pc=0x49e3e5
  1157. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*MultiplexTransport).Accept(0xc00c743e00, {{0xc00081a880, 0xa, 0x10}, 0xc00c4546d0, 0x0, 0xc00c4546e0, 0xc00e1edf80, 0xc00e1edfb0, 0xc00bac5dc0, ...})
  1158. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/transport.go:194 +0xa7 fp=0xc0000ccd20 sp=0xc0000ccbf8 pc=0xdb2467
  1159. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*Switch).acceptRoutine(0xc00db1f0e0)
  1160. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/switch.go:633 +0x175 fp=0xc0000ccfc8 sp=0xc0000ccd20 pc=0xdb07d5
  1161. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*Switch).OnStart.func1()
  1162. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/switch.go:241 +0x25 fp=0xc0000ccfe0 sp=0xc0000ccfc8 pc=0xdad765
  1163. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1164. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ccfe8 sp=0xc0000ccfe0 pc=0x4c16a1
  1165. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p.(*Switch).OnStart in goroutine 55
  1166. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/switch.go:241 +0x150
  1167. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2611625 [sleep]:
  1168. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f50652044d4e?, 0x332f61b?, 0x1a?, 0x0?, 0xc06302b200?)
  1169. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc002317ec8 sp=0xc002317ea8 pc=0x48df0e
  1170. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x5f5e100)
  1171. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc002317f08 sp=0xc002317ec8 pc=0x4be4a5
  1172. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).gossipVotesRoutine(0xc00d37eab0, {0x40404c0?, 0xc0b4e771e0}, 0xc08a7de750?)
  1173. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:768 +0x746 fp=0xc002317fb0 sp=0xc002317f08 pc=0x108ea06
  1174. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func2()
  1175. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:204 +0x2c fp=0xc002317fe0 sp=0xc002317fb0 pc=0x108a2ac
  1176. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1177. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc002317fe8 sp=0xc002317fe0 pc=0x4c16a1
  1178. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 2611756
  1179. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:204 +0x172
  1180. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 312 [IO wait]:
  1181. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x330669d?, 0xb?, 0x0?, 0x0?, 0xdf?)
  1182. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc037b15988 sp=0xc037b15968 pc=0x48df0e
  1183. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.netpollblock(0x4d77d8?, 0x4566e6?, 0x0?)
  1184. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:564 +0xf7 fp=0xc037b159c0 sp=0xc037b15988 pc=0x486857
  1185. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.runtime_pollWait(0x7fa7a5de24d8, 0x72)
  1186. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:343 +0x85 fp=0xc037b159e0 sp=0xc037b159c0 pc=0x4bb985
  1187. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).wait(0xc002300080?, 0xc020a67800?, 0x0)
  1188. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc037b15a08 sp=0xc037b159e0 pc=0x4fda27
  1189. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).waitRead(...)
  1190. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:89
  1191. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*FD).Read(0xc002300080, {0xc020a67800, 0x414, 0x800})
  1192. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_unix.go:164 +0x27a fp=0xc037b15aa0 sp=0xc037b15a08 pc=0x4fed1a
  1193. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*netFD).Read(0xc002300080, {0xc020a67800?, 0xc000e968f0?, 0xc101cbe060?})
  1194. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/fd_posix.go:55 +0x25 fp=0xc037b15ae8 sp=0xc037b15aa0 pc=0x584125
  1195. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*conn).Read(0xc0000c03d8, {0xc020a67800?, 0xc045441c68?, 0xc0efbdba40?})
  1196. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/net.go:179 +0x45 fp=0xc037b15b30 sp=0xc037b15ae8 pc=0x595625
  1197. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*TCPConn).Read(0xc0001a0cb8?, {0xc020a67800?, 0xc037b15b98?, 0x45df4c?})
  1198. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: <autogenerated>:1 +0x25 fp=0xc037b15b60 sp=0xc037b15b30 pc=0x5a70a5
  1199. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: io.ReadAtLeast({0x3fed020, 0xc0000c03d8}, {0xc020a67800, 0x414, 0x800}, 0x414)
  1200. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: io/io.go:335 +0x90 fp=0xc037b15ba8 sp=0xc037b15b60 pc=0x4f70b0
  1201. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: io.ReadFull(...)
  1202. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: io/io.go:354
  1203. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*SecretConnection).Read(0xc00279e280, {0xc0027c0000, 0x400, 0xc037b15d90?})
  1204. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/secret_connection.go:246 +0x26b fp=0xc037b15d10 sp=0xc037b15ba8 pc=0xd7000b
  1205. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: bufio.(*Reader).Read(0xc00059cc60, {0xc1fb509c10, 0x1, 0x7fa78f8e82d8?})
  1206. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: bufio/bufio.go:244 +0x197 fp=0xc037b15d48 sp=0xc037b15d10 pc=0x6faa97
  1207. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/libs/protoio.(*byteReader).ReadByte(0xc1cba0b860)
  1208. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/libs/protoio/io.go:93 +0x2f fp=0xc037b15d78 sp=0xc037b15d48 pc=0xa1238f
  1209. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: encoding/binary.ReadUvarint({0x3fee960, 0xc1cba0b860})
  1210. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: encoding/binary/varint.go:136 +0x82 fp=0xc037b15dc8 sp=0xc037b15d78 pc=0x5b4962
  1211. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/libs/protoio.(*varintReader).ReadMsg(0xc037b15f70, {0x400e600, 0xc0603a4150})
  1212. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/libs/protoio/reader.go:68 +0xd8 fp=0xc037b15e78 sp=0xc037b15dc8 pc=0xa124b8
  1213. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).recvRoutine(0xc006c2c000)
  1214. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:587 +0x165 fp=0xc037b15fc8 sp=0xc037b15e78 pc=0xd6d865
  1215. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart.func2()
  1216. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:232 +0x25 fp=0xc037b15fe0 sp=0xc037b15fc8 pc=0xd6b965
  1217. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1218. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc037b15fe8 sp=0xc037b15fe0 pc=0x4c16a1
  1219. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart in goroutine 179
  1220. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:232 +0x258
  1221. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 81 [select]:
  1222. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc00276ff40?, 0x7?, 0xe0?, 0xf?, 0xc00276feca?)
  1223. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc00276fd58 sp=0xc00276fd38 pc=0x48df0e
  1224. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc00276ff40, 0xc00276febc, 0xc0c4501df0?, 0x0, 0xc001432320?, 0x1)
  1225. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc00276fe78 sp=0xc00276fd58 pc=0x49e3e5
  1226. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).sendRoutine(0xc002360000)
  1227. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:432 +0x1b9 fp=0xc00276ffc8 sp=0xc00276fe78 pc=0xd6cc99
  1228. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart.func1()
  1229. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:231 +0x25 fp=0xc00276ffe0 sp=0xc00276ffc8 pc=0xd6b9c5
  1230. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1231. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00276ffe8 sp=0xc00276ffe0 pc=0x4c16a1
  1232. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart in goroutine 186
  1233. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:231 +0x21b
  1234. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 290 [IO wait]:
  1235. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x0?, 0xb?, 0x0?, 0x0?, 0xce?)
  1236. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc062dc7988 sp=0xc062dc7968 pc=0x48df0e
  1237. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.netpollblock(0x4d77d8?, 0x4566e6?, 0x0?)
  1238. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:564 +0xf7 fp=0xc062dc79c0 sp=0xc062dc7988 pc=0x486857
  1239. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.runtime_pollWait(0x7fa7a5de28b8, 0x72)
  1240. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:343 +0x85 fp=0xc062dc79e0 sp=0xc062dc79c0 pc=0x4bb985
  1241. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).wait(0xc0022b8200?, 0xc01c0e6800?, 0x0)
  1242. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc062dc7a08 sp=0xc062dc79e0 pc=0x4fda27
  1243. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).waitRead(...)
  1244. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:89
  1245. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*FD).Read(0xc0022b8200, {0xc01c0e6800, 0x414, 0x800})
  1246. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_unix.go:164 +0x27a fp=0xc062dc7aa0 sp=0xc062dc7a08 pc=0x4fed1a
  1247. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*netFD).Read(0xc0022b8200, {0xc01c0e6800?, 0xc00c625110?, 0xc0cab8e060?})
  1248. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/fd_posix.go:55 +0x25 fp=0xc062dc7ae8 sp=0xc062dc7aa0 pc=0x584125
  1249. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*conn).Read(0xc00c6da008, {0xc01c0e6800?, 0xc1bbcb6860?, 0xc0e6a1d1a0?})
  1250. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/net.go:179 +0x45 fp=0xc062dc7b30 sp=0xc062dc7ae8 pc=0x595625
  1251. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*TCPConn).Read(0xc0001a0cb8?, {0xc01c0e6800?, 0xc062dc7b98?, 0x45df4c?})
  1252. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: <autogenerated>:1 +0x25 fp=0xc062dc7b60 sp=0xc062dc7b30 pc=0x5a70a5
  1253. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: io.ReadAtLeast({0x3fed020, 0xc00c6da008}, {0xc01c0e6800, 0x414, 0x800}, 0x414)
  1254. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: io/io.go:335 +0x90 fp=0xc062dc7ba8 sp=0xc062dc7b60 pc=0x4f70b0
  1255. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: io.ReadFull(...)
  1256. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: io/io.go:354
  1257. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*SecretConnection).Read(0xc002300100, {0xc0006b2800, 0x400, 0xc062dc7d90?})
  1258. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/secret_connection.go:246 +0x26b fp=0xc062dc7d10 sp=0xc062dc7ba8 pc=0xd7000b
  1259. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: bufio.(*Reader).Read(0xc00ba830e0, {0xc21a2b8a80, 0x1, 0x7fa788c18af0?})
  1260. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: bufio/bufio.go:244 +0x197 fp=0xc062dc7d48 sp=0xc062dc7d10 pc=0x6faa97
  1261. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/libs/protoio.(*byteReader).ReadByte(0xc22ad34360)
  1262. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/libs/protoio/io.go:93 +0x2f fp=0xc062dc7d78 sp=0xc062dc7d48 pc=0xa1238f
  1263. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: encoding/binary.ReadUvarint({0x3fee960, 0xc22ad34360})
  1264. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: encoding/binary/varint.go:136 +0x82 fp=0xc062dc7dc8 sp=0xc062dc7d78 pc=0x5b4962
  1265. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/libs/protoio.(*varintReader).ReadMsg(0xc062dc7f70, {0x400e600, 0xc0bd1ff220})
  1266. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/libs/protoio/reader.go:68 +0xd8 fp=0xc062dc7e78 sp=0xc062dc7dc8 pc=0xa124b8
  1267. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).recvRoutine(0xc002360000)
  1268. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:587 +0x165 fp=0xc062dc7fc8 sp=0xc062dc7e78 pc=0xd6d865
  1269. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart.func2()
  1270. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:232 +0x25 fp=0xc062dc7fe0 sp=0xc062dc7fc8 pc=0xd6b965
  1271. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1272. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc062dc7fe8 sp=0xc062dc7fe0 pc=0x4c16a1
  1273. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart in goroutine 186
  1274. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:232 +0x258
  1275. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 291 [select]:
  1276. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc002773e98?, 0x2?, 0x0?, 0x0?, 0xc002773e64?)
  1277. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc002773c28 sp=0xc002773c08 pc=0x48df0e
  1278. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc002773e98, 0xc002773e60, 0xedd98a763?, 0x0, 0x56303e8?, 0x1)
  1279. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc002773d48 sp=0xc002773c28 pc=0x49e3e5
  1280. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*peer).metricsReporter(0xc00c625040)
  1281. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:372 +0xc5 fp=0xc002773fc8 sp=0xc002773d48 pc=0xdaae85
  1282. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*peer).OnStart.func1()
  1283. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:199 +0x25 fp=0xc002773fe0 sp=0xc002773fc8 pc=0xdaa165
  1284. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1285. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc002773fe8 sp=0xc002773fe0 pc=0x4c16a1
  1286. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p.(*peer).OnStart in goroutine 186
  1287. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:199 +0x66
  1288. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 292 [sleep]:
  1289. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f50654c888d4?, 0xc258eb?, 0xf1?, 0x69?, 0x10763a0?)
  1290. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc005cb1d30 sp=0xc005cb1d10 pc=0x48df0e
  1291. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x5f5e100)
  1292. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc005cb1d70 sp=0xc005cb1d30 pc=0x4be4a5
  1293. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).gossipDataRoutine(0xc00d37eab0, {0x40404c0?, 0xc00c625040}, 0xc00c4e9020?)
  1294. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:644 +0x975 fp=0xc005cb1fb0 sp=0xc005cb1d70 pc=0x108d4f5
  1295. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func1()
  1296. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:203 +0x2c fp=0xc005cb1fe0 sp=0xc005cb1fb0 pc=0x108a30c
  1297. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1298. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc005cb1fe8 sp=0xc005cb1fe0 pc=0x4c16a1
  1299. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 186
  1300. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:203 +0xf6
  1301. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 293 [sleep]:
  1302. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f50652048fd6?, 0x332f61b?, 0x1a?, 0x0?, 0xc06091dec0?)
  1303. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc002326ec8 sp=0xc002326ea8 pc=0x48df0e
  1304. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x5f5e100)
  1305. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc002326f08 sp=0xc002326ec8 pc=0x4be4a5
  1306. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).gossipVotesRoutine(0xc00d37eab0, {0x40404c0?, 0xc00c625040}, 0x0?)
  1307. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:768 +0x746 fp=0xc002326fb0 sp=0xc002326f08 pc=0x108ea06
  1308. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func2()
  1309. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:204 +0x2c fp=0xc002326fe0 sp=0xc002326fb0 pc=0x108a2ac
  1310. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1311. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc002326fe8 sp=0xc002326fe0 pc=0x4c16a1
  1312. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 186
  1313. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:204 +0x172
  1314. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 294 [sleep]:
  1315. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f506144fffc2?, 0x0?, 0x0?, 0x6f?, 0x10903e0?)
  1316. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc004d3fc10 sp=0xc004d3fbf0 pc=0x48df0e
  1317. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x77359400)
  1318. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc004d3fc50 sp=0xc004d3fc10 pc=0x4be4a5
  1319. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).queryMaj23Routine(0xc00d37eab0, {0x40404c0, 0xc00c625040}, 0x0?)
  1320. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:928 +0x58 fp=0xc004d3ffb0 sp=0xc004d3fc50 pc=0x108f0b8
  1321. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func3()
  1322. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:205 +0x2c fp=0xc004d3ffe0 sp=0xc004d3ffb0 pc=0x108a24c
  1323. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1324. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc004d3ffe8 sp=0xc004d3ffe0 pc=0x4c16a1
  1325. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 186
  1326. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:205 +0x1ea
  1327. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 295 [select, 118 minutes]:
  1328. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0023436e0?, 0x3?, 0x0?, 0x0?, 0xc00234366a?)
  1329. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0023434b8 sp=0xc002343498 pc=0x48df0e
  1330. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0023436e0, 0xc002343664, 0x0?, 0x0, 0x0?, 0x1)
  1331. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0023435d8 sp=0xc0023434b8 pc=0x49e3e5
  1332. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/evidence.(*Reactor).broadcastEvidenceRoutine(0xc00dacbc80, {0x40404c0, 0xc00c625040})
  1333. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:113 +0x13f fp=0xc0023437b8 sp=0xc0023435d8 pc=0x10deb9f
  1334. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/evidence.(*Reactor).AddPeer.func1()
  1335. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:66 +0x28 fp=0xc0023437e0 sp=0xc0023437b8 pc=0x10de5c8
  1336. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1337. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0023437e8 sp=0xc0023437e0 pc=0x4c16a1
  1338. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/evidence.(*Reactor).AddPeer in goroutine 186
  1339. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:66 +0x8c
  1340. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 313 [select]:
  1341. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc002327e98?, 0x2?, 0x0?, 0x0?, 0xc002327e64?)
  1342. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc002327c28 sp=0xc002327c08 pc=0x48df0e
  1343. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc002327e98, 0xc002327e60, 0xedd98a763?, 0x0, 0x5c79016?, 0x1)
  1344. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc002327d48 sp=0xc002327c28 pc=0x49e3e5
  1345. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*peer).metricsReporter(0xc000e96820)
  1346. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:372 +0xc5 fp=0xc002327fc8 sp=0xc002327d48 pc=0xdaae85
  1347. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*peer).OnStart.func1()
  1348. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:199 +0x25 fp=0xc002327fe0 sp=0xc002327fc8 pc=0xdaa165
  1349. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1350. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc002327fe8 sp=0xc002327fe0 pc=0x4c16a1
  1351. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p.(*peer).OnStart in goroutine 179
  1352. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:199 +0x66
  1353. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 306 [select]:
  1354. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc002770eb0?, 0x3?, 0x20?, 0x10?, 0xc002770e46?)
  1355. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc002770ce0 sp=0xc002770cc0 pc=0x48df0e
  1356. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc002770eb0, 0xc002770e40, 0xc002770e36?, 0x0, 0xc060a48c90?, 0x1)
  1357. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc002770e00 sp=0xc002770ce0 pc=0x49e3e5
  1358. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/mempool/v0.(*Reactor).broadcastTxRoutine(0xc00db12310, {0x40404c0?, 0xc00c625040?})
  1359. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:302 +0x3e5 fp=0xc002770f20 sp=0xc002770e00 pc=0x10e9b45
  1360. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/mempool/v0.(*Reactor).AddPeer.func1()
  1361. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:191 +0x1a5 fp=0xc002770fe0 sp=0xc002770f20 pc=0x10e8d45
  1362. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1363. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc002770fe8 sp=0xc002770fe0 pc=0x4c16a1
  1364. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/mempool/v0.(*Reactor).AddPeer in goroutine 186
  1365. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:157 +0xa5
  1366. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 315 [sleep]:
  1367. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f50652cb5b64?, 0x332f61b?, 0x1a?, 0x0?, 0xc062b61380?)
  1368. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc004d3dec8 sp=0xc004d3dea8 pc=0x48df0e
  1369. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x5f5e100)
  1370. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc004d3df08 sp=0xc004d3dec8 pc=0x4be4a5
  1371. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).gossipVotesRoutine(0xc00d37eab0, {0x40404c0?, 0xc000e96820}, 0x0?)
  1372. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:768 +0x746 fp=0xc004d3dfb0 sp=0xc004d3df08 pc=0x108ea06
  1373. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func2()
  1374. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:204 +0x2c fp=0xc004d3dfe0 sp=0xc004d3dfb0 pc=0x108a2ac
  1375. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1376. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc004d3dfe8 sp=0xc004d3dfe0 pc=0x4c16a1
  1377. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 179
  1378. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:204 +0x172
  1379. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 316 [sleep]:
  1380. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f5061b725ab3?, 0x0?, 0x80?, 0xb0?, 0x10903e0?)
  1381. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc002315c10 sp=0xc002315bf0 pc=0x48df0e
  1382. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x77359400)
  1383. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc002315c50 sp=0xc002315c10 pc=0x4be4a5
  1384. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).queryMaj23Routine(0xc00d37eab0, {0x40404c0, 0xc000e96820}, 0x0?)
  1385. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:928 +0x58 fp=0xc002315fb0 sp=0xc002315c50 pc=0x108f0b8
  1386. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func3()
  1387. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:205 +0x2c fp=0xc002315fe0 sp=0xc002315fb0 pc=0x108a24c
  1388. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1389. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc002315fe8 sp=0xc002315fe0 pc=0x4c16a1
  1390. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 179
  1391. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:205 +0x1ea
  1392. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 317 [select, 118 minutes]:
  1393. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0023406e0?, 0x3?, 0x0?, 0x0?, 0xc00234066a?)
  1394. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc002323cb8 sp=0xc002323c98 pc=0x48df0e
  1395. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc002323ee0, 0xc002340664, 0x0?, 0x0, 0x0?, 0x1)
  1396. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc002323dd8 sp=0xc002323cb8 pc=0x49e3e5
  1397. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/evidence.(*Reactor).broadcastEvidenceRoutine(0xc00dacbc80, {0x40404c0, 0xc000e96820})
  1398. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:113 +0x13f fp=0xc002323fb8 sp=0xc002323dd8 pc=0x10deb9f
  1399. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/evidence.(*Reactor).AddPeer.func1()
  1400. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:66 +0x28 fp=0xc002323fe0 sp=0xc002323fb8 pc=0x10de5c8
  1401. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1402. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc002323fe8 sp=0xc002323fe0 pc=0x4c16a1
  1403. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/evidence.(*Reactor).AddPeer in goroutine 179
  1404. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:66 +0x8c
  1405. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 318 [select]:
  1406. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc004d3beb0?, 0x3?, 0x20?, 0x10?, 0xc004d3be46?)
  1407. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc004d3bce0 sp=0xc004d3bcc0 pc=0x48df0e
  1408. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc004d3beb0, 0xc004d3be40, 0x0?, 0x0, 0xc0627b8a38?, 0x1)
  1409. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc004d3be00 sp=0xc004d3bce0 pc=0x49e3e5
  1410. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/mempool/v0.(*Reactor).broadcastTxRoutine(0xc00db12310, {0x40404c0?, 0xc000e96820?})
  1411. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:302 +0x3e5 fp=0xc004d3bf20 sp=0xc004d3be00 pc=0x10e9b45
  1412. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/mempool/v0.(*Reactor).AddPeer.func1()
  1413. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:191 +0x1a5 fp=0xc004d3bfe0 sp=0xc004d3bf20 pc=0x10e8d45
  1414. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1415. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc004d3bfe8 sp=0xc004d3bfe0 pc=0x4c16a1
  1416. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/mempool/v0.(*Reactor).AddPeer in goroutine 179
  1417. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:157 +0xa5
  1418. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2053459 [sleep]:
  1419. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f50654c8a09f?, 0xc258eb?, 0xf1?, 0x69?, 0x10763a0?)
  1420. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc381b03d30 sp=0xc381b03d10 pc=0x48df0e
  1421. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x5f5e100)
  1422. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc381b03d70 sp=0xc381b03d30 pc=0x4be4a5
  1423. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).gossipDataRoutine(0xc00d37eab0, {0x40404c0?, 0xc08a7de750}, 0xc03d2df2b0?)
  1424. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:644 +0x975 fp=0xc381b03fb0 sp=0xc381b03d70 pc=0x108d4f5
  1425. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func1()
  1426. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:203 +0x2c fp=0xc381b03fe0 sp=0xc381b03fb0 pc=0x108a30c
  1427. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1428. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc381b03fe8 sp=0xc381b03fe0 pc=0x4c16a1
  1429. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 2053081
  1430. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:203 +0xf6
  1431. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 656 [select]:
  1432. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc005be7f40?, 0x7?, 0xa0?, 0x17?, 0xc005be7eca?)
  1433. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc005be7d58 sp=0xc005be7d38 pc=0x48df0e
  1434. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc005be7f40, 0xc005be7ebc, 0xc0f096ce30?, 0x0, 0xc29d133ea0?, 0x1)
  1435. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc005be7e78 sp=0xc005be7d58 pc=0x49e3e5
  1436. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).sendRoutine(0xc0476962c0)
  1437. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:432 +0x1b9 fp=0xc005be7fc8 sp=0xc005be7e78 pc=0xd6cc99
  1438. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart.func1()
  1439. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:231 +0x25 fp=0xc005be7fe0 sp=0xc005be7fc8 pc=0xd6b9c5
  1440. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1441. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc005be7fe8 sp=0xc005be7fe0 pc=0x4c16a1
  1442. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart in goroutine 865
  1443. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:231 +0x21b
  1444. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 6398443 [sync.RWMutex.RLock]:
  1445. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x5faff7?, 0xc0011ef3b0?, 0x0?, 0x18?, 0xc01acef320?)
  1446. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc036a539b8 sp=0xc036a53998 pc=0x48df0e
  1447. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goparkunlock(...)
  1448. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:404
  1449. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.semacquire1(0xc00e1b009c, 0x5f?, 0x3, 0x0, 0x30?)
  1450. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/sema.go:160 +0x218 fp=0xc036a53a20 sp=0xc036a539b8 pc=0x49f418
  1451. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: sync.runtime_SemacquireRWMutexR(0x4011ec0?, 0x75?, 0xc0072adba8?)
  1452. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/sema.go:82 +0x25 fp=0xc036a53a58 sp=0xc036a53a20 pc=0x4bd405
  1453. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: sync.(*RWMutex).RLock(...)
  1454. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: sync/rwmutex.go:71
  1455. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).ReceiveEnvelope(0xc00d37eab0, {{0x40404c0, 0xc2134c3a00}, {0x4011ec0, 0xc0c8bec8f0}, 0x22})
  1456. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:345 +0x1525 fp=0xc036a53d60 sp=0xc036a53a58 pc=0x108b885
  1457. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.createMConnection.func1(0x22, {0xc01b610000, 0xbf, 0x2710})
  1458. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:425 +0x418 fp=0xc036a53e78 sp=0xc036a53d60 pc=0xdab658
  1459. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).recvRoutine(0xc0107b2f20)
  1460. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:648 +0x40f fp=0xc036a53fc8 sp=0xc036a53e78 pc=0xd6db0f
  1461. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart.func2()
  1462. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:232 +0x25 fp=0xc036a53fe0 sp=0xc036a53fc8 pc=0xd6b965
  1463. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1464. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc036a53fe8 sp=0xc036a53fe0 pc=0x4c16a1
  1465. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart in goroutine 6399561
  1466. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:232 +0x258
  1467. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2186343 [sleep]:
  1468. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f50654c8c14d?, 0xc258eb?, 0xf1?, 0x69?, 0x10763a0?)
  1469. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0024a5d30 sp=0xc0024a5d10 pc=0x48df0e
  1470. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x5f5e100)
  1471. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc0024a5d70 sp=0xc0024a5d30 pc=0x4be4a5
  1472. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).gossipDataRoutine(0xc00d37eab0, {0x40404c0?, 0xc0b55e7e10}, 0xc037155ba0?)
  1473. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:644 +0x975 fp=0xc0024a5fb0 sp=0xc0024a5d70 pc=0x108d4f5
  1474. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func1()
  1475. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:203 +0x2c fp=0xc0024a5fe0 sp=0xc0024a5fb0 pc=0x108a30c
  1476. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1477. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0024a5fe8 sp=0xc0024a5fe0 pc=0x4c16a1
  1478. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 2186303
  1479. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:203 +0xf6
  1480. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2611626 [sleep]:
  1481. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f50655099888?, 0x4011e00?, 0x0?, 0xea?, 0xc005be6c30?)
  1482. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc005be6c10 sp=0xc005be6bf0 pc=0x48df0e
  1483. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x77359400)
  1484. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc005be6c50 sp=0xc005be6c10 pc=0x4be4a5
  1485. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).queryMaj23Routine(0xc00d37eab0, {0x40404c0, 0xc0b4e771e0}, 0xc0b55e7e10?)
  1486. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:859 +0x314 fp=0xc005be6fb0 sp=0xc005be6c50 pc=0x108f374
  1487. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func3()
  1488. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:205 +0x2c fp=0xc005be6fe0 sp=0xc005be6fb0 pc=0x108a24c
  1489. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1490. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc005be6fe8 sp=0xc005be6fe0 pc=0x4c16a1
  1491. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 2611756
  1492. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:205 +0x1ea
  1493. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 272679 [sleep]:
  1494. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f50654c8a425?, 0xc258eb?, 0xf1?, 0x69?, 0x10763a0?)
  1495. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0e4f5ed30 sp=0xc0e4f5ed10 pc=0x48df0e
  1496. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x5f5e100)
  1497. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc0e4f5ed70 sp=0xc0e4f5ed30 pc=0x4be4a5
  1498. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).gossipDataRoutine(0xc00d37eab0, {0x40404c0?, 0xc03d2df2b0}, 0xc1f00c3640?)
  1499. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:644 +0x975 fp=0xc0e4f5efb0 sp=0xc0e4f5ed70 pc=0x108d4f5
  1500. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func1()
  1501. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:203 +0x2c fp=0xc0e4f5efe0 sp=0xc0e4f5efb0 pc=0x108a30c
  1502. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1503. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0e4f5efe8 sp=0xc0e4f5efe0 pc=0x4c16a1
  1504. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 272690
  1505. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:203 +0xf6
  1506. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 739 [IO wait]:
  1507. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x2f?, 0xb?, 0x0?, 0x0?, 0x13e?)
  1508. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc00db918f8 sp=0xc00db918d8 pc=0x48df0e
  1509. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.netpollblock(0x4d77d8?, 0x4566e6?, 0x0?)
  1510. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:564 +0xf7 fp=0xc00db91930 sp=0xc00db918f8 pc=0x486857
  1511. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.runtime_pollWait(0x7fa7a5de25d0, 0x72)
  1512. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:343 +0x85 fp=0xc00db91950 sp=0xc00db91930 pc=0x4bb985
  1513. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).wait(0xc03d650500?, 0xc041098000?, 0x0)
  1514. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc00db91978 sp=0xc00db91950 pc=0x4fda27
  1515. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).waitRead(...)
  1516. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:89
  1517. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*FD).Read(0xc03d650500, {0xc041098000, 0x1000, 0x1000})
  1518. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_unix.go:164 +0x27a fp=0xc00db91a10 sp=0xc00db91978 pc=0x4fed1a
  1519. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*netFD).Read(0xc03d650500, {0xc041098000?, 0x4fdee5?, 0x0?})
  1520. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/fd_posix.go:55 +0x25 fp=0xc00db91a58 sp=0xc00db91a10 pc=0x584125
  1521. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*conn).Read(0xc036ac30c0, {0xc041098000?, 0x0?, 0xc0404b6308?})
  1522. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/net.go:179 +0x45 fp=0xc00db91aa0 sp=0xc00db91a58 pc=0x595625
  1523. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*TCPConn).Read(0xc0404b6300?, {0xc041098000?, 0x0?, 0xc00db91ac0?})
  1524. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: <autogenerated>:1 +0x25 fp=0xc00db91ad0 sp=0xc00db91aa0 pc=0x5a70a5
  1525. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http.(*connReader).Read(0xc0404b6300, {0xc041098000, 0x1000, 0x1000})
  1526. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http/server.go:791 +0x14b fp=0xc00db91b20 sp=0xc00db91ad0 pc=0x77366b
  1527. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: bufio.(*Reader).fill(0xc041088240)
  1528. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: bufio/bufio.go:113 +0x103 fp=0xc00db91b58 sp=0xc00db91b20 pc=0x6fa563
  1529. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: bufio.(*Reader).Peek(0xc041088240, 0x4)
  1530. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: bufio/bufio.go:151 +0x53 fp=0xc00db91b78 sp=0xc00db91b58 pc=0x6fa693
  1531. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http.(*conn).serve(0xc0194f4bd0, {0x4016b98, 0xc00c64e240})
  1532. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http/server.go:2044 +0x75c fp=0xc00db91fb8 sp=0xc00db91b78 pc=0x77951c
  1533. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http.(*Server).Serve.func3()
  1534. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http/server.go:3086 +0x28 fp=0xc00db91fe0 sp=0xc00db91fb8 pc=0x77dce8
  1535. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1536. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00db91fe8 sp=0xc00db91fe0 pc=0x4c16a1
  1537. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by net/http.(*Server).Serve in goroutine 142
  1538. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http/server.go:3086 +0x5cb
  1539. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 272681 [sleep]:
  1540. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f5060cbc91cb?, 0x0?, 0x80?, 0xcd?, 0x10903e0?)
  1541. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc2434fdc10 sp=0xc2434fdbf0 pc=0x48df0e
  1542. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x77359400)
  1543. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc2434fdc50 sp=0xc2434fdc10 pc=0x4be4a5
  1544. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).queryMaj23Routine(0xc00d37eab0, {0x40404c0, 0xc03d2df2b0}, 0xc1db893040?)
  1545. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:928 +0x58 fp=0xc2434fdfb0 sp=0xc2434fdc50 pc=0x108f0b8
  1546. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func3()
  1547. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:205 +0x2c fp=0xc2434fdfe0 sp=0xc2434fdfb0 pc=0x108a24c
  1548. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1549. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc2434fdfe8 sp=0xc2434fdfe0 pc=0x4c16a1
  1550. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 272690
  1551. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:205 +0x1ea
  1552. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 6398446 [select]:
  1553. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc00f4abeb0?, 0x3?, 0x20?, 0x10?, 0xc00f4abe46?)
  1554. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc00f4abce0 sp=0xc00f4abcc0 pc=0x48df0e
  1555. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc00f4abeb0, 0xc00f4abe40, 0x0?, 0x0, 0xc0628410c8?, 0x1)
  1556. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc00f4abe00 sp=0xc00f4abce0 pc=0x49e3e5
  1557. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/mempool/v0.(*Reactor).broadcastTxRoutine(0xc00db12310, {0x40404c0?, 0xc2134c3a00?})
  1558. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:302 +0x3e5 fp=0xc00f4abf20 sp=0xc00f4abe00 pc=0x10e9b45
  1559. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/mempool/v0.(*Reactor).AddPeer.func1()
  1560. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:191 +0x1a5 fp=0xc00f4abfe0 sp=0xc00f4abf20 pc=0x10e8d45
  1561. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1562. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00f4abfe8 sp=0xc00f4abfe0 pc=0x4c16a1
  1563. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/mempool/v0.(*Reactor).AddPeer in goroutine 6399561
  1564. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:157 +0xa5
  1565. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 6398447 [sleep]:
  1566. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f5065409aea2?, 0xc258eb?, 0xf1?, 0x69?, 0x10763a0?)
  1567. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc01b5b5d30 sp=0xc01b5b5d10 pc=0x48df0e
  1568. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x5f5e100)
  1569. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc01b5b5d70 sp=0xc01b5b5d30 pc=0x4be4a5
  1570. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).gossipDataRoutine(0xc00d37eab0, {0x40404c0?, 0xc2134c3a00}, 0xc03d2df2b0?)
  1571. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:644 +0x975 fp=0xc01b5b5fb0 sp=0xc01b5b5d70 pc=0x108d4f5
  1572. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func1()
  1573. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:203 +0x2c fp=0xc01b5b5fe0 sp=0xc01b5b5fb0 pc=0x108a30c
  1574. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1575. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc01b5b5fe8 sp=0xc01b5b5fe0 pc=0x4c16a1
  1576. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 6399561
  1577. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:203 +0xf6
  1578. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 59354 [sleep]:
  1579. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f506558c9749?, 0x332f61b?, 0x1a?, 0x0?, 0xc062b61680?)
  1580. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc00231bec8 sp=0xc00231bea8 pc=0x48df0e
  1581. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x5f5e100)
  1582. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc00231bf08 sp=0xc00231bec8 pc=0x4be4a5
  1583. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).gossipVotesRoutine(0xc00d37eab0, {0x40404c0?, 0xc1db893040}, 0xc06622f860?)
  1584. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:768 +0x746 fp=0xc00231bfb0 sp=0xc00231bf08 pc=0x108ea06
  1585. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func2()
  1586. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:204 +0x2c fp=0xc00231bfe0 sp=0xc00231bfb0 pc=0x108a2ac
  1587. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1588. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00231bfe8 sp=0xc00231bfe0 pc=0x4c16a1
  1589. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 58675
  1590. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:204 +0x172
  1591. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2611621 [IO wait]:
  1592. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x0?, 0xb?, 0x0?, 0x0?, 0x19c?)
  1593. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc03621f988 sp=0xc03621f968 pc=0x48df0e
  1594. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.netpollblock(0x4d77d8?, 0x4566e6?, 0x0?)
  1595. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:564 +0xf7 fp=0xc03621f9c0 sp=0xc03621f988 pc=0x486857
  1596. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.runtime_pollWait(0x7fa78937bcb8, 0x72)
  1597. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:343 +0x85 fp=0xc03621f9e0 sp=0xc03621f9c0 pc=0x4bb985
  1598. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).wait(0xc051dc8a00?, 0xc100a00000?, 0x0)
  1599. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc03621fa08 sp=0xc03621f9e0 pc=0x4fda27
  1600. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).waitRead(...)
  1601. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:89
  1602. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*FD).Read(0xc051dc8a00, {0xc100a00000, 0x414, 0x800})
  1603. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_unix.go:164 +0x27a fp=0xc03621faa0 sp=0xc03621fa08 pc=0x4fed1a
  1604. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*netFD).Read(0xc051dc8a00, {0xc100a00000?, 0xc0b4e772b0?, 0xc0f78df5f0?})
  1605. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/fd_posix.go:55 +0x25 fp=0xc03621fae8 sp=0xc03621faa0 pc=0x584125
  1606. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*conn).Read(0xc051dc0580, {0xc100a00000?, 0xc20a98a640?, 0xc0b3051c98?})
  1607. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/net.go:179 +0x45 fp=0xc03621fb30 sp=0xc03621fae8 pc=0x595625
  1608. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*TCPConn).Read(0xc0001a0cb8?, {0xc100a00000?, 0xc03621fb98?, 0x45df4c?})
  1609. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: <autogenerated>:1 +0x25 fp=0xc03621fb60 sp=0xc03621fb30 pc=0x5a70a5
  1610. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: io.ReadAtLeast({0x3fed020, 0xc051dc0580}, {0xc100a00000, 0x414, 0x800}, 0x414)
  1611. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: io/io.go:335 +0x90 fp=0xc03621fba8 sp=0xc03621fb60 pc=0x4f70b0
  1612. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: io.ReadFull(...)
  1613. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: io/io.go:354
  1614. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*SecretConnection).Read(0xc051dc8a80, {0xc052674000, 0x400, 0xc03621fd90?})
  1615. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/secret_connection.go:246 +0x26b fp=0xc03621fd10 sp=0xc03621fba8 pc=0xd7000b
  1616. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: bufio.(*Reader).Read(0xc05261ae40, {0xc1fa761790, 0x1, 0x7fa788d2ea20?})
  1617. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: bufio/bufio.go:244 +0x197 fp=0xc03621fd48 sp=0xc03621fd10 pc=0x6faa97
  1618. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/libs/protoio.(*byteReader).ReadByte(0xc224d94750)
  1619. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/libs/protoio/io.go:93 +0x2f fp=0xc03621fd78 sp=0xc03621fd48 pc=0xa1238f
  1620. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: encoding/binary.ReadUvarint({0x3fee960, 0xc224d94750})
  1621. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: encoding/binary/varint.go:136 +0x82 fp=0xc03621fdc8 sp=0xc03621fd78 pc=0x5b4962
  1622. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/libs/protoio.(*varintReader).ReadMsg(0xc03621ff70, {0x400e600, 0xc0d927db20})
  1623. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/libs/protoio/reader.go:68 +0xd8 fp=0xc03621fe78 sp=0xc03621fdc8 pc=0xa124b8
  1624. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).recvRoutine(0xc05210e160)
  1625. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:587 +0x165 fp=0xc03621ffc8 sp=0xc03621fe78 pc=0xd6d865
  1626. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart.func2()
  1627. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:232 +0x25 fp=0xc03621ffe0 sp=0xc03621ffc8 pc=0xd6b965
  1628. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1629. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc03621ffe8 sp=0xc03621ffe0 pc=0x4c16a1
  1630. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart in goroutine 2611756
  1631. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:232 +0x258
  1632. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 59350 [sync.RWMutex.RLock]:
  1633. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x5faff7?, 0xc0011ef3b0?, 0x0?, 0x84?, 0xc03587d200?)
  1634. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0363299b8 sp=0xc036329998 pc=0x48df0e
  1635. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goparkunlock(...)
  1636. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:404
  1637. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.semacquire1(0xc00e1b009c, 0x5f?, 0x3, 0x0, 0x30?)
  1638. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/sema.go:160 +0x218 fp=0xc036329a20 sp=0xc0363299b8 pc=0x49f418
  1639. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: sync.runtime_SemacquireRWMutexR(0x4011ec0?, 0x75?, 0xc0072adba8?)
  1640. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/sema.go:82 +0x25 fp=0xc036329a58 sp=0xc036329a20 pc=0x4bd405
  1641. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: sync.(*RWMutex).RLock(...)
  1642. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: sync/rwmutex.go:71
  1643. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).ReceiveEnvelope(0xc00d37eab0, {{0x40404c0, 0xc1db893040}, {0x4011ec0, 0xc0a18dd068}, 0x22})
  1644. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:345 +0x1525 fp=0xc036329d60 sp=0xc036329a58 pc=0x108b885
  1645. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.createMConnection.func1(0x22, {0xc02f41f800, 0xbf, 0x2710})
  1646. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:425 +0x418 fp=0xc036329e78 sp=0xc036329d60 pc=0xdab658
  1647. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).recvRoutine(0xc0356f7e40)
  1648. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:648 +0x40f fp=0xc036329fc8 sp=0xc036329e78 pc=0xd6db0f
  1649. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart.func2()
  1650. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:232 +0x25 fp=0xc036329fe0 sp=0xc036329fc8 pc=0xd6b965
  1651. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1652. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc036329fe8 sp=0xc036329fe0 pc=0x4c16a1
  1653. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart in goroutine 58675
  1654. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:232 +0x258
  1655. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 59356 [select, 116 minutes]:
  1656. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc005c986e0?, 0x3?, 0xa8?, 0x2e?, 0xc005c9866a?)
  1657. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc005c984b8 sp=0xc005c98498 pc=0x48df0e
  1658. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc005c986e0, 0xc005c98664, 0xc035642ea0?, 0x0, 0xda0b85?, 0x1)
  1659. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc005c985d8 sp=0xc005c984b8 pc=0x49e3e5
  1660. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/evidence.(*Reactor).broadcastEvidenceRoutine(0xc00dacbc80, {0x40404c0, 0xc1db893040})
  1661. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:113 +0x13f fp=0xc005c987b8 sp=0xc005c985d8 pc=0x10deb9f
  1662. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/evidence.(*Reactor).AddPeer.func1()
  1663. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:66 +0x28 fp=0xc005c987e0 sp=0xc005c987b8 pc=0x10de5c8
  1664. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1665. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc005c987e8 sp=0xc005c987e0 pc=0x4c16a1
  1666. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/evidence.(*Reactor).AddPeer in goroutine 58675
  1667. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:66 +0x8c
  1668. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 998 [sleep]:
  1669. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f50614500acb?, 0x0?, 0x0?, 0x6f?, 0x10903e0?)
  1670. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc005cb2c10 sp=0xc005cb2bf0 pc=0x48df0e
  1671. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x77359400)
  1672. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc005cb2c50 sp=0xc005cb2c10 pc=0x4be4a5
  1673. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).queryMaj23Routine(0xc00d37eab0, {0x40404c0, 0xc037155ba0}, 0x0?)
  1674. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:928 +0x58 fp=0xc005cb2fb0 sp=0xc005cb2c50 pc=0x108f0b8
  1675. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func3()
  1676. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:205 +0x2c fp=0xc005cb2fe0 sp=0xc005cb2fb0 pc=0x108a24c
  1677. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1678. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc005cb2fe8 sp=0xc005cb2fe0 pc=0x4c16a1
  1679. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 865
  1680. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:205 +0x1ea
  1681. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 866 [IO wait, 118 minutes]:
  1682. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc00db8f8d8?, 0x468108?, 0x90?, 0xf8?, 0x504dbd?)
  1683. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc00db8f820 sp=0xc00db8f800 pc=0x48df0e
  1684. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.netpollblock(0x5?, 0x4566e6?, 0x0?)
  1685. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:564 +0xf7 fp=0xc00db8f858 sp=0xc00db8f820 pc=0x486857
  1686. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.runtime_pollWait(0x7fa7a5de22e8, 0x72)
  1687. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:343 +0x85 fp=0xc00db8f878 sp=0xc00db8f858 pc=0x4bb985
  1688. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).wait(0xc0fa716480?, 0x474dbc?, 0x0)
  1689. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc00db8f8a0 sp=0xc00db8f878 pc=0x4fda27
  1690. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).waitRead(...)
  1691. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:89
  1692. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*FD).Accept(0xc0fa716480)
  1693. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_unix.go:611 +0x2ac fp=0xc00db8f948 sp=0xc00db8f8a0 pc=0x502f0c
  1694. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*netFD).accept(0xc0fa716480)
  1695. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/fd_unix.go:172 +0x29 fp=0xc00db8fa00 sp=0xc00db8f948 pc=0x586149
  1696. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*TCPListener).accept(0xc00f18fc00)
  1697. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/tcpsock_posix.go:152 +0x1e fp=0xc00db8fa28 sp=0xc00db8fa00 pc=0x59e37e
  1698. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*TCPListener).Accept(0xc00f18fc00)
  1699. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/tcpsock.go:315 +0x30 fp=0xc00db8fa58 sp=0xc00db8fa28 pc=0x59d530
  1700. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: golang.org/x/net/netutil.(*limitListener).Accept(0xc00c022a20)
  1701. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: golang.org/x/net@v0.19.0/netutil/listen.go:63 +0x85 fp=0xc00db8fae8 sp=0xc00db8fa58 pc=0xda2545
  1702. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http.(*onceCloseListener).Accept(0x4016968?)
  1703. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: <autogenerated>:1 +0x24 fp=0xc00db8fb00 sp=0xc00db8fae8 pc=0x7a16a4
  1704. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http.(*Server).Serve(0xc2a05241e0, {0x400ac10, 0xc00c022a20})
  1705. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http/server.go:3056 +0x364 fp=0xc00db8fc30 sp=0xc00db8fb00 pc=0x77d924
  1706. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/rpc/jsonrpc/server.Serve({0x400ac10, 0xc00c022a20}, {0x3fec200, 0xc04d0e6240}, {0x4016d20, 0xc000a322f0}, 0xc00db8fd00)
  1707. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/rpc/jsonrpc/server/http_server.go:62 +0x2b4 fp=0xc00db8fcc0 sp=0xc00db8fc30 pc=0xf6b3f4
  1708. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk/server/api.(*Server).Start(_, {{{0xc000a91380, 0xa}, {0xc0007f2590, 0x6}, {0xc00429e27d, 0x3}, {0x3400894, 0x2}, 0x0, ...}, ...})
  1709. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/server/api/server.go:115 +0x3a7 fp=0xc00db8fd98 sp=0xc00db8fcc0 pc=0xfdf827
  1710. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk/server.startAPIserver.func1()
  1711. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/server/start.go:571 +0x59 fp=0xc00db8ffe0 sp=0xc00db8fd98 pc=0x133e959
  1712. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1713. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00db8ffe8 sp=0xc00db8ffe0 pc=0x4c16a1
  1714. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cosmos/cosmos-sdk/server.startAPIserver in goroutine 55
  1715. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/server/start.go:570 +0x845
  1716. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 59351 [select]:
  1717. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc2434ffe98?, 0x2?, 0x0?, 0x0?, 0xc2434ffe64?)
  1718. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc2434ffc28 sp=0xc2434ffc08 pc=0x48df0e
  1719. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc2434ffe98, 0xc2434ffe60, 0xedd98a817?, 0x0, 0x6e9c174?, 0x1)
  1720. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc2434ffd48 sp=0xc2434ffc28 pc=0x49e3e5
  1721. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*peer).metricsReporter(0xc1db893040)
  1722. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:372 +0xc5 fp=0xc2434fffc8 sp=0xc2434ffd48 pc=0xdaae85
  1723. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*peer).OnStart.func1()
  1724. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:199 +0x25 fp=0xc2434fffe0 sp=0xc2434fffc8 pc=0xdaa165
  1725. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1726. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc2434fffe8 sp=0xc2434fffe0 pc=0x4c16a1
  1727. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p.(*peer).OnStart in goroutine 58675
  1728. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:199 +0x66
  1729. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 286 [select, 118 minutes]:
  1730. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc005c4cf80?, 0x2?, 0x0?, 0x0?, 0xc005c4cf34?)
  1731. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc005c4cdc8 sp=0xc005c4cda8 pc=0x48df0e
  1732. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc005c4cf80, 0xc005c4cf30, 0x20001054597a0?, 0x0, 0x2000400010003?, 0x1)
  1733. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc005c4cee8 sp=0xc005c4cdc8 pc=0x49e3e5
  1734. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc29a273cc0, {0x4016bd0, 0xc22e03e050})
  1735. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: google.golang.org/grpc@v1.60.1/internal/grpcsync/callback_serializer.go:76 +0x115 fp=0xc005c4cfb8 sp=0xc005c4cee8 pc=0xac6455
  1736. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer.func1()
  1737. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: google.golang.org/grpc@v1.60.1/internal/grpcsync/callback_serializer.go:52 +0x28 fp=0xc005c4cfe0 sp=0xc005c4cfb8 pc=0xac62a8
  1738. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1739. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc005c4cfe8 sp=0xc005c4cfe0 pc=0x4c16a1
  1740. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 55
  1741. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: google.golang.org/grpc@v1.60.1/internal/grpcsync/callback_serializer.go:52 +0x129
  1742. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 999 [select, 118 minutes]:
  1743. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc005c5b6e0?, 0x3?, 0xac?, 0xe5?, 0xc005c5b66a?)
  1744. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc005c5b4b8 sp=0xc005c5b498 pc=0x48df0e
  1745. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc005c5b6e0, 0xc005c5b664, 0x3?, 0x0, 0xffffffffffffffff?, 0x1)
  1746. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc005c5b5d8 sp=0xc005c5b4b8 pc=0x49e3e5
  1747. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/evidence.(*Reactor).broadcastEvidenceRoutine(0xc00dacbc80, {0x40404c0, 0xc037155ba0})
  1748. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:113 +0x13f fp=0xc005c5b7b8 sp=0xc005c5b5d8 pc=0x10deb9f
  1749. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/evidence.(*Reactor).AddPeer.func1()
  1750. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:66 +0x28 fp=0xc005c5b7e0 sp=0xc005c5b7b8 pc=0x10de5c8
  1751. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1752. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc005c5b7e8 sp=0xc005c5b7e0 pc=0x4c16a1
  1753. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/evidence.(*Reactor).AddPeer in goroutine 865
  1754. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:66 +0x8c
  1755. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 657 [sync.RWMutex.RLock]:
  1756. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x5faff7?, 0xc0011ef3b0?, 0x0?, 0x66?, 0xc047692b40?)
  1757. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc01336f9b8 sp=0xc01336f998 pc=0x48df0e
  1758. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goparkunlock(...)
  1759. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:404
  1760. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.semacquire1(0xc00e1b009c, 0x5f?, 0x3, 0x0, 0x30?)
  1761. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/sema.go:160 +0x218 fp=0xc01336fa20 sp=0xc01336f9b8 pc=0x49f418
  1762. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: sync.runtime_SemacquireRWMutexR(0x4011ec0?, 0x75?, 0xc0072adba8?)
  1763. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/sema.go:82 +0x25 fp=0xc01336fa58 sp=0xc01336fa20 pc=0x4bd405
  1764. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: sync.(*RWMutex).RLock(...)
  1765. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: sync/rwmutex.go:71
  1766. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).ReceiveEnvelope(0xc00d37eab0, {{0x40404c0, 0xc037155ba0}, {0x4011ec0, 0xc0c8becc20}, 0x22})
  1767. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:345 +0x1525 fp=0xc01336fd60 sp=0xc01336fa58 pc=0x108b885
  1768. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.createMConnection.func1(0x22, {0xc03a89b800, 0xc0, 0x2710})
  1769. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:425 +0x418 fp=0xc01336fe78 sp=0xc01336fd60 pc=0xdab658
  1770. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).recvRoutine(0xc0476962c0)
  1771. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:648 +0x40f fp=0xc01336ffc8 sp=0xc01336fe78 pc=0xd6db0f
  1772. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart.func2()
  1773. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:232 +0x25 fp=0xc01336ffe0 sp=0xc01336ffc8 pc=0xd6b965
  1774. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1775. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc01336ffe8 sp=0xc01336ffe0 pc=0x4c16a1
  1776. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart in goroutine 865
  1777. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:232 +0x258
  1778. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 994 [select]:
  1779. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc005be4e98?, 0x2?, 0x0?, 0x0?, 0xc005be4e64?)
  1780. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc005be4c28 sp=0xc005be4c08 pc=0x48df0e
  1781. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc005be4e98, 0xc005be4e60, 0xedd98a781?, 0x0, 0x4fcd64c?, 0x1)
  1782. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc005be4d48 sp=0xc005be4c28 pc=0x49e3e5
  1783. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*peer).metricsReporter(0xc037155ba0)
  1784. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:372 +0xc5 fp=0xc005be4fc8 sp=0xc005be4d48 pc=0xdaae85
  1785. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*peer).OnStart.func1()
  1786. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:199 +0x25 fp=0xc005be4fe0 sp=0xc005be4fc8 pc=0xdaa165
  1787. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1788. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc005be4fe8 sp=0xc005be4fe0 pc=0x4c16a1
  1789. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p.(*peer).OnStart in goroutine 865
  1790. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:199 +0x66
  1791. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 997 [sleep]:
  1792. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f506530820b3?, 0xc0633de200?, 0xf1?, 0x69?, 0x10763a0?)
  1793. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc381b02ec8 sp=0xc381b02ea8 pc=0x48df0e
  1794. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x5f5e100)
  1795. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc381b02f08 sp=0xc381b02ec8 pc=0x4be4a5
  1796. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).gossipVotesRoutine(0xc00d37eab0, {0x40404c0?, 0xc037155ba0}, 0xc002763d80?)
  1797. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:768 +0x746 fp=0xc381b02fb0 sp=0xc381b02f08 pc=0x108ea06
  1798. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func2()
  1799. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:204 +0x2c fp=0xc381b02fe0 sp=0xc381b02fb0 pc=0x108a2ac
  1800. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1801. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc381b02fe8 sp=0xc381b02fe0 pc=0x4c16a1
  1802. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 865
  1803. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:204 +0x172
  1804. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 996 [sleep]:
  1805. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f50654c8c518?, 0xc258eb?, 0xf1?, 0x69?, 0x10763a0?)
  1806. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc005be2d30 sp=0xc005be2d10 pc=0x48df0e
  1807. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x5f5e100)
  1808. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc005be2d70 sp=0xc005be2d30 pc=0x4be4a5
  1809. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).gossipDataRoutine(0xc00d37eab0, {0x40404c0?, 0xc037155ba0}, 0xc002763f00?)
  1810. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:644 +0x975 fp=0xc005be2fb0 sp=0xc005be2d70 pc=0x108d4f5
  1811. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func1()
  1812. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:203 +0x2c fp=0xc005be2fe0 sp=0xc005be2fb0 pc=0x108a30c
  1813. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1814. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc005be2fe8 sp=0xc005be2fe0 pc=0x4c16a1
  1815. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 865
  1816. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:203 +0xf6
  1817. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 995 [select]:
  1818. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc00f4a8eb0?, 0x3?, 0x20?, 0x10?, 0xc00f4a8e46?)
  1819. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc00f4a8ce0 sp=0xc00f4a8cc0 pc=0x48df0e
  1820. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc00f4a8eb0, 0xc00f4a8e40, 0x0?, 0x0, 0xc0624835a8?, 0x1)
  1821. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc00f4a8e00 sp=0xc00f4a8ce0 pc=0x49e3e5
  1822. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/mempool/v0.(*Reactor).broadcastTxRoutine(0xc00db12310, {0x40404c0?, 0xc037155ba0?})
  1823. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:302 +0x3e5 fp=0xc00f4a8f20 sp=0xc00f4a8e00 pc=0x10e9b45
  1824. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/mempool/v0.(*Reactor).AddPeer.func1()
  1825. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:191 +0x1a5 fp=0xc00f4a8fe0 sp=0xc00f4a8f20 pc=0x10e8d45
  1826. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1827. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00f4a8fe8 sp=0xc00f4a8fe0 pc=0x4c16a1
  1828. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/mempool/v0.(*Reactor).AddPeer in goroutine 865
  1829. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:157 +0xa5
  1830. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2186346 [select, 74 minutes]:
  1831. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc005c38ee0?, 0x3?, 0xf8?, 0x79?, 0xc005c38e6a?)
  1832. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc005c38cb8 sp=0xc005c38c98 pc=0x48df0e
  1833. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc005c38ee0, 0xc005c38e64, 0xc0c3a879e0?, 0x0, 0xda0b85?, 0x1)
  1834. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc005c38dd8 sp=0xc005c38cb8 pc=0x49e3e5
  1835. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/evidence.(*Reactor).broadcastEvidenceRoutine(0xc00dacbc80, {0x40404c0, 0xc0b55e7e10})
  1836. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:113 +0x13f fp=0xc005c38fb8 sp=0xc005c38dd8 pc=0x10deb9f
  1837. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/evidence.(*Reactor).AddPeer.func1()
  1838. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:66 +0x28 fp=0xc005c38fe0 sp=0xc005c38fb8 pc=0x10de5c8
  1839. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1840. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc005c38fe8 sp=0xc005c38fe0 pc=0x4c16a1
  1841. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/evidence.(*Reactor).AddPeer in goroutine 2186303
  1842. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:66 +0x8c
  1843. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 904 [IO wait, 118 minutes]:
  1844. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x4d9970?, 0xc002318c20?, 0x70?, 0x8c?, 0x504dbd?)
  1845. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc002318c00 sp=0xc002318be0 pc=0x48df0e
  1846. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.netpollblock(0x4bf712?, 0x4566e6?, 0x0?)
  1847. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:564 +0xf7 fp=0xc002318c38 sp=0xc002318c00 pc=0x486857
  1848. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.runtime_pollWait(0x7fa7a5de23e0, 0x72)
  1849. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:343 +0x85 fp=0xc002318c58 sp=0xc002318c38 pc=0x4bb985
  1850. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).wait(0xc065b96900?, 0x4?, 0x0)
  1851. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc002318c80 sp=0xc002318c58 pc=0x4fda27
  1852. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).waitRead(...)
  1853. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:89
  1854. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*FD).Accept(0xc065b96900)
  1855. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_unix.go:611 +0x2ac fp=0xc002318d28 sp=0xc002318c80 pc=0x502f0c
  1856. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*netFD).accept(0xc065b96900)
  1857. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/fd_unix.go:172 +0x29 fp=0xc002318de0 sp=0xc002318d28 pc=0x586149
  1858. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*TCPListener).accept(0xc082718980)
  1859. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/tcpsock_posix.go:152 +0x1e fp=0xc002318e08 sp=0xc002318de0 pc=0x59e37e
  1860. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*TCPListener).Accept(0xc082718980)
  1861. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/tcpsock.go:315 +0x30 fp=0xc002318e38 sp=0xc002318e08 pc=0x59d530
  1862. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: google.golang.org/grpc.(*Server).Serve(0xc065900200, {0x40092c0?, 0xc082718980})
  1863. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: google.golang.org/grpc@v1.60.1/server.go:871 +0x462 fp=0xc002318f78 sp=0xc002318e38 pc=0xb70bc2
  1864. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk/server/grpc.StartGRPCServer.func2()
  1865. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/server/grpc/server.go:70 +0x35 fp=0xc002318fe0 sp=0xc002318f78 pc=0x13312b5
  1866. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1867. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc002318fe8 sp=0xc002318fe0 pc=0x4c16a1
  1868. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cosmos/cosmos-sdk/server/grpc.StartGRPCServer in goroutine 55
  1869. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/server/grpc/server.go:69 +0x576
  1870. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 1077 [select]:
  1871. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0000cef98?, 0x2?, 0x0?, 0x0?, 0xc0000cef8c?)
  1872. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000cee30 sp=0xc0000cee10 pc=0x48df0e
  1873. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0000cef98, 0xc0000cef88, 0x2?, 0x0, 0xfe483b?, 0x1)
  1874. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0000cef50 sp=0xc0000cee30 pc=0x49e3e5
  1875. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*BaseWAL).processFlushTicks(0xc2306b77a0)
  1876. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/wal.go:144 +0x5d fp=0xc0000cefc8 sp=0xc0000cef50 pc=0x10aeedd
  1877. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*BaseWAL).OnStart.func1()
  1878. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/wal.go:138 +0x25 fp=0xc0000cefe0 sp=0xc0000cefc8 pc=0x10aee45
  1879. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1880. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000cefe8 sp=0xc0000cefe0 pc=0x4c16a1
  1881. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*BaseWAL).OnStart in goroutine 166
  1882. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/wal.go:138 +0xff
  1883. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2611624 [sleep]:
  1884. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f50654c8b322?, 0xc258eb?, 0xf1?, 0x69?, 0x10763a0?)
  1885. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc002772d30 sp=0xc002772d10 pc=0x48df0e
  1886. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x5f5e100)
  1887. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc002772d70 sp=0xc002772d30 pc=0x4be4a5
  1888. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).gossipDataRoutine(0xc00d37eab0, {0x40404c0?, 0xc0b4e771e0}, 0xc1db893040?)
  1889. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:644 +0x975 fp=0xc002772fb0 sp=0xc002772d70 pc=0x108d4f5
  1890. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func1()
  1891. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:203 +0x2c fp=0xc002772fe0 sp=0xc002772fb0 pc=0x108a30c
  1892. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1893. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc002772fe8 sp=0xc002772fe0 pc=0x4c16a1
  1894. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 2611756
  1895. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:203 +0xf6
  1896. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 272677 [sync.RWMutex.RLock]:
  1897. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x5faff7?, 0xc0011ef3b0?, 0xa0?, 0x71?, 0xc02a9d07e0?)
  1898. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc1028cf9b8 sp=0xc1028cf998 pc=0x48df0e
  1899. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goparkunlock(...)
  1900. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:404
  1901. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.semacquire1(0xc00e1b009c, 0x5f?, 0x3, 0x0, 0x30?)
  1902. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/sema.go:160 +0x218 fp=0xc1028cfa20 sp=0xc1028cf9b8 pc=0x49f418
  1903. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: sync.runtime_SemacquireRWMutexR(0x4011ec0?, 0x75?, 0xc0072adba8?)
  1904. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/sema.go:82 +0x25 fp=0xc1028cfa58 sp=0xc1028cfa20 pc=0x4bd405
  1905. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: sync.(*RWMutex).RLock(...)
  1906. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: sync/rwmutex.go:71
  1907. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).ReceiveEnvelope(0xc00d37eab0, {{0x40404c0, 0xc03d2df2b0}, {0x4011ec0, 0xc238f77b28}, 0x22})
  1908. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:345 +0x1525 fp=0xc1028cfd60 sp=0xc1028cfa58 pc=0x108b885
  1909. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.createMConnection.func1(0x22, {0xc021f78800, 0xbf, 0x2710})
  1910. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:425 +0x418 fp=0xc1028cfe78 sp=0xc1028cfd60 pc=0xdab658
  1911. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).recvRoutine(0xc0282aba20)
  1912. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:648 +0x40f fp=0xc1028cffc8 sp=0xc1028cfe78 pc=0xd6db0f
  1913. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart.func2()
  1914. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:232 +0x25 fp=0xc1028cffe0 sp=0xc1028cffc8 pc=0xd6b965
  1915. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1916. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc1028cffe8 sp=0xc1028cffe0 pc=0x4c16a1
  1917. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart in goroutine 272690
  1918. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:232 +0x258
  1919. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 1076 [select]:
  1920. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc03e40ff90?, 0x2?, 0xbd?, 0xbb?, 0xc03e40ff7c?)
  1921. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc03e40fe20 sp=0xc03e40fe00 pc=0x48df0e
  1922. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc03e40ff90, 0xc03e40ff78, 0x1?, 0x0, 0x5a32400?, 0x1)
  1923. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc03e40ff40 sp=0xc03e40fe20 pc=0x49e3e5
  1924. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/libs/autofile.(*Group).processTicks(0xc107e09550)
  1925. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/libs/autofile/group.go:242 +0xb9 fp=0xc03e40ffc8 sp=0xc03e40ff40 pc=0x107ccf9
  1926. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/libs/autofile.(*Group).OnStart.func1()
  1927. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/libs/autofile/group.go:140 +0x25 fp=0xc03e40ffe0 sp=0xc03e40ffc8 pc=0x107be65
  1928. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1929. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc03e40ffe8 sp=0xc03e40ffe0 pc=0x4c16a1
  1930. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/libs/autofile.(*Group).OnStart in goroutine 166
  1931. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/libs/autofile/group.go:140 +0x8b
  1932. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 267 [IO wait, 118 minutes]:
  1933. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc005be5c38?, 0x46021d?, 0x40?, 0x5c?, 0x504dbd?)
  1934. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc005be5bd0 sp=0xc005be5bb0 pc=0x48df0e
  1935. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.netpollblock(0x7fa795322050?, 0x4566e6?, 0x0?)
  1936. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:564 +0xf7 fp=0xc005be5c08 sp=0xc005be5bd0 pc=0x486857
  1937. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.runtime_pollWait(0x7fa7a5de29b0, 0x72)
  1938. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:343 +0x85 fp=0xc005be5c28 sp=0xc005be5c08 pc=0x4bb985
  1939. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).wait(0xc20aa3e180?, 0xc005be5d10?, 0x0)
  1940. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc005be5c50 sp=0xc005be5c28 pc=0x4fda27
  1941. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).waitRead(...)
  1942. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:89
  1943. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*FD).Accept(0xc20aa3e180)
  1944. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_unix.go:611 +0x2ac fp=0xc005be5cf8 sp=0xc005be5c50 pc=0x502f0c
  1945. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*netFD).accept(0xc20aa3e180)
  1946. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/fd_unix.go:172 +0x29 fp=0xc005be5db0 sp=0xc005be5cf8 pc=0x586149
  1947. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*TCPListener).accept(0xc20aa2a0e0)
  1948. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/tcpsock_posix.go:152 +0x1e fp=0xc005be5dd8 sp=0xc005be5db0 pc=0x59e37e
  1949. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*TCPListener).Accept(0xc20aa2a0e0)
  1950. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/tcpsock.go:315 +0x30 fp=0xc005be5e08 sp=0xc005be5dd8 pc=0x59d530
  1951. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http.(*onceCloseListener).Accept(0x4016968?)
  1952. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: <autogenerated>:1 +0x24 fp=0xc005be5e20 sp=0xc005be5e08 pc=0x7a16a4
  1953. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http.(*Server).Serve(0xc20aa40000, {0x40092c0, 0xc20aa2a0e0})
  1954. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http/server.go:3056 +0x364 fp=0xc005be5f50 sp=0xc005be5e20 pc=0x77d924
  1955. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http.(*Server).ListenAndServe(0xc20aa40000)
  1956. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/http/server.go:2985 +0x71 fp=0xc005be5f80 sp=0xc005be5f50 pc=0x77d591
  1957. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk/server/grpc.StartGRPCWeb.func2()
  1958. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/server/grpc/grpc_web.go:35 +0x25 fp=0xc005be5fe0 sp=0xc005be5f80 pc=0x1330aa5
  1959. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1960. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc005be5fe8 sp=0xc005be5fe0 pc=0x4c16a1
  1961. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cosmos/cosmos-sdk/server/grpc.StartGRPCWeb in goroutine 55
  1962. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cosmos/cosmos-sdk@v0.47.8/server/grpc/grpc_web.go:34 +0x1e8
  1963. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 1075 [select]:
  1964. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc005c83798?, 0x2?, 0x20?, 0xae?, 0xc005c83794?)
  1965. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc005c83640 sp=0xc005c83620 pc=0x48df0e
  1966. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc005c83798, 0xc005c83790, 0xfe483b?, 0x0, 0x3318b30?, 0x1)
  1967. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc005c83760 sp=0xc005c83640 pc=0x49e3e5
  1968. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/libs/autofile.(*AutoFile).closeFileRoutine(0xc242ba19a0)
  1969. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/libs/autofile/autofile.go:104 +0x65 fp=0xc005c837c8 sp=0xc005c83760 pc=0x107b1a5
  1970. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/libs/autofile.OpenAutoFile.func2()
  1971. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/libs/autofile/autofile.go:86 +0x25 fp=0xc005c837e0 sp=0xc005c837c8 pc=0x107b025
  1972. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1973. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc005c837e8 sp=0xc005c837e0 pc=0x4c16a1
  1974. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/libs/autofile.OpenAutoFile in goroutine 166
  1975. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/libs/autofile/autofile.go:86 +0x245
  1976. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 1078 [select]:
  1977. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc00233ff88?, 0x3?, 0xde?, 0xb0?, 0xc00233ff1a?)
  1978. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc00233fda8 sp=0xc00233fd88 pc=0x48df0e
  1979. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc00233ff88, 0xc00233ff14, 0x56ba05?, 0x0, 0x0?, 0x1)
  1980. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc00233fec8 sp=0xc00233fda8 pc=0x49e3e5
  1981. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*timeoutTicker).timeoutRoutine(0xc00dacbec0)
  1982. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/ticker.go:98 +0xd3 fp=0xc00233ffc8 sp=0xc00233fec8 pc=0x10ae173
  1983. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*timeoutTicker).OnStart.func1()
  1984. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/ticker.go:54 +0x25 fp=0xc00233ffe0 sp=0xc00233ffc8 pc=0x10adee5
  1985. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1986. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00233ffe8 sp=0xc00233ffe0 pc=0x4c16a1
  1987. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*timeoutTicker).OnStart in goroutine 166
  1988. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/ticker.go:54 +0x4f
  1989. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 272678 [select]:
  1990. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc005cb3e98?, 0x2?, 0x0?, 0x0?, 0xc005cb3e64?)
  1991. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc005cb3c28 sp=0xc005cb3c08 pc=0x48df0e
  1992. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc005cb3e98, 0xc005cb3e60, 0xedd98a961?, 0x0, 0x407fcee?, 0x1)
  1993. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc005cb3d48 sp=0xc005cb3c28 pc=0x49e3e5
  1994. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*peer).metricsReporter(0xc03d2df2b0)
  1995. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:372 +0xc5 fp=0xc005cb3fc8 sp=0xc005cb3d48 pc=0xdaae85
  1996. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*peer).OnStart.func1()
  1997. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:199 +0x25 fp=0xc005cb3fe0 sp=0xc005cb3fc8 pc=0xdaa165
  1998. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  1999. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc005cb3fe8 sp=0xc005cb3fe0 pc=0x4c16a1
  2000. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p.(*peer).OnStart in goroutine 272690
  2001. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:199 +0x66
  2002. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 1074 [chan receive, 118 minutes]:
  2003. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x1000000030002?, 0x2000400030000?, 0xa0?, 0x3e?, 0xc010973630?)
  2004. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc005ca1f00 sp=0xc005ca1ee0 pc=0x48df0e
  2005. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.chanrecv(0xc2306b76e0, 0xc005ca1fc0, 0x1)
  2006. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/chan.go:583 +0x3cd fp=0xc005ca1f78 sp=0xc005ca1f00 pc=0x45956d
  2007. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.chanrecv2(0x494ffc?, 0xc00d343aa0?)
  2008. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/chan.go:447 +0x12 fp=0xc005ca1fa0 sp=0xc005ca1f78 pc=0x459192
  2009. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/libs/autofile.OpenAutoFile.func1()
  2010. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/libs/autofile/autofile.go:81 +0x47 fp=0xc005ca1fe0 sp=0xc005ca1fa0 pc=0x107b0a7
  2011. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2012. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc005ca1fe8 sp=0xc005ca1fe0 pc=0x4c16a1
  2013. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/libs/autofile.OpenAutoFile in goroutine 166
  2014. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/libs/autofile/autofile.go:80 +0x205
  2015. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2053460 [sleep]:
  2016. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f5065265ac23?, 0x332f61b?, 0x1a?, 0x0?, 0xc062b61080?)
  2017. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc2434fbec8 sp=0xc2434fbea8 pc=0x48df0e
  2018. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x5f5e100)
  2019. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc2434fbf08 sp=0xc2434fbec8 pc=0x4be4a5
  2020. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).gossipVotesRoutine(0xc00d37eab0, {0x40404c0?, 0xc08a7de750}, 0xc00c625040?)
  2021. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:768 +0x746 fp=0xc2434fbfb0 sp=0xc2434fbf08 pc=0x108ea06
  2022. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func2()
  2023. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:204 +0x2c fp=0xc2434fbfe0 sp=0xc2434fbfb0 pc=0x108a2ac
  2024. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2025. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc2434fbfe8 sp=0xc2434fbfe0 pc=0x4c16a1
  2026. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 2053081
  2027. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:204 +0x172
  2028. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 6398442 [select]:
  2029. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0024a4f40?, 0x7?, 0x0?, 0x57?, 0xc0024a4eca?)
  2030. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0024a4d58 sp=0xc0024a4d38 pc=0x48df0e
  2031. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0024a4f40, 0xc0024a4ebc, 0x1?, 0x0, 0x100000000000002?, 0x1)
  2032. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0024a4e78 sp=0xc0024a4d58 pc=0x49e3e5
  2033. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).sendRoutine(0xc0107b2f20)
  2034. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:432 +0x1b9 fp=0xc0024a4fc8 sp=0xc0024a4e78 pc=0xd6cc99
  2035. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart.func1()
  2036. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:231 +0x25 fp=0xc0024a4fe0 sp=0xc0024a4fc8 pc=0xd6b9c5
  2037. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2038. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0024a4fe8 sp=0xc0024a4fe0 pc=0x4c16a1
  2039. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart in goroutine 6399561
  2040. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:231 +0x21b
  2041. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 59352 [select]:
  2042. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc2434feeb0?, 0x3?, 0x20?, 0x10?, 0xc2434fee46?)
  2043. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc2434fece0 sp=0xc2434fecc0 pc=0x48df0e
  2044. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc2434feeb0, 0xc2434fee40, 0x0?, 0x0, 0xc0626c3548?, 0x1)
  2045. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc2434fee00 sp=0xc2434fece0 pc=0x49e3e5
  2046. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/mempool/v0.(*Reactor).broadcastTxRoutine(0xc00db12310, {0x40404c0?, 0xc1db893040?})
  2047. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:302 +0x3e5 fp=0xc2434fef20 sp=0xc2434fee00 pc=0x10e9b45
  2048. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/mempool/v0.(*Reactor).AddPeer.func1()
  2049. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:191 +0x1a5 fp=0xc2434fefe0 sp=0xc2434fef20 pc=0x10e8d45
  2050. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2051. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc2434fefe8 sp=0xc2434fefe0 pc=0x4c16a1
  2052. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/mempool/v0.(*Reactor).AddPeer in goroutine 58675
  2053. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:157 +0xa5
  2054. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2186344 [sleep]:
  2055. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f50653d6ee86?, 0x332f61b?, 0x1a?, 0x0?, 0xc0630c2180?)
  2056. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc2434faec8 sp=0xc2434faea8 pc=0x48df0e
  2057. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x5f5e100)
  2058. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc2434faf08 sp=0xc2434faec8 pc=0x4be4a5
  2059. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).gossipVotesRoutine(0xc00d37eab0, {0x40404c0?, 0xc0b55e7e10}, 0xc08a7de750?)
  2060. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:768 +0x746 fp=0xc2434fafb0 sp=0xc2434faf08 pc=0x108ea06
  2061. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func2()
  2062. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:204 +0x2c fp=0xc2434fafe0 sp=0xc2434fafb0 pc=0x108a2ac
  2063. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2064. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc2434fafe8 sp=0xc2434fafe0 pc=0x4c16a1
  2065. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 2186303
  2066. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:204 +0x172
  2067. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 272682 [select, 110 minutes]:
  2068. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0060b16e0?, 0x3?, 0x68?, 0xc3?, 0xc0060b166a?)
  2069. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0060b14b8 sp=0xc0060b1498 pc=0x48df0e
  2070. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0060b16e0, 0xc0060b1664, 0xc02a99c360?, 0x0, 0xda0b85?, 0x1)
  2071. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0060b15d8 sp=0xc0060b14b8 pc=0x49e3e5
  2072. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/evidence.(*Reactor).broadcastEvidenceRoutine(0xc00dacbc80, {0x40404c0, 0xc03d2df2b0})
  2073. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:113 +0x13f fp=0xc0060b17b8 sp=0xc0060b15d8 pc=0x10deb9f
  2074. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/evidence.(*Reactor).AddPeer.func1()
  2075. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:66 +0x28 fp=0xc0060b17e0 sp=0xc0060b17b8 pc=0x10de5c8
  2076. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2077. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0060b17e8 sp=0xc0060b17e0 pc=0x4c16a1
  2078. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/evidence.(*Reactor).AddPeer in goroutine 272690
  2079. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:66 +0x8c
  2080. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2186345 [sleep]:
  2081. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f505eac08aca?, 0x0?, 0xc0?, 0x3?, 0x10903e0?)
  2082. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc03538cc10 sp=0xc03538cbf0 pc=0x48df0e
  2083. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x77359400)
  2084. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc03538cc50 sp=0xc03538cc10 pc=0x4be4a5
  2085. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).queryMaj23Routine(0xc00d37eab0, {0x40404c0, 0xc0b55e7e10}, 0xc037155ba0?)
  2086. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:928 +0x58 fp=0xc03538cfb0 sp=0xc03538cc50 pc=0x108f0b8
  2087. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func3()
  2088. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:205 +0x2c fp=0xc03538cfe0 sp=0xc03538cfb0 pc=0x108a24c
  2089. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2090. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc03538cfe8 sp=0xc03538cfe0 pc=0x4c16a1
  2091. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 2186303
  2092. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:205 +0x1ea
  2093. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2611623 [select]:
  2094. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc010e06eb0?, 0x3?, 0x20?, 0x10?, 0xc010e06e46?)
  2095. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc010e06ce0 sp=0xc010e06cc0 pc=0x48df0e
  2096. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc010e06eb0, 0xc010e06e40, 0x0?, 0x0, 0xc062714d80?, 0x1)
  2097. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc010e06e00 sp=0xc010e06ce0 pc=0x49e3e5
  2098. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/mempool/v0.(*Reactor).broadcastTxRoutine(0xc00db12310, {0x40404c0?, 0xc0b4e771e0?})
  2099. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:302 +0x3e5 fp=0xc010e06f20 sp=0xc010e06e00 pc=0x10e9b45
  2100. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/mempool/v0.(*Reactor).AddPeer.func1()
  2101. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:191 +0x1a5 fp=0xc010e06fe0 sp=0xc010e06f20 pc=0x10e8d45
  2102. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2103. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc010e06fe8 sp=0xc010e06fe0 pc=0x4c16a1
  2104. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/mempool/v0.(*Reactor).AddPeer in goroutine 2611756
  2105. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:157 +0xa5
  2106. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2611622 [select]:
  2107. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc035388e98?, 0x2?, 0x0?, 0x0?, 0xc035388e64?)
  2108. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc035388c28 sp=0xc035388c08 pc=0x48df0e
  2109. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc035388e98, 0xc035388e60, 0xedd98b40b?, 0x0, 0x2a043d8?, 0x1)
  2110. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc035388d48 sp=0xc035388c28 pc=0x49e3e5
  2111. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*peer).metricsReporter(0xc0b4e771e0)
  2112. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:372 +0xc5 fp=0xc035388fc8 sp=0xc035388d48 pc=0xdaae85
  2113. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*peer).OnStart.func1()
  2114. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:199 +0x25 fp=0xc035388fe0 sp=0xc035388fc8 pc=0xdaa165
  2115. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2116. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc035388fe8 sp=0xc035388fe0 pc=0x4c16a1
  2117. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p.(*peer).OnStart in goroutine 2611756
  2118. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:199 +0x66
  2119. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 59353 [sleep]:
  2120. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f50654c8bf25?, 0xc258eb?, 0xf1?, 0x69?, 0x10763a0?)
  2121. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc2434fcd30 sp=0xc2434fcd10 pc=0x48df0e
  2122. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x5f5e100)
  2123. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc2434fcd70 sp=0xc2434fcd30 pc=0x4be4a5
  2124. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).gossipDataRoutine(0xc00d37eab0, {0x40404c0?, 0xc1db893040}, 0xc037155ba0?)
  2125. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:644 +0x975 fp=0xc2434fcfb0 sp=0xc2434fcd70 pc=0x108d4f5
  2126. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func1()
  2127. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:203 +0x2c fp=0xc2434fcfe0 sp=0xc2434fcfb0 pc=0x108a30c
  2128. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2129. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc2434fcfe8 sp=0xc2434fcfe0 pc=0x4c16a1
  2130. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 58675
  2131. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:203 +0xf6
  2132. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 272680 [sleep]:
  2133. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f50656d77448?, 0xc0635db360?, 0xf1?, 0x69?, 0x10763a0?)
  2134. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0000d2ec8 sp=0xc0000d2ea8 pc=0x48df0e
  2135. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x5f5e100)
  2136. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc0000d2f08 sp=0xc0000d2ec8 pc=0x4be4a5
  2137. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).gossipVotesRoutine(0xc00d37eab0, {0x40404c0?, 0xc03d2df2b0}, 0xc000e96820?)
  2138. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:768 +0x746 fp=0xc0000d2fb0 sp=0xc0000d2f08 pc=0x108ea06
  2139. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func2()
  2140. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:204 +0x2c fp=0xc0000d2fe0 sp=0xc0000d2fb0 pc=0x108a2ac
  2141. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2142. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0000d2fe8 sp=0xc0000d2fe0 pc=0x4c16a1
  2143. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 272690
  2144. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:204 +0x172
  2145. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 59349 [select]:
  2146. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc005cb5f40?, 0x7?, 0x0?, 0x57?, 0xc005cb5eca?)
  2147. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc005cb5d58 sp=0xc005cb5d38 pc=0x48df0e
  2148. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc005cb5f40, 0xc005cb5ebc, 0xc0c3b9bf80?, 0x0, 0x100000000000002?, 0x1)
  2149. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc005cb5e78 sp=0xc005cb5d58 pc=0x49e3e5
  2150. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).sendRoutine(0xc0356f7e40)
  2151. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:432 +0x1b9 fp=0xc005cb5fc8 sp=0xc005cb5e78 pc=0xd6cc99
  2152. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart.func1()
  2153. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:231 +0x25 fp=0xc005cb5fe0 sp=0xc005cb5fc8 pc=0xd6b9c5
  2154. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2155. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc005cb5fe8 sp=0xc005cb5fe0 pc=0x4c16a1
  2156. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart in goroutine 58675
  2157. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:231 +0x21b
  2158. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 59355 [sleep]:
  2159. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f5061b727686?, 0x0?, 0x80?, 0xb0?, 0x10903e0?)
  2160. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0024a1c10 sp=0xc0024a1bf0 pc=0x48df0e
  2161. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x77359400)
  2162. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc0024a1c50 sp=0xc0024a1c10 pc=0x4be4a5
  2163. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).queryMaj23Routine(0xc00d37eab0, {0x40404c0, 0xc1db893040}, 0xc000e96820?)
  2164. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:928 +0x58 fp=0xc0024a1fb0 sp=0xc0024a1c50 pc=0x108f0b8
  2165. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func3()
  2166. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:205 +0x2c fp=0xc0024a1fe0 sp=0xc0024a1fb0 pc=0x108a24c
  2167. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2168. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0024a1fe8 sp=0xc0024a1fe0 pc=0x4c16a1
  2169. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 58675
  2170. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:205 +0x1ea
  2171. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2053457 [select]:
  2172. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc032587e98?, 0x2?, 0x0?, 0x0?, 0xc032587e64?)
  2173. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc032587c28 sp=0xc032587c08 pc=0x48df0e
  2174. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc032587e98, 0xc032587e60, 0xedd98b195?, 0x0, 0x32e37c9?, 0x1)
  2175. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc032587d48 sp=0xc032587c28 pc=0x49e3e5
  2176. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*peer).metricsReporter(0xc08a7de750)
  2177. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:372 +0xc5 fp=0xc032587fc8 sp=0xc032587d48 pc=0xdaae85
  2178. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*peer).OnStart.func1()
  2179. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:199 +0x25 fp=0xc032587fe0 sp=0xc032587fc8 pc=0xdaa165
  2180. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2181. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc032587fe8 sp=0xc032587fe0 pc=0x4c16a1
  2182. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p.(*peer).OnStart in goroutine 2053081
  2183. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:199 +0x66
  2184. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 6398448 [sleep]:
  2185. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f506561fb395?, 0x332f61b?, 0x1a?, 0x0?, 0xc062b61740?)
  2186. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc01b5b9ec8 sp=0xc01b5b9ea8 pc=0x48df0e
  2187. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x5f5e100)
  2188. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc01b5b9f08 sp=0xc01b5b9ec8 pc=0x4be4a5
  2189. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).gossipVotesRoutine(0xc00d37eab0, {0x40404c0?, 0xc2134c3a00}, 0xc03d2df2b0?)
  2190. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:768 +0x746 fp=0xc01b5b9fb0 sp=0xc01b5b9f08 pc=0x108ea06
  2191. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func2()
  2192. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:204 +0x2c fp=0xc01b5b9fe0 sp=0xc01b5b9fb0 pc=0x108a2ac
  2193. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2194. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc01b5b9fe8 sp=0xc01b5b9fe0 pc=0x4c16a1
  2195. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 6399561
  2196. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:204 +0x172
  2197. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 272683 [select]:
  2198. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc381b00eb0?, 0x3?, 0x20?, 0x10?, 0xc381b00e46?)
  2199. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc381b00ce0 sp=0xc381b00cc0 pc=0x48df0e
  2200. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc381b00eb0, 0xc381b00e40, 0x0?, 0x0, 0xc0626737a0?, 0x1)
  2201. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc381b00e00 sp=0xc381b00ce0 pc=0x49e3e5
  2202. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/mempool/v0.(*Reactor).broadcastTxRoutine(0xc00db12310, {0x40404c0?, 0xc03d2df2b0?})
  2203. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:302 +0x3e5 fp=0xc381b00f20 sp=0xc381b00e00 pc=0x10e9b45
  2204. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/mempool/v0.(*Reactor).AddPeer.func1()
  2205. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:191 +0x1a5 fp=0xc381b00fe0 sp=0xc381b00f20 pc=0x10e8d45
  2206. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2207. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc381b00fe8 sp=0xc381b00fe0 pc=0x4c16a1
  2208. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/mempool/v0.(*Reactor).AddPeer in goroutine 272690
  2209. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:157 +0xa5
  2210. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2053462 [select, 76 minutes]:
  2211. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc07093e6e0?, 0x3?, 0x68?, 0x43?, 0xc07093e66a?)
  2212. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc07093e4b8 sp=0xc07093e498 pc=0x48df0e
  2213. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc07093e6e0, 0xc07093e664, 0xc07b484360?, 0x0, 0xda0b85?, 0x1)
  2214. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc07093e5d8 sp=0xc07093e4b8 pc=0x49e3e5
  2215. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/evidence.(*Reactor).broadcastEvidenceRoutine(0xc00dacbc80, {0x40404c0, 0xc08a7de750})
  2216. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:113 +0x13f fp=0xc07093e7b8 sp=0xc07093e5d8 pc=0x10deb9f
  2217. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/evidence.(*Reactor).AddPeer.func1()
  2218. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:66 +0x28 fp=0xc07093e7e0 sp=0xc07093e7b8 pc=0x10de5c8
  2219. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2220. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc07093e7e8 sp=0xc07093e7e0 pc=0x4c16a1
  2221. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/evidence.(*Reactor).AddPeer in goroutine 2053081
  2222. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:66 +0x8c
  2223. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2186340 [runnable]:
  2224. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x330669d?, 0xb?, 0x0?, 0x0?, 0x202?)
  2225. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc062b59988 sp=0xc062b59968 pc=0x48df0e
  2226. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.netpollblock(0x4d77d8?, 0x4566e6?, 0x0?)
  2227. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:564 +0xf7 fp=0xc062b599c0 sp=0xc062b59988 pc=0x486857
  2228. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.runtime_pollWait(0x7fa7a5de27c0, 0x72)
  2229. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/netpoll.go:343 +0x85 fp=0xc062b599e0 sp=0xc062b599c0 pc=0x4bb985
  2230. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).wait(0xc0c403c700?, 0xc0df7cc000?, 0x0)
  2231. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc062b59a08 sp=0xc062b599e0 pc=0x4fda27
  2232. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*pollDesc).waitRead(...)
  2233. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_poll_runtime.go:89
  2234. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll.(*FD).Read(0xc0c403c700, {0xc0df7cc000, 0x414, 0x800})
  2235. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: internal/poll/fd_unix.go:164 +0x27a fp=0xc062b59aa0 sp=0xc062b59a08 pc=0x4fed1a
  2236. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*netFD).Read(0xc0c403c700, {0xc0df7cc000?, 0xc0b55e7ee0?, 0xc0cab8e060?})
  2237. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/fd_posix.go:55 +0x25 fp=0xc062b59ae8 sp=0xc062b59aa0 pc=0x584125
  2238. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*conn).Read(0xc0c3e529b0, {0xc0df7cc000?, 0xc0af04cb70?, 0xc037aa7800?})
  2239. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net/net.go:179 +0x45 fp=0xc062b59b30 sp=0xc062b59ae8 pc=0x595625
  2240. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: net.(*TCPConn).Read(0xc0001a0cb8?, {0xc0df7cc000?, 0xc062b59b98?, 0x45df4c?})
  2241. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: <autogenerated>:1 +0x25 fp=0xc062b59b60 sp=0xc062b59b30 pc=0x5a70a5
  2242. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: io.ReadAtLeast({0x3fed020, 0xc0c3e529b0}, {0xc0df7cc000, 0x414, 0x800}, 0x414)
  2243. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: io/io.go:335 +0x90 fp=0xc062b59ba8 sp=0xc062b59b60 pc=0x4f70b0
  2244. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: io.ReadFull(...)
  2245. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: io/io.go:354
  2246. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*SecretConnection).Read(0xc0c4128700, {0xc0bd4f2400, 0x400, 0xc062b59d90?})
  2247. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/secret_connection.go:246 +0x26b fp=0xc062b59d10 sp=0xc062b59ba8 pc=0xd7000b
  2248. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: bufio.(*Reader).Read(0xc0c4548c00, {0xc01ab49948, 0x1, 0x7fa788c0f4a8?})
  2249. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: bufio/bufio.go:244 +0x197 fp=0xc062b59d48 sp=0xc062b59d10 pc=0x6faa97
  2250. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/libs/protoio.(*byteReader).ReadByte(0xc22a9c91d0)
  2251. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/libs/protoio/io.go:93 +0x2f fp=0xc062b59d78 sp=0xc062b59d48 pc=0xa1238f
  2252. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: encoding/binary.ReadUvarint({0x3fee960, 0xc22a9c91d0})
  2253. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: encoding/binary/varint.go:136 +0x82 fp=0xc062b59dc8 sp=0xc062b59d78 pc=0x5b4962
  2254. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/libs/protoio.(*varintReader).ReadMsg(0xc062b59f70, {0x400e600, 0xc1d72a8670})
  2255. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/libs/protoio/reader.go:68 +0xd8 fp=0xc062b59e78 sp=0xc062b59dc8 pc=0xa124b8
  2256. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).recvRoutine(0xc0be632c60)
  2257. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:587 +0x165 fp=0xc062b59fc8 sp=0xc062b59e78 pc=0xd6d865
  2258. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart.func2()
  2259. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:232 +0x25 fp=0xc062b59fe0 sp=0xc062b59fc8 pc=0xd6b965
  2260. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2261. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc062b59fe8 sp=0xc062b59fe0 pc=0x4c16a1
  2262. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart in goroutine 2186303
  2263. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:232 +0x258
  2264. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2186339 [select]:
  2265. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc381b01f40?, 0x7?, 0xd0?, 0x9d?, 0xc381b01eca?)
  2266. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc381b01d58 sp=0xc381b01d38 pc=0x48df0e
  2267. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc381b01f40, 0xc381b01ebc, 0xc0c4501e60?, 0x0, 0x100000000000002?, 0x1)
  2268. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc381b01e78 sp=0xc381b01d58 pc=0x49e3e5
  2269. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).sendRoutine(0xc0be632c60)
  2270. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:432 +0x1b9 fp=0xc381b01fc8 sp=0xc381b01e78 pc=0xd6cc99
  2271. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart.func1()
  2272. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:231 +0x25 fp=0xc381b01fe0 sp=0xc381b01fc8 pc=0xd6b9c5
  2273. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2274. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc381b01fe8 sp=0xc381b01fe0 pc=0x4c16a1
  2275. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart in goroutine 2186303
  2276. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:231 +0x21b
  2277. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 272676 [select]:
  2278. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0024a3f40?, 0x7?, 0xf0?, 0x16?, 0xc0024a3eca?)
  2279. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0024a3d58 sp=0xc0024a3d38 pc=0x48df0e
  2280. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0024a3f40, 0xc0024a3ebc, 0xc221d99d80?, 0x0, 0x7?, 0x1)
  2281. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0024a3e78 sp=0xc0024a3d58 pc=0x49e3e5
  2282. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).sendRoutine(0xc0282aba20)
  2283. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:432 +0x1b9 fp=0xc0024a3fc8 sp=0xc0024a3e78 pc=0xd6cc99
  2284. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart.func1()
  2285. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:231 +0x25 fp=0xc0024a3fe0 sp=0xc0024a3fc8 pc=0xd6b9c5
  2286. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2287. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0024a3fe8 sp=0xc0024a3fe0 pc=0x4c16a1
  2288. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart in goroutine 272690
  2289. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:231 +0x21b
  2290. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2186342 [select]:
  2291. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc03258ceb0?, 0x3?, 0x20?, 0x10?, 0xc03258ce46?)
  2292. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc03258cce0 sp=0xc03258ccc0 pc=0x48df0e
  2293. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc03258ceb0, 0xc03258ce40, 0x0?, 0x0, 0xc062923770?, 0x1)
  2294. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc03258ce00 sp=0xc03258cce0 pc=0x49e3e5
  2295. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/mempool/v0.(*Reactor).broadcastTxRoutine(0xc00db12310, {0x40404c0?, 0xc0b55e7e10?})
  2296. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:302 +0x3e5 fp=0xc03258cf20 sp=0xc03258ce00 pc=0x10e9b45
  2297. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/mempool/v0.(*Reactor).AddPeer.func1()
  2298. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:191 +0x1a5 fp=0xc03258cfe0 sp=0xc03258cf20 pc=0x10e8d45
  2299. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2300. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc03258cfe8 sp=0xc03258cfe0 pc=0x4c16a1
  2301. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/mempool/v0.(*Reactor).AddPeer in goroutine 2186303
  2302. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:157 +0xa5
  2303. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2053456 [sync.RWMutex.RLock]:
  2304. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x5faff7?, 0xc0011ef3b0?, 0x0?, 0x9?, 0xc07aae1d40?)
  2305. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc028c759b8 sp=0xc028c75998 pc=0x48df0e
  2306. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goparkunlock(...)
  2307. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:404
  2308. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.semacquire1(0xc00e1b009c, 0x5f?, 0x3, 0x0, 0x30?)
  2309. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/sema.go:160 +0x218 fp=0xc028c75a20 sp=0xc028c759b8 pc=0x49f418
  2310. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: sync.runtime_SemacquireRWMutexR(0x4011ec0?, 0x75?, 0xc0072adba8?)
  2311. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/sema.go:82 +0x25 fp=0xc028c75a58 sp=0xc028c75a20 pc=0x4bd405
  2312. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: sync.(*RWMutex).RLock(...)
  2313. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: sync/rwmutex.go:71
  2314. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).ReceiveEnvelope(0xc00d37eab0, {{0x40404c0, 0xc08a7de750}, {0x4011ec0, 0xc0c8bec7a0}, 0x22})
  2315. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:345 +0x1525 fp=0xc028c75d60 sp=0xc028c75a58 pc=0x108b885
  2316. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.createMConnection.func1(0x22, {0xc06b7ff800, 0xbe, 0x2710})
  2317. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:425 +0x418 fp=0xc028c75e78 sp=0xc028c75d60 pc=0xdab658
  2318. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).recvRoutine(0xc073603a20)
  2319. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:648 +0x40f fp=0xc028c75fc8 sp=0xc028c75e78 pc=0xd6db0f
  2320. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart.func2()
  2321. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:232 +0x25 fp=0xc028c75fe0 sp=0xc028c75fc8 pc=0xd6b965
  2322. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2323. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc028c75fe8 sp=0xc028c75fe0 pc=0x4c16a1
  2324. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart in goroutine 2053081
  2325. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:232 +0x258
  2326. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 1432586 [select, 88 minutes]:
  2327. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc005c75f80?, 0x2?, 0x1?, 0x0?, 0xc005c75f34?)
  2328. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc005c75dc8 sp=0xc005c75da8 pc=0x48df0e
  2329. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc005c75f80, 0xc005c75f30, 0xc005c75f90?, 0x0, 0x2?, 0x1)
  2330. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc005c75ee8 sp=0xc005c75dc8 pc=0x49e3e5
  2331. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: google.golang.org/grpc/internal/grpcsync.(*CallbackSerializer).run(0xc04222b320, {0x4016bd0, 0xc0909fecd0})
  2332. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: google.golang.org/grpc@v1.60.1/internal/grpcsync/callback_serializer.go:76 +0x115 fp=0xc005c75fb8 sp=0xc005c75ee8 pc=0xac6455
  2333. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer.func1()
  2334. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: google.golang.org/grpc@v1.60.1/internal/grpcsync/callback_serializer.go:52 +0x28 fp=0xc005c75fe0 sp=0xc005c75fb8 pc=0xac62a8
  2335. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2336. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc005c75fe8 sp=0xc005c75fe0 pc=0x4c16a1
  2337. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by google.golang.org/grpc/internal/grpcsync.NewCallbackSerializer in goroutine 1432584
  2338. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: google.golang.org/grpc@v1.60.1/internal/grpcsync/callback_serializer.go:52 +0x129
  2339. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2186341 [select]:
  2340. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc00f4a4e98?, 0x2?, 0x0?, 0x0?, 0xc00f4a4e64?)
  2341. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc00f4a4c28 sp=0xc00f4a4c08 pc=0x48df0e
  2342. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc00f4a4e98, 0xc00f4a4e60, 0xedd98b22b?, 0x0, 0x5bc90ad?, 0x1)
  2343. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc00f4a4d48 sp=0xc00f4a4c28 pc=0x49e3e5
  2344. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*peer).metricsReporter(0xc0b55e7e10)
  2345. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:372 +0xc5 fp=0xc00f4a4fc8 sp=0xc00f4a4d48 pc=0xdaae85
  2346. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*peer).OnStart.func1()
  2347. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:199 +0x25 fp=0xc00f4a4fe0 sp=0xc00f4a4fc8 pc=0xdaa165
  2348. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2349. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00f4a4fe8 sp=0xc00f4a4fe0 pc=0x4c16a1
  2350. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p.(*peer).OnStart in goroutine 2186303
  2351. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:199 +0x66
  2352. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2053458 [select]:
  2353. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc07ad48eb0?, 0x3?, 0x20?, 0x10?, 0xc07ad48e46?)
  2354. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc07ad48ce0 sp=0xc07ad48cc0 pc=0x48df0e
  2355. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc07ad48eb0, 0xc07ad48e40, 0x0?, 0x0, 0xc062841068?, 0x1)
  2356. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc07ad48e00 sp=0xc07ad48ce0 pc=0x49e3e5
  2357. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/mempool/v0.(*Reactor).broadcastTxRoutine(0xc00db12310, {0x40404c0?, 0xc08a7de750?})
  2358. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:302 +0x3e5 fp=0xc07ad48f20 sp=0xc07ad48e00 pc=0x10e9b45
  2359. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/mempool/v0.(*Reactor).AddPeer.func1()
  2360. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:191 +0x1a5 fp=0xc07ad48fe0 sp=0xc07ad48f20 pc=0x10e8d45
  2361. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2362. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc07ad48fe8 sp=0xc07ad48fe0 pc=0x4c16a1
  2363. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/mempool/v0.(*Reactor).AddPeer in goroutine 2053081
  2364. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/mempool/v0/reactor.go:157 +0xa5
  2365. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2053461 [sleep]:
  2366. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f505eac0827e?, 0x0?, 0xc0?, 0x3?, 0x10903e0?)
  2367. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc07ad45c10 sp=0xc07ad45bf0 pc=0x48df0e
  2368. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x77359400)
  2369. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc07ad45c50 sp=0xc07ad45c10 pc=0x4be4a5
  2370. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).queryMaj23Routine(0xc00d37eab0, {0x40404c0, 0xc08a7de750}, 0xc000e96820?)
  2371. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:928 +0x58 fp=0xc07ad45fb0 sp=0xc07ad45c50 pc=0x108f0b8
  2372. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func3()
  2373. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:205 +0x2c fp=0xc07ad45fe0 sp=0xc07ad45fb0 pc=0x108a24c
  2374. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2375. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc07ad45fe8 sp=0xc07ad45fe0 pc=0x4c16a1
  2376. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 2053081
  2377. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:205 +0x1ea
  2378. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2053455 [select]:
  2379. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc03258af40?, 0x7?, 0xc0?, 0x8c?, 0xc03258aeca?)
  2380. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc03258ad58 sp=0xc03258ad38 pc=0x48df0e
  2381. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc03258af40, 0xc03258aebc, 0xc0f096ce70?, 0x0, 0x100000000000002?, 0x1)
  2382. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc03258ae78 sp=0xc03258ad58 pc=0x49e3e5
  2383. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).sendRoutine(0xc073603a20)
  2384. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:432 +0x1b9 fp=0xc03258afc8 sp=0xc03258ae78 pc=0xd6cc99
  2385. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart.func1()
  2386. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:231 +0x25 fp=0xc03258afe0 sp=0xc03258afc8 pc=0xd6b9c5
  2387. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2388. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc03258afe8 sp=0xc03258afe0 pc=0x4c16a1
  2389. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart in goroutine 2053081
  2390. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:231 +0x21b
  2391. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 6398444 [select]:
  2392. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc035386e98?, 0x2?, 0x0?, 0x0?, 0xc035386e64?)
  2393. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc035386c28 sp=0xc035386c08 pc=0x48df0e
  2394. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc035386e98, 0xc035386e60, 0xedd98c329?, 0x0, 0xb3577?, 0x1)
  2395. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc035386d48 sp=0xc035386c28 pc=0x49e3e5
  2396. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*peer).metricsReporter(0xc2134c3a00)
  2397. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:372 +0xc5 fp=0xc035386fc8 sp=0xc035386d48 pc=0xdaae85
  2398. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p.(*peer).OnStart.func1()
  2399. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:199 +0x25 fp=0xc035386fe0 sp=0xc035386fc8 pc=0xdaa165
  2400. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2401. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc035386fe8 sp=0xc035386fe0 pc=0x4c16a1
  2402. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p.(*peer).OnStart in goroutine 6399561
  2403. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/peer.go:199 +0x66
  2404. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2611620 [select]:
  2405. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc00276ef40?, 0x7?, 0x50?, 0x87?, 0xc00276eeca?)
  2406. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc00276ed58 sp=0xc00276ed38 pc=0x48df0e
  2407. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc00276ef40, 0xc00276eebc, 0xc0c3b9bf00?, 0x0, 0xc0e9f8b220?, 0x1)
  2408. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc00276ee78 sp=0xc00276ed58 pc=0x49e3e5
  2409. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).sendRoutine(0xc05210e160)
  2410. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:432 +0x1b9 fp=0xc00276efc8 sp=0xc00276ee78 pc=0xd6cc99
  2411. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart.func1()
  2412. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:231 +0x25 fp=0xc00276efe0 sp=0xc00276efc8 pc=0xd6b9c5
  2413. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2414. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00276efe8 sp=0xc00276efe0 pc=0x4c16a1
  2415. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/p2p/conn.(*MConnection).OnStart in goroutine 2611756
  2416. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/p2p/conn/connection.go:231 +0x21b
  2417. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 2611627 [select, 66 minutes]:
  2418. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc0023456e0?, 0x3?, 0x68?, 0x8c?, 0xc00234566a?)
  2419. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc0023454b8 sp=0xc002345498 pc=0x48df0e
  2420. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc0023456e0, 0xc002345664, 0xc052118c60?, 0x0, 0xda0b85?, 0x1)
  2421. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc0023455d8 sp=0xc0023454b8 pc=0x49e3e5
  2422. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/evidence.(*Reactor).broadcastEvidenceRoutine(0xc00dacbc80, {0x40404c0, 0xc0b4e771e0})
  2423. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:113 +0x13f fp=0xc0023457b8 sp=0xc0023455d8 pc=0x10deb9f
  2424. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/evidence.(*Reactor).AddPeer.func1()
  2425. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:66 +0x28 fp=0xc0023457e0 sp=0xc0023457b8 pc=0x10de5c8
  2426. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2427. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc0023457e8 sp=0xc0023457e0 pc=0x4c16a1
  2428. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/evidence.(*Reactor).AddPeer in goroutine 2611756
  2429. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:66 +0x8c
  2430. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 6398449 [sleep]:
  2431. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0x21f506283c401c?, 0x0?, 0x80?, 0xa1?, 0x10903e0?)
  2432. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc00276cc10 sp=0xc00276cbf0 pc=0x48df0e
  2433. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: time.Sleep(0x77359400)
  2434. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/time.go:195 +0x125 fp=0xc00276cc50 sp=0xc00276cc10 pc=0x4be4a5
  2435. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).queryMaj23Routine(0xc00d37eab0, {0x40404c0, 0xc2134c3a00}, 0xc0a33e4d20?)
  2436. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:928 +0x58 fp=0xc00276cfb0 sp=0xc00276cc50 pc=0x108f0b8
  2437. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer.func3()
  2438. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:205 +0x2c fp=0xc00276cfe0 sp=0xc00276cfb0 pc=0x108a24c
  2439. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2440. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc00276cfe8 sp=0xc00276cfe0 pc=0x4c16a1
  2441. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/consensus.(*Reactor).AddPeer in goroutine 6399561
  2442. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/consensus/reactor.go:205 +0x1ea
  2443. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: goroutine 6398445 [select]:
  2444. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.gopark(0xc005c88ee0?, 0x3?, 0x28?, 0xea?, 0xc005c88e6a?)
  2445. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/proc.go:398 +0xce fp=0xc005c88cb8 sp=0xc005c88c98 pc=0x48df0e
  2446. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.selectgo(0xc005c88ee0, 0xc005c88e64, 0xc01aceea20?, 0x0, 0xda0b85?, 0x1)
  2447. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/select.go:327 +0x725 fp=0xc005c88dd8 sp=0xc005c88cb8 pc=0x49e3e5
  2448. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/evidence.(*Reactor).broadcastEvidenceRoutine(0xc00dacbc80, {0x40404c0, 0xc2134c3a00})
  2449. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:113 +0x13f fp=0xc005c88fb8 sp=0xc005c88dd8 pc=0x10deb9f
  2450. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft/evidence.(*Reactor).AddPeer.func1()
  2451. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:66 +0x28 fp=0xc005c88fe0 sp=0xc005c88fb8 pc=0x10de5c8
  2452. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime.goexit()
  2453. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: runtime/asm_amd64.s:1650 +0x1 fp=0xc005c88fe8 sp=0xc005c88fe0 pc=0x4c16a1
  2454. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: created by github.com/cometbft/cometbft/evidence.(*Reactor).AddPeer in goroutine 6399561
  2455. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: github.com/cometbft/cometbft@v0.37.4/evidence/reactor.go:66 +0x8c
  2456. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: rax 0x0
  2457. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: rbx 0x0
  2458. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: rcx 0x2d20401
  2459. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: rdx 0x0
  2460. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: rdi 0x2
  2461. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: rsi 0x7fa7a59fd690
  2462. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: rbp 0x7fa7a59fd690
  2463. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: rsp 0x7fa7a59fd688
  2464. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: r8 0x5a6f4a0
  2465. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: r9 0x40000000
  2466. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: r10 0x8
  2467. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: r11 0x246
  2468. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: r12 0x7fa7995e6340
  2469. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: r13 0x1
  2470. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: r14 0x7fa799149090
  2471. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: r15 0x2d182b0
  2472. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: rip 0x2d20401
  2473. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: rflags 0x246
  2474. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: cs 0x33
  2475. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: fs 0x0
  2476. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950774]: gs 0x0
  2477. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950755]: Error: exit status 2
  2478. Mar 29 14:12:20 validator-03.sc.com cosmovisor[1950755]: 2:12PM ERR error="exit status 2" module=cosmovisor
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!