Coder Social home page Coder Social logo

Why node sync so slow? about klaytn HOT 4 CLOSED

klaytn avatar klaytn commented on June 3, 2024
Why node sync so slow?

from klaytn.

Comments (4)

Jongsic avatar Jongsic commented on June 3, 2024

This is full log

INFO[02/03,05:17:35 Z] [33] [Dial] Add dial candidate from static nodes  id=0fa5c281933268fc NodeType=2 ip=15.164.117.136 port="[32323 32324]"
INFO[02/03,05:17:35 Z] [33] [Dial] Add dial candidate from static nodes  id=10035abc98acdd40 NodeType=2 ip=18.139.72.99   port="[32323 32324]"
INFO[02/03,05:17:35 Z] [33] Added a multichannel P2P Peer             id=0fa5c281933268fc conn=trusted-staticdial peerID=0fa5c281933268fc
INFO[02/03,05:17:36 Z] [33] Added a multichannel P2P Peer             id=10035abc98acdd40 conn=trusted-staticdial peerID=10035abc98acdd40
INFO[02/03,05:17:36 Z] [33] [Dial] Add dial candidate from discovery nodes  id=ff08cb5323980f02 addr=15.164.48.246:32323
INFO[02/03,05:17:36 Z] [33] [Dial] Add dial candidate from discovery nodes  id=25f410cac9ea6979 addr=172.104.105.152:32323
INFO[02/03,05:17:36 Z] [33] [Dial] Add dial candidate from discovery nodes  id=8b63e0b35b1d9514 addr=52.79.42.169:32323
INFO[02/03,05:17:36 Z] [33] [Dial] Add dial candidate from discovery nodes  id=8eb66ed62beb98b2 addr=52.79.47.98:32323
INFO[02/03,05:17:37 Z] [41] Historical state regenerated              block=19231672 elapsed=4.322117398s nodeSize=19.88mB preimageSize=618.15kB
INFO[02/03,05:17:37 Z] [41] Regenerating historical state             block=19231617 target=19231673 remaining=56 elapsed=750ns
INFO[02/03,05:17:38 Z] [28] Block synchronisation started
INFO[02/03,05:17:38 Z] [49] Mining aborted due to sync
INFO[02/03,05:17:39 Z] [26] Refresh done.                             blockNum=19231200 hash=de9244…bed25d valSet.blockNum=19231744 stakingInfo.BlockNum=19094400
INFO[02/03,05:17:41 Z] [41] Historical state regenerated              block=19231673 elapsed=4.331306598s nodeSize=19.94mB preimageSize=619.68kB
INFO[02/03,05:17:41 Z] [41] Regenerating historical state             block=19231617 target=19231674 remaining=57 elapsed=802ns
INFO[02/03,05:17:45 Z] [41] Historical state regenerated              block=19231674 elapsed=3.736139103s nodeSize=19.95mB preimageSize=619.92kB
INFO[02/03,05:17:45 Z] [41] Regenerating historical state             block=19231617 target=19231675 remaining=58 elapsed=625ns
INFO[02/03,05:17:48 Z] [5] Imported new chain segment                number=19231692 hash=1ffe2f…192a68 blocks=76 txs=2651 elapsed=9.341s       trieDBSize=22.77mB mgas=423.719 mgasps=45.359
INFO[02/03,05:17:49 Z] [41] Historical state regenerated              block=19231675 elapsed=3.348341519s nodeSize=19.97mB preimageSize=620.50kB
INFO[02/03,05:17:49 Z] [41] Regenerating historical state             block=19231617 target=19231676 remaining=59 elapsed=712ns
INFO[02/03,05:17:51 Z] [33] [Dial] Add dial candidate from discovery nodes  id=c78a591de7c62b83 addr=54.65.228.15:32323
INFO[02/03,05:17:51 Z] [33] [Dial] Add dial candidate from discovery nodes  id=abe186b6b6f99f8f addr=54.180.183.222:32323
INFO[02/03,05:17:51 Z] [33] [Dial] Add dial candidate from discovery nodes  id=53065fbbb73b0454 addr=52.78.232.41:32323
INFO[02/03,05:17:51 Z] [33] [Dial] Add dial candidate from discovery nodes  id=663fe9d8efb8966d addr=107.155.56.28:32323
INFO[02/03,05:17:52 Z] [41] Historical state regenerated              block=19231676 elapsed=3.42352992s  nodeSize=19.99mB preimageSize=621.05kB
INFO[02/03,05:17:52 Z] [41] Regenerating historical state             block=19231617 target=19231677 remaining=60 elapsed=856ns
INFO[02/03,05:17:56 Z] [5] Imported new chain segment                number=19231726 hash=f969cc…8ad601 blocks=34 txs=1357 elapsed=8.021s       trieDBSize=32.41mB mgas=214.880 mgasps=26.788
INFO[02/03,05:17:56 Z] [41] Historical state regenerated              block=19231677 elapsed=3.779188339s nodeSize=20.01mB preimageSize=621.86kB
INFO[02/03,05:17:56 Z] [41] Regenerating historical state             block=19231617 target=19231678 remaining=61 elapsed=694ns
INFO[02/03,05:18:00 Z] [41] Historical state regenerated              block=19231678 elapsed=3.645570762s nodeSize=20.15mB preimageSize=626.02kB
INFO[02/03,05:18:00 Z] [41] Regenerating historical state             block=19231617 target=19231679 remaining=62 elapsed=901ns
INFO[02/03,05:18:04 Z] [41] Historical state regenerated              block=19231679 elapsed=3.638469488s nodeSize=20.18mB preimageSize=626.89kB
INFO[02/03,05:18:04 Z] [41] Regenerating historical state             block=19231617 target=19231680 remaining=63 elapsed=651ns
INFO[02/03,05:18:04 Z] [5] Imported new chain segment                number=19231733 hash=4b67a4…53c92c blocks=7  txs=231  elapsed=8.706s       trieDBSize=33.21mB mgas=33.851  mgasps=3.888
INFO[02/03,05:18:06 Z] [33] [Dial] Add dial candidate from discovery nodes  id=6928d6ba8ebcfb53 addr=13.209.27.13:32323
INFO[02/03,05:18:06 Z] [33] [Dial] Add dial candidate from discovery nodes  id=f7e32806033519dd addr=40.115.19.81:32323
INFO[02/03,05:18:06 Z] [33] [Dial] Add dial candidate from discovery nodes  id=1f05305868c692cf addr=52.79.244.98:32323
INFO[02/03,05:18:06 Z] [33] [Dial] Add dial candidate from discovery nodes  id=82405257c4e64010 addr=13.209.84.76:32323
INFO[02/03,05:18:06 Z] [33] [Dial] Add dial candidate from discovery nodes  id=08b5e8165320c339 addr=52.78.232.41:32323
INFO[02/03,05:18:06 Z] [33] [Dial] Add dial candidate from discovery nodes  id=a141f1c578a0d935 addr=13.209.81.153:32323
INFO[02/03,05:18:08 Z] [41] Historical state regenerated              block=19231680 elapsed=3.764767831s nodeSize=20.19mB preimageSize=627.14kB
INFO[02/03,05:18:08 Z] [41] Regenerating historical state             block=19231617 target=19231681 remaining=64 elapsed=670ns
INFO[02/03,05:18:11 Z] [33] [Dial] Add dial candidate from discovery nodes  id=25f410cac9ea6979 addr=172.104.105.152:32323
INFO[02/03,05:18:11 Z] [33] [Dial] Add dial candidate from discovery nodes  id=e4e6f06aebcae80c addr=119.254.81.66:32323
INFO[02/03,05:18:11 Z] [41] Historical state regenerated              block=19231681 elapsed=3.70059208s  nodeSize=20.20mB preimageSize=627.32kB
INFO[02/03,05:18:12 Z] [41] Regenerating historical state             block=19231617 target=19231682 remaining=65 elapsed=775ns
INFO[02/03,05:18:15 Z] [41] Historical state regenerated              block=19231682 elapsed=3.536018704s nodeSize=20.23mB preimageSize=628.17kB
INFO[02/03,05:18:15 Z] [41] Regenerating historical state             block=19231617 target=19231683 remaining=66 elapsed=775ns
INFO[02/03,05:18:19 Z] [41] Historical state regenerated              block=19231683 elapsed=3.47908927s  nodeSize=20.28mB preimageSize=629.54kB
INFO[02/03,05:18:19 Z] [41] Regenerating historical state             block=19231617 target=19231684 remaining=67 elapsed=925ns
INFO[02/03,05:18:21 Z] [33] [Dial] Add dial candidate from discovery nodes  id=b2dd13b3a1d3cbef addr=13.209.79.71:32323
INFO[02/03,05:18:21 Z] [33] [Dial] Add dial candidate from discovery nodes  id=fed55e5b68fe2389 addr=18.139.52.104:32323
INFO[02/03,05:18:21 Z] [5] Imported new chain segment                number=19231734 hash=7256f0…528a26 blocks=1  txs=16   elapsed=16.961s      trieDBSize=32.99mB mgas=4.073   mgasps=0.240
INFO[02/03,05:18:23 Z] [41] Historical state regenerated              block=19231684 elapsed=3.838221004s nodeSize=20.30mB preimageSize=630.42kB
INFO[02/03,05:18:24 Z] [41] Regenerating historical state             block=19231617 target=19231685 remaining=68 elapsed=720ns
INFO[02/03,05:18:26 Z] [33] [Dial] Add dial candidate from discovery nodes  id=8a575f87151a07b4 addr=15.165.161.138:32323
INFO[02/03,05:18:28 Z] [41] Historical state regenerated              block=19231685 elapsed=3.638627745s nodeSize=20.96mB preimageSize=652.24kB
INFO[02/03,05:18:28 Z] [41] Regenerating historical state             block=19231617 target=19231686 remaining=69 elapsed=749ns
INFO[02/03,05:18:31 Z] [5] Imported new chain segment                number=19231736 hash=8567c9…6e0577 blocks=2  txs=65   elapsed=9.471s       trieDBSize=33.82mB mgas=14.351  mgasps=1.515
INFO[02/03,05:18:31 Z] [41] Historical state regenerated              block=19231686 elapsed=3.608295087s nodeSize=21.00mB preimageSize=653.46kB
INFO[02/03,05:18:31 Z] [41] Regenerating historical state             block=19231617 target=19231687 remaining=70 elapsed=927ns
INFO[02/03,05:18:35 Z] [41] Historical state regenerated              block=19231687 elapsed=3.748426602s nodeSize=21.00mB preimageSize=653.69kB
INFO[02/03,05:18:35 Z] [41] Regenerating historical state             block=19231617 target=19231688 remaining=71 elapsed=760ns
INFO[02/03,05:18:36 Z] [33] [Dial] Add dial candidate from discovery nodes  id=47aedd28639678ca addr=104.42.169.103:32323
INFO[02/03,05:18:36 Z] [33] [Dial] Add dial candidate from discovery nodes  id=53065fbbb73b0454 addr=52.78.232.41:32323
WARN[02/03,05:18:38 Z] [28] spawnSync timeout                         peerID=0fa5c281933268fc
INFO[02/03,05:18:39 Z] [41] Historical state regenerated              block=19231688 elapsed=3.567974448s nodeSize=21.07mB preimageSize=655.77kB
INFO[02/03,05:18:39 Z] [41] Regenerating historical state             block=19231617 target=19231689 remaining=72 elapsed=700ns
INFO[02/03,05:18:39 Z] [5] Imported new chain segment                number=19231737 hash=cb4111…29c696 blocks=1  txs=56   elapsed=8.282s       trieDBSize=34.96mB mgas=11.457  mgasps=1.383
INFO[02/03,05:18:41 Z] [33] [Dial] Add dial candidate from discovery nodes  id=ae9468da6c64247c addr=52.231.49.154:36300
INFO[02/03,05:18:41 Z] [33] [Dial] Add dial candidate from discovery nodes  id=d547cf2d920d5fca addr=13.209.56.144:32323
INFO[02/03,05:18:43 Z] [41] Historical state regenerated              block=19231689 elapsed=3.902788008s nodeSize=21.10mB preimageSize=656.59kB
INFO[02/03,05:18:43 Z] [41] Regenerating historical state             block=19231617 target=19231690 remaining=73 elapsed=691ns
INFO[02/03,05:18:47 Z] [41] Historical state regenerated              block=19231690 elapsed=4.21355094s  nodeSize=21.12mB preimageSize=657.01kB
INFO[02/03,05:18:48 Z] [41] Regenerating historical state             block=19231617 target=19231691 remaining=74 elapsed=13.84µs
INFO[02/03,05:18:50 Z] [5] Imported new chain segment                number=19231742 hash=83c9ee…95939c blocks=5  txs=179  elapsed=11.206s      trieDBSize=35.72mB mgas=27.665  mgasps=2.469
INFO[02/03,05:18:51 Z] [33] [Dial] Add dial candidate from discovery nodes  id=7c6a0befc495ca47 addr=52.78.241.194:32323
INFO[02/03,05:18:52 Z] [41] Historical state regenerated              block=19231691 elapsed=3.900843961s nodeSize=21.64mB preimageSize=675.56kB
INFO[02/03,05:18:52 Z] [41] Regenerating historical state             block=19231617 target=19231692 remaining=75 elapsed=657ns
INFO[02/03,05:18:56 Z] [41] Historical state regenerated              block=19231692 elapsed=3.849268149s nodeSize=22.13mB preimageSize=692.46kB
INFO[02/03,05:18:56 Z] [33] [Dial] Add dial candidate from discovery nodes  id=ec5e59e618979ef2 addr=52.141.42.3:36300
INFO[02/03,05:18:56 Z] [41] Regenerating historical state             block=19231617 target=19231693 remaining=76 elapsed=684ns
INFO[02/03,05:18:56 Z] [33] [Dial] Add dial candidate from discovery nodes  id=d5b3eed6b8b31623 addr=54.178.210.184:32323
INFO[02/03,05:19:00 Z] [41] Historical state regenerated              block=19231693 elapsed=4.02928672s  nodeSize=22.58mB preimageSize=708.33kB
INFO[02/03,05:19:01 Z] [41] Regenerating historical state             block=19231617 target=19231694 remaining=77 elapsed=744ns
INFO[02/03,05:19:05 Z] [41] Historical state regenerated              block=19231694 elapsed=4.146214654s nodeSize=24.00mB preimageSize=759.90kB
INFO[02/03,05:19:06 Z] [41] Regenerating historical state             block=19231617 target=19231695 remaining=78 elapsed=1.037µs
INFO[02/03,05:19:06 Z] [47] Persisted trie from memory database       updated nodes=89673 updated nodes size=30.34mB time=743.353509ms gcnodes=32510 gcsize=16.82mB gctime=156.64997ms livenodes=2744 livesize=1.46mB
INFO[02/03,05:19:06 Z] [5] Imported new chain segment                number=19231744 hash=8799d8…677e12 blocks=2  txs=98   elapsed=15.487s      trieDBSize=838.07kB mgas=19.699  mgasps=1.272
INFO[02/03,05:19:06 Z] [33] [Dial] Add dial candidate from discovery nodes  id=ab7faefeb0833ce4 addr=47.74.53.200:32323
INFO[02/03,05:19:10 Z] [41] Historical state regenerated              block=19231695 elapsed=4.586302627s nodeSize=24.48mB preimageSize=776.34kB
INFO[02/03,05:19:10 Z] [41] Regenerating historical state             block=19231617 target=19231696 remaining=79 elapsed=744ns
INFO[02/03,05:19:11 Z] [33] [Dial] Add dial candidate from discovery nodes  id=4425ebe565ef166c addr=15.164.93.139:32323
INFO[02/03,05:19:11 Z] [33] [Dial] Add dial candidate from discovery nodes  id=4e68cd19867d0b5f addr=13.124.162.109:32323
INFO[02/03,05:19:11 Z] [33] [Dial] Add dial candidate from discovery nodes  id=1700d1f0caa0a2a7 addr=13.125.211.81:32323
INFO[02/03,05:19:15 Z] [41] Historical state regenerated              block=19231696 elapsed=4.641234797s nodeSize=25.09mB preimageSize=798.07kB
INFO[02/03,05:19:15 Z] [41] Regenerating historical state             block=19231617 target=19231697 remaining=80 elapsed=750ns
INFO[02/03,05:19:17 Z] [5] Imported new chain segment                number=19231745 hash=7a255b…9ecee5 blocks=1  txs=70   elapsed=11.152s      trieDBSize=2.28mB   mgas=14.910  mgasps=1.337
INFO[02/03,05:19:20 Z] [41] Historical state regenerated              block=19231697 elapsed=4.586056986s nodeSize=25.50mB preimageSize=812.37kB
INFO[02/03,05:19:20 Z] [41] Regenerating historical state             block=19231617 target=19231698 remaining=81 elapsed=732ns
INFO[02/03,05:19:21 Z] [33] [Dial] Add dial candidate from discovery nodes  id=906ae56543e66f12 addr=13.124.249.12:32323
INFO[02/03,05:19:25 Z] [41] Historical state regenerated              block=19231698 elapsed=4.62379527s  nodeSize=25.60mB preimageSize=816.06kB
INFO[02/03,05:19:25 Z] [41] Regenerating historical state             block=19231617 target=19231699 remaining=82 elapsed=622ns
INFO[02/03,05:19:26 Z] [33] [Dial] Add dial candidate from discovery nodes  id=cb507eec43e8290a addr=176.9.43.247:32323
INFO[02/03,05:19:26 Z] [33] [Dial] Add dial candidate from discovery nodes  id=a4db4705c1176d09 addr=54.180.142.43:32323
INFO[02/03,05:19:27 Z] [33] [Dial] Add dial candidate from discovery nodes  id=f6bf5355ceedc9e4 addr=13.209.60.117:32323
INFO[02/03,05:19:27 Z] [33] [Dial] Add dial candidate from discovery nodes  id=2db772e55d5e162d addr=52.141.42.3:36300
INFO[02/03,05:19:30 Z] [41] Historical state regenerated              block=19231699 elapsed=4.776450116s nodeSize=25.62mB preimageSize=816.82kB
INFO[02/03,05:19:30 Z] [41] Regenerating historical state             block=19231617 target=19231701 remaining=84 elapsed=830ns
INFO[02/03,05:19:35 Z] [41] Historical state regenerated              block=19231701 elapsed=4.836579741s nodeSize=25.64mB preimageSize=817.41kB
INFO[02/03,05:19:35 Z] [41] Regenerating historical state             block=19231617 target=19231702 remaining=85 elapsed=729ns
INFO[02/03,05:19:36 Z] [33] [Dial] Add dial candidate from discovery nodes  id=c6d04d1c44efc877 addr=13.209.81.153:32323
INFO[02/03,05:19:36 Z] [33] [Dial] Add dial candidate from discovery nodes  id=249fa4c8436074ec addr=13.209.204.37:32323
INFO[02/03,05:19:37 Z] [5] Imported new chain segment                number=19231750 hash=b2af2a…8800ee blocks=5  txs=35   elapsed=20.615s      trieDBSize=1.81mB   mgas=6.483   mgasps=0.314
INFO[02/03,05:19:40 Z] [41] Historical state regenerated              block=19231702 elapsed=5.317994804s nodeSize=25.69mB preimageSize=819.07kB
INFO[02/03,05:19:40 Z] [41] Regenerating historical state             block=19231617 target=19231703 remaining=86 elapsed=599ns
INFO[02/03,05:19:42 Z] [33] [Dial] Add dial candidate from discovery nodes  id=abe186b6b6f99f8f addr=54.180.183.222:32323
INFO[02/03,05:19:46 Z] [41] Historical state regenerated              block=19231703 elapsed=5.237232011s nodeSize=25.70mB preimageSize=819.36kB
INFO[02/03,05:19:46 Z] [41] Regenerating historical state             block=19231617 target=19231704 remaining=87 elapsed=776ns
INFO[02/03,05:19:47 Z] [33] [Dial] Add dial candidate from discovery nodes  id=1f05305868c692cf addr=52.79.244.98:32323
INFO[02/03,05:19:51 Z] [33] [Dial] Add dial candidate from discovery nodes  id=b2dd13b3a1d3cbef addr=13.209.79.71:32323
INFO[02/03,05:19:51 Z] [5] Imported new chain segment                number=19231752 hash=6805dc…fe2016 blocks=2  txs=171  elapsed=13.698s      trieDBSize=4.14mB   mgas=30.958  mgasps=2.260
INFO[02/03,05:19:51 Z] [41] Historical state regenerated              block=19231704 elapsed=5.276020072s nodeSize=25.84mB preimageSize=823.42kB
INFO[02/03,05:19:51 Z] [41] Regenerating historical state             block=19231617 target=19231705 remaining=88 elapsed=759ns
INFO[02/03,05:19:56 Z] [41] Historical state regenerated              block=19231705 elapsed=5.224683362s nodeSize=25.84mB preimageSize=823.47kB
INFO[02/03,05:19:57 Z] [41] Regenerating historical state             block=19231617 target=19231706 remaining=89 elapsed=900ns
INFO[02/03,05:19:57 Z] [33] [Dial] Add dial candidate from discovery nodes  id=663fe9d8efb8966d addr=107.155.56.28:32323

from klaytn.

KimKyungup avatar KimKyungup commented on June 3, 2024

@Jongsic Thanks for the report.
During that time, There were heavy transactions. So syncing was too slow.
Our team will improve the sync speed.

Separately, invalid fee payer error can be also resolved in the binary which I already shared.
But We will release the next binary with another solution without increasing memory and decreasing performance.

And we also welcome you to talk in forum.klaytn.com.

from klaytn.

KimKyungup avatar KimKyungup commented on June 3, 2024

cc @winnie-byun

from klaytn.

KimKyungup avatar KimKyungup commented on June 3, 2024

Please refer the below release. We have some optimization. I hope it will helpful.
#485

I close this issue. If you have any some similar issue, please let us know. Thanks.

from klaytn.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.