video comments only save 10 subcomments per comment thread about ytpriv

[riptl]

Interesting, YouTube must have changed their API. I'll take a look at it.

[riptl]

@adsad213 Sorry for the delay, but this is fixed in 1.0.0! https://github.com/terorie/ytwrk/releases/tag/v1.0.0

I've verified that subcomments get scraped with the video you've linked.
I now get 10 pages of sub-comments on the first comment thread (used to be 1).

./ytwrk video comments e9dZQelULDk --sort=top -c1 >/dev/null

INFO[0000] Start video                                   video_id=e9dZQelULDk
INFO[0001] Page                                          index=-1 video_id=e9dZQelULDk
INFO[0001] Page                                          index=0 video_id=e9dZQelULDk
INFO[0001] Sub page                                      index=1 parent_id=Ugx3Zffzf5edwiRain94AaABAg sub_index=0 video_id=e9dZQelULDk
INFO[0002] Sub page                                      index=1 parent_id=Ugx3Zffzf5edwiRain94AaABAg sub_index=1 video_id=e9dZQelULDk
INFO[0002] Sub page                                      index=1 parent_id=Ugx3Zffzf5edwiRain94AaABAg sub_index=2 video_id=e9dZQelULDk
INFO[0003] Sub page                                      index=1 parent_id=Ugx3Zffzf5edwiRain94AaABAg sub_index=3 video_id=e9dZQelULDk
INFO[0004] Sub page                                      index=1 parent_id=Ugx3Zffzf5edwiRain94AaABAg sub_index=4 video_id=e9dZQelULDk
INFO[0004] Sub page                                      index=1 parent_id=Ugx3Zffzf5edwiRain94AaABAg sub_index=5 video_id=e9dZQelULDk
INFO[0005] Sub page                                      index=1 parent_id=Ugx3Zffzf5edwiRain94AaABAg sub_index=6 video_id=e9dZQelULDk
INFO[0005] Sub page                                      index=1 parent_id=Ugx3Zffzf5edwiRain94AaABAg sub_index=7 video_id=e9dZQelULDk
INFO[0006] Sub page                                      index=1 parent_id=Ugx3Zffzf5edwiRain94AaABAg sub_index=8 video_id=e9dZQelULDk
INFO[0006] Sub page                                      index=1 parent_id=Ugx3Zffzf5edwiRain94AaABAg sub_index=9 video_id=e9dZQelULDk
INFO[0007] Sub page                                      index=1 parent_id=Ugx3Zffzf5edwiRain94AaABAg sub_index=10 video_id=e9dZQelULDk
INFO[0007] Sub page                                      index=1 parent_id=Ugx8ndkeMmG8LLc0WKp4AaABAg sub_index=0 video_id=e9dZQelULDk
INFO[0007] Sub page                                      index=1 parent_id=Ugx8ndkeMmG8LLc0WKp4AaABAg sub_index=1 video_id=e9dZQelULDk

[adsad213]

Are 10 pages the limit? With the API I'm able to get all the sub-comments in a comment thread. Thanks for your effort!

[riptl]

@adsad213 The scraper fakes using youtube.com as on desktop. I am pretty sure you can get more than 10 pages if you click "show more replies" in the app. Thus, I don't think the scraper has a limit of subcomments. It's best to test manually.