Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Comments download have been limited to 50 #2125

Closed
Gabriel-Aragao opened this issue Dec 4, 2023 · 9 comments
Closed

Comments download have been limited to 50 #2125

Gabriel-Aragao opened this issue Dec 4, 2023 · 9 comments
Labels
bug Bug

Comments

@Gabriel-Aragao
Copy link

Both command line and python module are downloading only 50 comments of each post,

To Reproduce
instaloader --login=scrape.gcp.3 --comments --no-captions --no-pictures -- -SHORTCODE

Expected behavior
When a post had more than 250 comments, it used to appear the 250 ... 500 ... 750.. and every comment downloaded.
Since yesterday it have been downloading olny 50 comments.

Instaloader version
4.10.1

@Gabriel-Aragao Gabriel-Aragao added the bug Bug label Dec 4, 2023
@Gabriel-Aragao
Copy link
Author

Have anyone found a workarround for this?

@hmobinizade
Copy link

Yes, I have exactly the same problem in recent days. It gives only 11 recent comments from each post!!!

@Gabriel-Aragao
Copy link
Author

Yes, I have exactly the same problem in recent days. It gives only 11 recent comments from each post!!!

Have you found a solution?

@jopapo
Copy link

jopapo commented Dec 9, 2023

Just to add something I noticed:

50 is graphql paging hard-coded client-side (but it seems that is the upper limit in the server also - tried to put more and didnt work) and server dont say it has more pages. So, it returns just the first page.

Somehow the backend is returning:

"page_info":{
      "has_next_page":false,
      "end_cursor":"None"
   },

has_next_page should be returning True (in my case... 2k+ comments) and the lib would try to fetch more pages.

https://github.com/instaloader/instaloader/blob/master/instaloader/nodeiterator.py#L140

Don't know if it is something with the server or the graphql lib limit request... :-/

@Michoko92
Copy link

DId someone find a fix for this please? I'm trying to get a few thousand comments from a post and can only get the first 50 ones too. Thank you so much for your help!

@aandergr
Copy link
Member

Indeed, this is reproducible. Thanks for reporting!

@ardian708
Copy link

Has anyone found the solution? this library should be fixed please

@aandergr
Copy link
Member

aandergr commented Jan 5, 2024

It seems it is still quite reliable to query the comments of posts that have more than 50 comments via an iPhone endpoint.

For those in a hurry, I've put together a little gist for this before I built it into Instaloader: https://gist.github.com/aandergr/35ad3881e726e2be8925cf09e719a68b

@aandergr aandergr pinned this issue Jan 5, 2024
aandergr added a commit that referenced this issue Jan 12, 2024
Closes issue #2125 by using an iphone endpoint for posts that have more
than 50 comments.
aandergr added a commit that referenced this issue Jan 12, 2024
Closes issue #2125 by using an iphone endpoint for posts that have more
than 50 comments.
aandergr added a commit that referenced this issue Jan 12, 2024
Closes issue #2125 by using an iphone endpoint for posts that have more
than 50 comments.
@aandergr
Copy link
Member

Fixed in Version 4.10.3.

aandergr added a commit that referenced this issue Mar 17, 2024
Closes issue #2125 by using an iphone endpoint for posts that have more
than 50 comments.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Bug
Projects
None yet
Development

No branches or pull requests

6 participants