Page 1 of 2

Scrape all Like/Reblogs not working.

Posted: Mon Mar 21, 2016 9:55 pm
by alesana
I have chosen 29 different posts with some of them having over 50K notes. I saved all their links to a text file and used the scrape tool to "Scrape Post Notes: Users who have liked/reblogged a post" For some of the posts it worked, but for most of them it only saved 50 blogs notes.

Re: Scrape all Like/Reblogs not working.

Posted: Tue Mar 22, 2016 3:15 am
by martin@rootjazz
Please post or email me a sample to test to see if I get the same issue

Re: Scrape all Like/Reblogs not working.

Posted: Tue Mar 22, 2016 6:27 am
by alesana
http://beautyanal.tumblr.com/post/140138308923/ has 11,000+ notes however only scrapes 45 blogs. I won't post the blogs here but if you want to see the blogs that it scrapes I pasted theme here http://pastebin.com/D8GLFjeZ.

Re: Scrape all Like/Reblogs not working.

Posted: Tue Mar 22, 2016 9:55 am
by cloudx
I have same problem,
11:53:42: Scrape notes: http://poedanaron.tumblr.com/post/14129 ... apan-memes max: 0
11:53:42: tmp results: 41
11:53:42: Cannot scrape unlimited using global max: 900000
11:53:46: total results: 350
11:53:46: No more notes found on page to load:

log id 55787

Re: Scrape all Like/Reblogs not working.

Posted: Tue Mar 22, 2016 5:14 pm
by soa0611
Have same problem!

just have sumbitted logs and send a message to e-mail.

Also yesterday i noticed such moment while following - very many users to follow have *Couldnt pull src link" - or something like that.

Re: Scrape all Like/Reblogs not working.

Posted: Tue Mar 22, 2016 6:05 pm
by martin@rootjazz
cloudx wrote:I have same problem,
11:53:42: Scrape notes: http://poedanaron.tumblr.com/post/14129 ... apan-memes max: 0
11:53:42: tmp results: 41
11:53:42: Cannot scrape unlimited using global max: 900000
11:53:46: total results: 350
11:53:46: No more notes found on page to load:

log id 55787


Running a test on :
http://poedanaron.tumblr.com/post/14129 ... apan-memes

I can scrape 868, and then tumblr returns no more results. I do not think tumblr is giving access to all notes anymore

Go here
http://poedanaron.tumblr.com/notes/1412 ... /K0gKHJRZb


then keep clicking MORE

then will stop at 1000

The 868 results is the unique results as some are shown as like and reblogged of same user, thus < than the 1000 shown.

before tumblr would show 200k+, but seems they have changed.

Re: Scrape all Like/Reblogs not working.

Posted: Tue Mar 22, 2016 9:26 pm
by alesana
Some posts it is successfully scraping thousands of users, (one has just under 15,000). Some it is not. Is it possible that it has something to do with the theme instead of Tumblr?

Re: Scrape all Like/Reblogs not working.

Posted: Wed Mar 23, 2016 1:17 pm
by martin@rootjazz
IT does appear random. Some 250, some 300 I have seen a 1000. But it does stop at some point. It could be theme, it could be user option. It could be random as tumblr runs tests trying to decide what to do.

Re: Scrape all Like/Reblogs not working.

Posted: Mon Apr 11, 2016 10:17 pm
by alesana
Hello, this is still happening. An example; I get two posts from the same blog - and one has ~6800 notes and it scrapes 94 users. The other has ~6400 notes and scrapes ~4700 users (I'm guessing this is because it only has notes from that many UNIQUE users, so that works well). It is from the same exact blog so I don't think that it is theme or user related (unless it scrapes it from the original poster's blog instead of a reblogger's blog) Is there any way to fix this?

When I gather posts totaling ~400,000 notes it scrapes ~40,000 which is 10%. I understand that there are people who like and reblog so it wouldn't give me the full 400,000 users anyways but 10% is very frustrating when I know I am missing tons of users I should be scraping.

Re: Scrape all Like/Reblogs not working.

Posted: Tue Apr 12, 2016 4:33 pm
by martin@rootjazz
It is possible there is a limit by tumblr.

40k results is still quite good going