Scrape all Like/Reblogs not working.

Ask any support / help / issues / problem or question related to TumblingJazz
alesana
Posts: 28
Joined: Tue Mar 15, 2016 9:10 pm

Scrape all Like/Reblogs not working.

Post by alesana »

I have chosen 29 different posts with some of them having over 50K notes. I saved all their links to a text file and used the scrape tool to "Scrape Post Notes: Users who have liked/reblogged a post" For some of the posts it worked, but for most of them it only saved 50 blogs notes.
User avatar
martin@rootjazz
Site Admin
Posts: 34627
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scrape all Like/Reblogs not working.

Post by martin@rootjazz »

Please post or email me a sample to test to see if I get the same issue
alesana
Posts: 28
Joined: Tue Mar 15, 2016 9:10 pm

Re: Scrape all Like/Reblogs not working.

Post by alesana »

http://beautyanal.tumblr.com/post/140138308923/ has 11,000+ notes however only scrapes 45 blogs. I won't post the blogs here but if you want to see the blogs that it scrapes I pasted theme here http://pastebin.com/D8GLFjeZ.
cloudx
Posts: 26
Joined: Wed Sep 23, 2015 8:16 pm

Re: Scrape all Like/Reblogs not working.

Post by cloudx »

I have same problem,
11:53:42: Scrape notes: http://poedanaron.tumblr.com/post/14129 ... apan-memes max: 0
11:53:42: tmp results: 41
11:53:42: Cannot scrape unlimited using global max: 900000
11:53:46: total results: 350
11:53:46: No more notes found on page to load:

log id 55787
soa0611
Posts: 66
Joined: Tue Sep 29, 2015 4:45 pm

Re: Scrape all Like/Reblogs not working.

Post by soa0611 »

Have same problem!

just have sumbitted logs and send a message to e-mail.

Also yesterday i noticed such moment while following - very many users to follow have *Couldnt pull src link" - or something like that.
User avatar
martin@rootjazz
Site Admin
Posts: 34627
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scrape all Like/Reblogs not working.

Post by martin@rootjazz »

cloudx wrote:I have same problem,
11:53:42: Scrape notes: http://poedanaron.tumblr.com/post/14129 ... apan-memes max: 0
11:53:42: tmp results: 41
11:53:42: Cannot scrape unlimited using global max: 900000
11:53:46: total results: 350
11:53:46: No more notes found on page to load:

log id 55787


Running a test on :
http://poedanaron.tumblr.com/post/14129 ... apan-memes

I can scrape 868, and then tumblr returns no more results. I do not think tumblr is giving access to all notes anymore

Go here
http://poedanaron.tumblr.com/notes/1412 ... /K0gKHJRZb


then keep clicking MORE

then will stop at 1000

The 868 results is the unique results as some are shown as like and reblogged of same user, thus < than the 1000 shown.

before tumblr would show 200k+, but seems they have changed.
alesana
Posts: 28
Joined: Tue Mar 15, 2016 9:10 pm

Re: Scrape all Like/Reblogs not working.

Post by alesana »

Some posts it is successfully scraping thousands of users, (one has just under 15,000). Some it is not. Is it possible that it has something to do with the theme instead of Tumblr?
User avatar
martin@rootjazz
Site Admin
Posts: 34627
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scrape all Like/Reblogs not working.

Post by martin@rootjazz »

IT does appear random. Some 250, some 300 I have seen a 1000. But it does stop at some point. It could be theme, it could be user option. It could be random as tumblr runs tests trying to decide what to do.
alesana
Posts: 28
Joined: Tue Mar 15, 2016 9:10 pm

Re: Scrape all Like/Reblogs not working.

Post by alesana »

Hello, this is still happening. An example; I get two posts from the same blog - and one has ~6800 notes and it scrapes 94 users. The other has ~6400 notes and scrapes ~4700 users (I'm guessing this is because it only has notes from that many UNIQUE users, so that works well). It is from the same exact blog so I don't think that it is theme or user related (unless it scrapes it from the original poster's blog instead of a reblogger's blog) Is there any way to fix this?

When I gather posts totaling ~400,000 notes it scrapes ~40,000 which is 10%. I understand that there are people who like and reblog so it wouldn't give me the full 400,000 users anyways but 10% is very frustrating when I know I am missing tons of users I should be scraping.
User avatar
martin@rootjazz
Site Admin
Posts: 34627
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scrape all Like/Reblogs not working.

Post by martin@rootjazz »

It is possible there is a limit by tumblr.

40k results is still quite good going
Post Reply