Scrape all Like/Reblogs not working.
Scrape all Like/Reblogs not working.
I have chosen 29 different posts with some of them having over 50K notes. I saved all their links to a text file and used the scrape tool to "Scrape Post Notes: Users who have liked/reblogged a post" For some of the posts it worked, but for most of them it only saved 50 blogs notes.
- martin@rootjazz
- Site Admin
- Posts: 34627
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scrape all Like/Reblogs not working.
Please post or email me a sample to test to see if I get the same issue
Re: Scrape all Like/Reblogs not working.
http://beautyanal.tumblr.com/post/140138308923/ has 11,000+ notes however only scrapes 45 blogs. I won't post the blogs here but if you want to see the blogs that it scrapes I pasted theme here http://pastebin.com/D8GLFjeZ.
Re: Scrape all Like/Reblogs not working.
I have same problem,
11:53:42: Scrape notes: http://poedanaron.tumblr.com/post/14129 ... apan-memes max: 0
11:53:42: tmp results: 41
11:53:42: Cannot scrape unlimited using global max: 900000
11:53:46: total results: 350
11:53:46: No more notes found on page to load:
log id 55787
11:53:42: Scrape notes: http://poedanaron.tumblr.com/post/14129 ... apan-memes max: 0
11:53:42: tmp results: 41
11:53:42: Cannot scrape unlimited using global max: 900000
11:53:46: total results: 350
11:53:46: No more notes found on page to load:
log id 55787
Re: Scrape all Like/Reblogs not working.
Have same problem!
just have sumbitted logs and send a message to e-mail.
Also yesterday i noticed such moment while following - very many users to follow have *Couldnt pull src link" - or something like that.
just have sumbitted logs and send a message to e-mail.
Also yesterday i noticed such moment while following - very many users to follow have *Couldnt pull src link" - or something like that.
- martin@rootjazz
- Site Admin
- Posts: 34627
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scrape all Like/Reblogs not working.
cloudx wrote:I have same problem,
11:53:42: Scrape notes: http://poedanaron.tumblr.com/post/14129 ... apan-memes max: 0
11:53:42: tmp results: 41
11:53:42: Cannot scrape unlimited using global max: 900000
11:53:46: total results: 350
11:53:46: No more notes found on page to load:
log id 55787
Running a test on :
http://poedanaron.tumblr.com/post/14129 ... apan-memes
I can scrape 868, and then tumblr returns no more results. I do not think tumblr is giving access to all notes anymore
Go here
http://poedanaron.tumblr.com/notes/1412 ... /K0gKHJRZb
then keep clicking MORE
then will stop at 1000
The 868 results is the unique results as some are shown as like and reblogged of same user, thus < than the 1000 shown.
before tumblr would show 200k+, but seems they have changed.
Re: Scrape all Like/Reblogs not working.
Some posts it is successfully scraping thousands of users, (one has just under 15,000). Some it is not. Is it possible that it has something to do with the theme instead of Tumblr?
- martin@rootjazz
- Site Admin
- Posts: 34627
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scrape all Like/Reblogs not working.
IT does appear random. Some 250, some 300 I have seen a 1000. But it does stop at some point. It could be theme, it could be user option. It could be random as tumblr runs tests trying to decide what to do.
Re: Scrape all Like/Reblogs not working.
Hello, this is still happening. An example; I get two posts from the same blog - and one has ~6800 notes and it scrapes 94 users. The other has ~6400 notes and scrapes ~4700 users (I'm guessing this is because it only has notes from that many UNIQUE users, so that works well). It is from the same exact blog so I don't think that it is theme or user related (unless it scrapes it from the original poster's blog instead of a reblogger's blog) Is there any way to fix this?
When I gather posts totaling ~400,000 notes it scrapes ~40,000 which is 10%. I understand that there are people who like and reblog so it wouldn't give me the full 400,000 users anyways but 10% is very frustrating when I know I am missing tons of users I should be scraping.
When I gather posts totaling ~400,000 notes it scrapes ~40,000 which is 10%. I understand that there are people who like and reblog so it wouldn't give me the full 400,000 users anyways but 10% is very frustrating when I know I am missing tons of users I should be scraping.
- martin@rootjazz
- Site Admin
- Posts: 34627
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scrape all Like/Reblogs not working.
It is possible there is a limit by tumblr.
40k results is still quite good going
40k results is still quite good going