Scrape all notes in a blog

TumblingJazz Tumblr bot discussion
Moses
Posts: 289
Joined: Fri Feb 28, 2014 11:59 pm

Scrape all notes in a blog

Post by Moses » Mon Nov 25, 2019 9:22 pm

is possible to scrape all post-notes in a blog instead of just one post?

I'm referring to the scrape notes feature

User avatar
martin@rootjazz
Site Admin
Posts: 26923
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scrape all notes in a blog

Post by martin@rootjazz » Tue Nov 26, 2019 2:55 pm

Depends on number of numbers and posts as to if you will hit over scraping limits.

But to do it, use CUSTOM SEARCH

get posts
get notes

(or whatever the exact search steps are, but something like that

Moses
Posts: 289
Joined: Fri Feb 28, 2014 11:59 pm

Re: Scrape all notes in a blog

Post by Moses » Wed Dec 11, 2019 3:27 am

Idk how to do that.

I want to extract notes of post in a certain blog that's not my blog. HOw would i go about doing that?

You don't explain it great in your youtube video because you only explain using search terms which is not what i want i want to do.

Moses
Posts: 289
Joined: Fri Feb 28, 2014 11:59 pm

Re: Scrape all notes in a blog

Post by Moses » Wed Dec 11, 2019 3:28 am

How so do i enter the blog URL into a file?

Again this blog/account isn't mine

User avatar
martin@rootjazz
Site Admin
Posts: 26923
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scrape all notes in a blog

Post by martin@rootjazz » Wed Dec 11, 2019 7:34 pm

Moses wrote:
Wed Dec 11, 2019 3:27 am
Idk how to do that.

I want to extract notes of post in a certain blog that's not my blog. HOw would i go about doing that?

You don't explain it great in your youtube video because you only explain using search terms which is not what i want i want to do.
sorry I misunderstood, you want notes from a SINGLE post.

So, goto SCRAPE tab
specify the post URL as the input
Set CUSTOM SEARCH (search builder) step as NOTES

That's it

Moses
Posts: 289
Joined: Fri Feb 28, 2014 11:59 pm

Re: Scrape all notes in a blog

Post by Moses » Fri Dec 13, 2019 9:40 pm

No not a single post. I want to scrape notes from ALL posts in a blog.
Can you explain in detail how that's done please or give material that explains.

User avatar
martin@rootjazz
Site Admin
Posts: 26923
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scrape all notes in a blog

Post by martin@rootjazz » Sat Dec 14, 2019 1:52 pm

Moses wrote:
Fri Dec 13, 2019 9:40 pm
No not a single post. I want to scrape notes from ALL posts in a blog.
I explain how to do that previously. Then you replied
I want to extract notes of post in a certain blog
which I thought you wanted notes of a specific post.


If you want to TRY and get all notes from all posts.

Then

GOTO search tab
Create a CUSTOM SEARCH POSTS search

Set the steps:
RECENT POSTS OF (100)
NOTES OF POST

where (100) is the amount of posts you want to scrape. To set this, double click the selected step.

WARNING, if you specify something like 9999999 to try and get them all, you may trigger tumblr protections as over scraping.

Moses
Posts: 289
Joined: Fri Feb 28, 2014 11:59 pm

Re: Scrape all notes in a blog

Post by Moses » Sun Dec 15, 2019 5:15 am

Ok i get it....sorry it's been 3 years since i last used this app.

How do i specify the blog that will be scraped? Or do i put the blog URL in a file or enter the blog URL into the app?

User avatar
martin@rootjazz
Site Admin
Posts: 26923
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scrape all notes in a blog

Post by martin@rootjazz » Sun Dec 15, 2019 3:41 pm

Moses wrote:
Sun Dec 15, 2019 5:15 am
Ok i get it....sorry it's been 3 years since i last used this app.

How do i specify the blog that will be scraped? Or do i put the blog URL in a file or enter the blog URL into the app?
enter the blog URL in the search input box


Regards,
Martin

Moses
Posts: 289
Joined: Fri Feb 28, 2014 11:59 pm

Re: Scrape all notes in a blog

Post by Moses » Wed Dec 18, 2019 11:36 pm

It's saying invalid URL in process failed action

logs 5688

Post Reply