How to Scrape "Aged" or "old" or "date range" notes

TumblingJazz Tumblr bot discussion
tahoe012
Posts: 94
Joined: Mon Jan 06, 2020 10:56 am

Re: How to Scrape "Aged" or "old" or "date range" notes

Post by tahoe012 » Fri Oct 16, 2020 9:04 am

I think I did not do something right. The screen shot shows the set up. The file was a list of Posts scraped from keyword dog.
The objective is to scrape the posts for Notes than run that list of notes thru availability checker.
I was hoping for 1 Million notes and ended up with 1 Million posts.

https://ibb.co/tsq7ctX
24348 are the logs

snibi
Posts: 398
Joined: Thu Sep 17, 2015 6:48 am

Re: How to Scrape "Aged" or "old" or "date range" notes

Post by snibi » Fri Oct 16, 2020 10:12 am

You have used "Custom Search Posts", which delivers posts of the notes back.

To scrape the notes of a post, please use "Custom Search Users", the field above.

Select "A Post URL / File List" -> "Scrape Notes Of Post", which delivers back the notes of your file list.

Image


tahoe012
Posts: 94
Joined: Mon Jan 06, 2020 10:56 am

Re: How to Scrape "Aged" or "old" or "date range" notes

Post by tahoe012 » Sat Oct 17, 2020 12:53 pm

Thankyou. Now scraping Notes and while that process is running i'd like to start a process of testing availability of another list of usernames. But, it shows "Waiting" for the current process to finish. Can I change a setting so both processes can run at same time?

User avatar
martin@rootjazz
Site Admin
Posts: 26208
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: How to Scrape "Aged" or "old" or "date range" notes

Post by martin@rootjazz » Sat Oct 17, 2020 1:10 pm

tahoe012 wrote:
Sat Oct 17, 2020 12:53 pm
Thankyou. Now scraping Notes and while that process is running i'd like to start a process of testing availability of another list of usernames. But, it shows "Waiting" for the current process to finish. Can I change a setting so both processes can run at same time?
Processing tab > NUM THREADS

1 thread runs 1 action, so to run 2 actions, set it to 2


WARNING there is a protection (SETTINGS TAB) to only run 1 action per account, so to run multiple actions of the same account turn this off



Regards,
Martin

Post Reply