How to Scrape "Aged" or "old" or "date range" notes

TumblingJazz Tumblr bot discussion
tahoe012
Posts: 107
Joined: Mon Jan 06, 2020 10:56 am

How to Scrape "Aged" or "old" or "date range" notes

Post by tahoe012 »

For this example here is the beginning of the processor statements:
Also, the Goal is to find develop a large tumblr list to run thru scrapebox Vanity name checker for Available Tumblrs.
Also, the Goal would be a preference to find old/aged posts and notes as perhaps it would result in a higher amount of Available Tumblrs.

I am brand new with this software, I have watched the training videos on custom searches and read some postings in the forum.

Starting: 07/01/2020 00:02 AM
Custom posts search: kitchen design
Max Results Wanted: 1000000
Setup custom search controller
Custom search run: search: kitchen design
Perform custom search: #chain/total: 1/2 Scrape Popular Posts using:
User specific num per stage to return: 10000
Start search: Scrape Popular Posts with: kitchen design(10000) using: No account
URL: https://www.tumblr.com/search/kitchen+design

This is also after searching posts it searches for notes.

So, is there a way to target a date range or old posts / notes?
User avatar
martin@rootjazz
Site Admin
Posts: 36314
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: How to Scrape "Aged" or "old" or "date range" notes

Post by martin@rootjazz »

You cannot scrape specific date ranges of notes.

Also, your idea is flawed, expired tumblrs are not going to be found as notes to posts, when the tumblr blog is deleted, the note is removed. Unless you have other information for this.
User avatar
martin@rootjazz
Site Admin
Posts: 36314
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: How to Scrape "Aged" or "old" or "date range" notes

Post by martin@rootjazz »

ILearnSEO wrote: Sat May 23, 2020 10:03 am
martin@rootjazz wrote: Tue Jan 07, 2020 4:51 pm You cannot scrape specific date ranges of notes.

Also, your idea is flawed, expired tumblrs are not going to be found as notes to posts, when the tumblr blog is deleted, the note is removed. Unless you have other information for this.
Since when? Dead blogs used to be and still are in the posts.
If that is the case, then I stand corrected
tahoe012
Posts: 107
Joined: Mon Jan 06, 2020 10:56 am

Re: How to Scrape "Aged" or "old" or "date range" notes

Post by tahoe012 »

Hi I found an image that showed an older version of TJ. https://ibb.co/5njdGqL

Since the new version of Tj does not have that field anymore - is there a workaround to accomplish the same using custom search.

In effect this image represents uploading a txt file with multiple urls / posts and than it would scrape the notes resulting in a list of blogs to than run thru the availability checker.
User avatar
martin@rootjazz
Site Admin
Posts: 36314
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: How to Scrape "Aged" or "old" or "date range" notes

Post by martin@rootjazz »

tahoe012 wrote: Sat Oct 03, 2020 4:15 pm Hi I found an image that showed an older version of TJ. https://ibb.co/5njdGqL

Since the new version of Tj does not have that field anymore - is there a workaround to accomplish the same using custom search.

In effect this image represents uploading a txt file with multiple urls / posts and than it would scrape the notes resulting in a list of blogs to than run thru the availability checker.
Use CUSTOM SEARCH notes scrape step.

So if you have a list of posts your steps are

POST URL / FILE LIST (9999999)
SCRAPE NOTES (9999999)

the (9999999) is to ensure you get all items from all steps


Regards,
Martin
tahoe012
Posts: 107
Joined: Mon Jan 06, 2020 10:56 am

Re: How to Scrape "Aged" or "old" or "date range" notes

Post by tahoe012 »

https://ibb.co/0sqMpfR
https://ibb.co/7XDMhDn
21482


Hi. These images describe how I'm setting up a Notes Search. I'm not sure where to place (9999999)

Thanks
User avatar
martin@rootjazz
Site Admin
Posts: 36314
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: How to Scrape "Aged" or "old" or "date range" notes

Post by martin@rootjazz »

My apologies, I didn't explain well.

In the CUSTOM SEARCH form, on the SELECTIONS side (right side) double click the steps and you can set the number to scrape for each step
tahoe012
Posts: 107
Joined: Mon Jan 06, 2020 10:56 am

Re: How to Scrape "Aged" or "old" or "date range" notes

Post by tahoe012 »

Thanks Martin,

I made it thru the steps and than it fails when processing so included the error log.
https://ibb.co/8zBxXzk
https://ibb.co/dP8FH4d
https://ibb.co/Hx8S3Kp

Logs: 61142
User avatar
martin@rootjazz
Site Admin
Posts: 36314
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: How to Scrape "Aged" or "old" or "date range" notes

Post by martin@rootjazz »

Can you update:

https://rootjazz.com/tumblingjazz/updatetesting.html

Does the issue persist? That error is an old one and was solved for the best of my knowledge
tahoe012
Posts: 107
Joined: Mon Jan 06, 2020 10:56 am

Re: How to Scrape "Aged" or "old" or "date range" notes

Post by tahoe012 »

Hi Martin,

Downloaded from the Link in your reply
Same error message

On my Laptop working fine.
On the Windows VPS is the Error

Thanks for looking into this.
Post Reply