Page 1 of 3

How to Scrape "Aged" or "old" or "date range" notes

Posted: Tue Jan 07, 2020 9:08 am
by tahoe012
For this example here is the beginning of the processor statements:
Also, the Goal is to find develop a large tumblr list to run thru scrapebox Vanity name checker for Available Tumblrs.
Also, the Goal would be a preference to find old/aged posts and notes as perhaps it would result in a higher amount of Available Tumblrs.

I am brand new with this software, I have watched the training videos on custom searches and read some postings in the forum.

Starting: 07/01/2020 00:02 AM
Custom posts search: kitchen design
Max Results Wanted: 1000000
Setup custom search controller
Custom search run: search: kitchen design
Perform custom search: #chain/total: 1/2 Scrape Popular Posts using:
User specific num per stage to return: 10000
Start search: Scrape Popular Posts with: kitchen design(10000) using: No account
URL: https://www.tumblr.com/search/kitchen+design

This is also after searching posts it searches for notes.

So, is there a way to target a date range or old posts / notes?

Re: How to Scrape "Aged" or "old" or "date range" notes

Posted: Tue Jan 07, 2020 4:51 pm
by martin@rootjazz
You cannot scrape specific date ranges of notes.

Also, your idea is flawed, expired tumblrs are not going to be found as notes to posts, when the tumblr blog is deleted, the note is removed. Unless you have other information for this.

Re: How to Scrape "Aged" or "old" or "date range" notes

Posted: Sat May 23, 2020 10:03 am
by ILearnSEO
martin@rootjazz wrote: Tue Jan 07, 2020 4:51 pm You cannot scrape specific date ranges of notes.

Also, your idea is flawed, expired tumblrs are not going to be found as notes to posts, when the tumblr blog is deleted, the note is removed. Unless you have other information for this.
Since when? Dead blogs used to be and still are in the posts.

Re: How to Scrape "Aged" or "old" or "date range" notes

Posted: Sat May 23, 2020 5:48 pm
by martin@rootjazz
ILearnSEO wrote: Sat May 23, 2020 10:03 am
martin@rootjazz wrote: Tue Jan 07, 2020 4:51 pm You cannot scrape specific date ranges of notes.

Also, your idea is flawed, expired tumblrs are not going to be found as notes to posts, when the tumblr blog is deleted, the note is removed. Unless you have other information for this.
Since when? Dead blogs used to be and still are in the posts.
If that is the case, then I stand corrected

Re: How to Scrape "Aged" or "old" or "date range" notes

Posted: Sat Oct 03, 2020 4:15 pm
by tahoe012
Hi I found an image that showed an older version of TJ. https://ibb.co/5njdGqL

Since the new version of Tj does not have that field anymore - is there a workaround to accomplish the same using custom search.

In effect this image represents uploading a txt file with multiple urls / posts and than it would scrape the notes resulting in a list of blogs to than run thru the availability checker.

Re: How to Scrape "Aged" or "old" or "date range" notes

Posted: Mon Oct 05, 2020 1:55 pm
by martin@rootjazz
tahoe012 wrote: Sat Oct 03, 2020 4:15 pm Hi I found an image that showed an older version of TJ. https://ibb.co/5njdGqL

Since the new version of Tj does not have that field anymore - is there a workaround to accomplish the same using custom search.

In effect this image represents uploading a txt file with multiple urls / posts and than it would scrape the notes resulting in a list of blogs to than run thru the availability checker.
Use CUSTOM SEARCH notes scrape step.

So if you have a list of posts your steps are

POST URL / FILE LIST (9999999)
SCRAPE NOTES (9999999)

the (9999999) is to ensure you get all items from all steps


Regards,
Martin

Re: How to Scrape "Aged" or "old" or "date range" notes

Posted: Thu Oct 08, 2020 9:24 am
by tahoe012
https://ibb.co/0sqMpfR
https://ibb.co/7XDMhDn
21482


Hi. These images describe how I'm setting up a Notes Search. I'm not sure where to place (9999999)

Thanks

Re: How to Scrape "Aged" or "old" or "date range" notes

Posted: Thu Oct 08, 2020 5:31 pm
by martin@rootjazz
My apologies, I didn't explain well.

In the CUSTOM SEARCH form, on the SELECTIONS side (right side) double click the steps and you can set the number to scrape for each step

Re: How to Scrape "Aged" or "old" or "date range" notes

Posted: Thu Oct 08, 2020 10:29 pm
by tahoe012
Thanks Martin,

I made it thru the steps and than it fails when processing so included the error log.
https://ibb.co/8zBxXzk
https://ibb.co/dP8FH4d
https://ibb.co/Hx8S3Kp

Logs: 61142

Re: How to Scrape "Aged" or "old" or "date range" notes

Posted: Fri Oct 09, 2020 1:33 pm
by martin@rootjazz
Can you update:

https://rootjazz.com/tumblingjazz/updatetesting.html

Does the issue persist? That error is an old one and was solved for the best of my knowledge