Page 1 of 1

Scrape from search

Posted: Mon May 07, 2018 3:26 pm
by Bartekef
Hey I'm looking to scrape tweets (tweet body) for example from last one month. How do I exactly set it up?
I created action like this:

Image

But it only goes to 100 results.

Max scrape results in global settings is 10.000.

How do I create action that scrape more than 100, and even set it up to scrape only from this month for example?

Logs: 21913

Thank you!

Re: Scrape from search

Posted: Tue May 08, 2018 7:12 am
by support@rootjazz
Hey I'm looking to scrape tweets (tweet body) for example from last one month.
I don;t think there is a way bu which we can scrape last months tweet. But, let me find a way for you.

recent tweet search has no PERFECT WAY that will deliver you the LAST months tweets.

But it only goes to 100 results.
What is the max item value? set it to your desired value
Also
Double click on tweets recent > set value to your desired value


Should help you.
How do I create action that scrape more than 100, and even set it up to scrape only from this month for example?
No guarantee for LAST month.
Well, found a way -



TD > tweet search module > Tweet filter > max hours since tweet > set the value

max = 30 days x 24 hours

try this filter and also look into the other filter that might help you.



Best regards