Scrape from search

Support / help / discussion forum for twitter bot
Post Reply
Bartekef
Posts: 677
Joined: Thu Sep 22, 2016 12:24 pm

Scrape from search

Post by Bartekef »

Hey I'm looking to scrape tweets (tweet body) for example from last one month. How do I exactly set it up?
I created action like this:

Image

But it only goes to 100 results.

Max scrape results in global settings is 10.000.

How do I create action that scrape more than 100, and even set it up to scrape only from this month for example?

Logs: 21913

Thank you!
support@rootjazz
Posts: 2317
Joined: Tue Feb 02, 2016 1:58 pm

Re: Scrape from search

Post by support@rootjazz »

Hey I'm looking to scrape tweets (tweet body) for example from last one month.
I don;t think there is a way bu which we can scrape last months tweet. But, let me find a way for you.

recent tweet search has no PERFECT WAY that will deliver you the LAST months tweets.

But it only goes to 100 results.
What is the max item value? set it to your desired value
Also
Double click on tweets recent > set value to your desired value


Should help you.
How do I create action that scrape more than 100, and even set it up to scrape only from this month for example?
No guarantee for LAST month.
Well, found a way -



TD > tweet search module > Tweet filter > max hours since tweet > set the value

max = 30 days x 24 hours

try this filter and also look into the other filter that might help you.



Best regards
Post Reply