Scraping Issues

Support / help / discussion forum for twitter bot
User avatar
martin@rootjazz
Site Admin
Posts: 34359
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scraping Issues

Post by martin@rootjazz »

Next update the in-action save will save correctly to the file as well



Regards,
Martin
User avatar
martin@rootjazz
Site Admin
Posts: 34359
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scraping Issues

Post by martin@rootjazz »

starelong
Posts: 7
Joined: Thu Apr 11, 2019 11:11 pm

Re: Scraping Issues

Post by starelong »

Image

is it possible to use a list of accounts here?
i want to scrape followers of @steelers
as well as all the associated steelers players accounts

@joehaden23
@SteelersPRBurt
@anotherplayer
@player4

etc...

do i have to set each as an individual process or can i load many accounts and many terms here?
User avatar
martin@rootjazz
Site Admin
Posts: 34359
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scraping Issues

Post by martin@rootjazz »

two options:

1)
put the values into a file, one per line.
search input: your file path
In your custom search, the first step should be A USER / ID / URL (something to that effect)

this will load your file as a the first step and then loop over them all in a single action. NOTE you will want to set the number_results_to_return value for each step ****


2) Similar to above, but do NOT set the first step mentioned above, have your first step as FOLLOWERS, this will then create one action per line in your file.

No difference really, just depending if you want many actions or single action in your processor.



--------------------------------
***
Twitterdub custom search tutorial
- Explains how to build a search and specify how many results per step (optional)

https://www.youtube.com/watch?v=FYP9Gvh2n-M
Post Reply