Page 1 of 1
What is the recursive process in the scrape tab?
Posted: Tue Aug 28, 2018 1:10 am
by JasperJones
Hey!
I am curious on what the Recursive process will do in the scrape tab?
Thanks
Re: What is the recursive process in the scrape tab?
Posted: Tue Aug 28, 2018 4:07 pm
by martin@rootjazz
it was a pre-cursor to custom search.
It will recursively scrape followers
so enter a profile
1) scrape 100 followers from the profile
2) from each 100 results, scrape 100 of their followers
3) from the 10000 results from (2) scrape 100 followers from each
etc etc
until you get your requested N results
Re: What is the recursive process in the scrape tab?
Posted: Tue Aug 28, 2018 5:09 pm
by JasperJones
Thanks, I didn't see in the docs and googled the word and didn't know how it applied.
Thanks again.
Re: What is the recursive process in the scrape tab?
Posted: Tue Aug 28, 2018 7:24 pm
by martin@rootjazz
"recursive" in programming, means something that feeds back to itself. So the results of function are fed back into itself to get more results.
something like this
Code: Select all
totalResults = new List
function GetFollowers(profileUrl)
results = SearchFollowers(profileUrl);
totalResults.add(results)
for each result in results
GetFollows(result)
note that the GetFollowers function calls itself, so it "recurses" to infinity (unless we break out at some point)
Re: What is the recursive process in the scrape tab?
Posted: Tue Aug 28, 2018 7:28 pm
by JasperJones
That is impressive. Yes, the function works extremely well.