Hey!
I am curious on what the Recursive process will do in the scrape tab?
Thanks
What is the recursive process in the scrape tab?
-
- Posts: 166
- Joined: Sat Jan 14, 2017 12:17 pm
- martin@rootjazz
- Site Admin
- Posts: 35057
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: What is the recursive process in the scrape tab?
it was a pre-cursor to custom search.
It will recursively scrape followers
so enter a profile
1) scrape 100 followers from the profile
2) from each 100 results, scrape 100 of their followers
3) from the 10000 results from (2) scrape 100 followers from each
etc etc
until you get your requested N results
It will recursively scrape followers
so enter a profile
1) scrape 100 followers from the profile
2) from each 100 results, scrape 100 of their followers
3) from the 10000 results from (2) scrape 100 followers from each
etc etc
until you get your requested N results
-
- Posts: 166
- Joined: Sat Jan 14, 2017 12:17 pm
Re: What is the recursive process in the scrape tab?
Thanks, I didn't see in the docs and googled the word and didn't know how it applied.
Thanks again.
Thanks again.
- martin@rootjazz
- Site Admin
- Posts: 35057
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: What is the recursive process in the scrape tab?
"recursive" in programming, means something that feeds back to itself. So the results of function are fed back into itself to get more results.
something like this
note that the GetFollowers function calls itself, so it "recurses" to infinity (unless we break out at some point)
something like this
Code: Select all
totalResults = new List
function GetFollowers(profileUrl)
results = SearchFollowers(profileUrl);
totalResults.add(results)
for each result in results
GetFollows(result)
-
- Posts: 166
- Joined: Sat Jan 14, 2017 12:17 pm
Re: What is the recursive process in the scrape tab?
That is impressive. Yes, the function works extremely well.