Can't scrape more then 18 Items

Support / help / discussion forum for twitter bot
Post Reply
sunder321
Posts: 74
Joined: Thu Nov 02, 2017 10:55 am

Can't scrape more then 18 Items

Post by sunder321 »

Hi! Firstly thanks for the big update of Twitterdub v 2.0. I run it today and i have problems with scraping. I can't scrape more then 18 users. Its says that: WARNING: duplicate cursor received - assumed end of results.

Code: Select all

Checking Filter: Default Av
Filter user: https://twitter.com/mikelthepickle_  = mikelthepickle_
Checking Filter: Default Av
Filter user: https://twitter.com/MedumWellMusic1  = MedumWellMusic1
Checking Filter: Default Av
Filter user: https://twitter.com/MaZuRCS  = MaZuRCS
Checking Filter: Default Av
Filter user: https://twitter.com/Matthwellmusic  = Matthwellmusic
Checking Filter: Default Av
Filter user: https://twitter.com/seanjerhemy  = seanjerhemy
Checking Filter: Default Av
Filter user: https://twitter.com/dub05010115  = dub05010115
Checking Filter: Default Av
Filter user: https://twitter.com/kkss96  = kkss96
Checking Filter: Default Av
Filter user: https://twitter.com/Cat77Twilight  = Cat77Twilight
Checking Filter: Default Av
Filter user: https://twitter.com/kin_kuna  = kin_kuna
Checking Filter: Default Av
Filter user: https://twitter.com/JohanZ2002  = JohanZ2002
Results: 10
Checking Filter: Default Av
Filter user: https://twitter.com/kenny_hess  = kenny_hess
Checking Filter: Default Av
Filter user: https://twitter.com/middlechilddan  = middlechilddan
Checking Filter: Default Av
Filter user: https://twitter.com/jq8ZSb6SGLRdWLE  = jq8ZSb6SGLRdWLE
Checking Filter: Default Av
Filter user: https://twitter.com/Camkin_Nexus01  = Camkin_Nexus01
Checking Filter: Default Av
Filter user: https://twitter.com/smellydeqa32  = smellydeqa32
Checking Filter: Default Av
Filter user: https://twitter.com/Sanguin65318231  = Sanguin65318231
Checking Filter: Default Av
Filter user: https://twitter.com/GalacticLightz  = GalacticLightz
Checking Filter: Default Av
Filter user: https://twitter.com/Beepmg  = Beepmg
* IGNORE: Default Av
* IGNORE: Filtered: https://twitter.com/Beepmg
Checking Filter: Default Av
Filter user: https://twitter.com/duv70650239  = duv70650239
* IGNORE: Default Av
* IGNORE: Filtered: https://twitter.com/duv70650239
Checking Filter: Default Av
Filter user: https://twitter.com/moret_gustavo  = moret_gustavo
Results: 18
Next cursor: 1608194939862333329
Checking Filter: Default Av
Filter user: https://twitter.com/mikelthepickle_  = mikelthepickle_
Checking Filter: Default Av
Filter user: https://twitter.com/MedumWellMusic1  = MedumWellMusic1
Checking Filter: Default Av
Filter user: https://twitter.com/MaZuRCS  = MaZuRCS
Checking Filter: Default Av
Filter user: https://twitter.com/Matthwellmusic  = Matthwellmusic
Checking Filter: Default Av
Filter user: https://twitter.com/seanjerhemy  = seanjerhemy
Checking Filter: Default Av
Filter user: https://twitter.com/dub05010115  = dub05010115
Checking Filter: Default Av
Filter user: https://twitter.com/kkss96  = kkss96
Checking Filter: Default Av
Filter user: https://twitter.com/Cat77Twilight  = Cat77Twilight
Checking Filter: Default Av
Filter user: https://twitter.com/kin_kuna  = kin_kuna
Checking Filter: Default Av
Filter user: https://twitter.com/JohanZ2002  = JohanZ2002
Checking Filter: Default Av
Filter user: https://twitter.com/kenny_hess  = kenny_hess
Checking Filter: Default Av
Filter user: https://twitter.com/middlechilddan  = middlechilddan
Checking Filter: Default Av
Filter user: https://twitter.com/jq8ZSb6SGLRdWLE  = jq8ZSb6SGLRdWLE
Checking Filter: Default Av
Filter user: https://twitter.com/Camkin_Nexus01  = Camkin_Nexus01
Checking Filter: Default Av
Filter user: https://twitter.com/smellydeqa32  = smellydeqa32
Checking Filter: Default Av
Filter user: https://twitter.com/Sanguin65318231  = Sanguin65318231
Checking Filter: Default Av
Filter user: https://twitter.com/GalacticLightz  = GalacticLightz
Checking Filter: Default Av
Filter user: https://twitter.com/Beepmg  = Beepmg
* IGNORE: Default Av
* IGNORE: Filtered: https://twitter.com/Beepmg
Checking Filter: Default Av
Filter user: https://twitter.com/duv70650239  = duv70650239
* IGNORE: Default Av
* IGNORE: Filtered: https://twitter.com/duv70650239
Checking Filter: Default Av
Filter user: https://twitter.com/moret_gustavo  = moret_gustavo
Results: 18
[b]WARNING: duplicate cursor received - assumed end of results[/b]
Results of search: FollowersOf with: https://twitter.com/PegboardNerds
Handle results: 18 nextstep: 1/1
End of chain: Store results: 18
Results: 18
Saving to: ******************************
Started: 08.08.2018 18:05 
Finished: 08.08.2018 18:05 
ID: 528fd1cb-724d-469a-a689-203528719c30
Action ran for: 0hr:0min:3s
Is it only for me or its just error? Other function works well for me :)
User avatar
martin@rootjazz
Site Admin
Posts: 34360
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Can't scrape more then 18 Items

Post by martin@rootjazz »

What search are you running?

Might be an error, might not be any more results. I will need to test.

Also, might be useful if you could submit app logs
HELP > LOGS > SUBMIT

then send your logs ID - the first 4 numbers is sufficient (displayed after successful uploading of logs)






Regards,
Martin
sunder321
Posts: 74
Joined: Thu Nov 02, 2017 10:55 am

Re: Can't scrape more then 18 Items

Post by sunder321 »

I search Followers Of User. Set 1 filter: ignore if Default av and Maximum Scraping result is 10,000. Logs submitted: 54881
User avatar
martin@rootjazz
Site Admin
Posts: 34360
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Can't scrape more then 18 Items

Post by martin@rootjazz »

found the issue and fixed.

Next update will be ready in about an hour



Regards,
Martin
sunder321
Posts: 74
Joined: Thu Nov 02, 2017 10:55 am

Re: Can't scrape more then 18 Items

Post by sunder321 »

Thank you! :D
User avatar
martin@rootjazz
Site Admin
Posts: 34360
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Can't scrape more then 18 Items

Post by martin@rootjazz »

Can you confirm if that means it is now working for you. Or is it just a "thank you" for the link?
User avatar
martin@rootjazz
Site Admin
Posts: 34360
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Can't scrape more then 18 Items

Post by martin@rootjazz »

Post Reply