Scraping list members "page does not exist" error

Support / help / discussion forum for twitter bot
Post Reply
markds10
Posts: 59
Joined: Tue Dec 17, 2019 2:37 pm

Scraping list members "page does not exist" error

Post by markds10 »

Hi,

I have been using the scraping tool before and it worked fine, now however I try to scrape list members I get errors saying:

Starting: 23/02/2020 12:11 PM
Perform custom search
Max Results Wanted: 5000
Setup custom search controller
Custom search run: search: https://twitter.com/i/lists/1178350655683125248
Perform custom search: #chain/total: 1/1 List Members using: T*******
One search stage detected, setting default per item per stage value to max: 5000
Start search: List Members with: https://twitter.com/i/lists/1178350655683125248(5000) using: T********s_
Search: ListMembers with: T********s_ max: 5000
FAILED GET: (676663) 404
https://api.twitter.com/1.1/lists/membe ... 5683125248
* WARNING: Request failed with Twitter response: Sorry, that page does not exist.
Paused for 6secs
* STOP: no more items: (0) https://api.twitter.com/1.1/lists/membe ... 5683125248
Results of search: 0 List Members with: https://twitter.com/i/lists/1178350655683125248
Handle results: 0 nextstep: 2/1
End of chain: Store results: 0
Finished search: results: 0
Results: 0
Started: 23/02/2020 12:11 PM
Finished: 23/02/2020 12:11 PM
ID: d6c5020e-ccb6-4545-9f2e-7ab6c6917e40
Action ran for: 0hr:0min:13s

Anything I've done wrong?
I also tried opening the memberslist from that list and copied that link but gave the same errors.
User avatar
martin@rootjazz
Site Admin
Posts: 34375
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scraping list members "page does not exist" error

Post by martin@rootjazz »

that list format looks wrong. Let me run some tests
User avatar
martin@rootjazz
Site Admin
Posts: 34375
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scraping list members "page does not exist" error

Post by martin@rootjazz »

the format is fine, twitter have changed what the format is and how the results are pulled. The program needs updating to handle this.

I will let you know once the update is ready


Regards,
Martin
markds10
Posts: 59
Joined: Tue Dec 17, 2019 2:37 pm

Re: Scraping list members "page does not exist" error

Post by markds10 »

Thank you :)
markds10
Posts: 59
Joined: Tue Dec 17, 2019 2:37 pm

Re: Scraping list members "page does not exist" error

Post by markds10 »

Thanks it works now!
User avatar
martin@rootjazz
Site Admin
Posts: 34375
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scraping list members "page does not exist" error

Post by martin@rootjazz »

8-)
Post Reply