Hi,
I have been using the scraping tool before and it worked fine, now however I try to scrape list members I get errors saying:
Starting: 23/02/2020 12:11 PM
Perform custom search
Max Results Wanted: 5000
Setup custom search controller
Custom search run: search: https://twitter.com/i/lists/1178350655683125248
Perform custom search: #chain/total: 1/1 List Members using: T*******
One search stage detected, setting default per item per stage value to max: 5000
Start search: List Members with: https://twitter.com/i/lists/1178350655683125248(5000) using: T********s_
Search: ListMembers with: T********s_ max: 5000
FAILED GET: (676663) 404
https://api.twitter.com/1.1/lists/membe ... 5683125248
* WARNING: Request failed with Twitter response: Sorry, that page does not exist.
Paused for 6secs
* STOP: no more items: (0) https://api.twitter.com/1.1/lists/membe ... 5683125248
Results of search: 0 List Members with: https://twitter.com/i/lists/1178350655683125248
Handle results: 0 nextstep: 2/1
End of chain: Store results: 0
Finished search: results: 0
Results: 0
Started: 23/02/2020 12:11 PM
Finished: 23/02/2020 12:11 PM
ID: d6c5020e-ccb6-4545-9f2e-7ab6c6917e40
Action ran for: 0hr:0min:13s
Anything I've done wrong?
I also tried opening the memberslist from that list and copied that link but gave the same errors.
Scraping list members "page does not exist" error
- martin@rootjazz
- Site Admin
- Posts: 34634
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scraping list members "page does not exist" error
that list format looks wrong. Let me run some tests
- martin@rootjazz
- Site Admin
- Posts: 34634
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scraping list members "page does not exist" error
the format is fine, twitter have changed what the format is and how the results are pulled. The program needs updating to handle this.
I will let you know once the update is ready
Regards,
Martin
I will let you know once the update is ready
Regards,
Martin
- martin@rootjazz
- Site Admin
- Posts: 34634
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scraping list members "page does not exist" error
Thanks it works now!
- martin@rootjazz
- Site Admin
- Posts: 34634
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact: