trying to scrape a profiles "lists"
trying to scrape a profiles "lists"
I've been reading through the forum, watched the videos, and done searchers on this but can not figure this out. I would like to scrape a profile's list that they created so I may follow the users on their list. I been able to scrape a profile's followers and followings but not their lists. It seems like it should be doable since there are page urls to do this at, I just can't seem to find the way to do it. How is this done? Any help would be appreciated! Thanks!
- martin@rootjazz
- Site Admin
- Posts: 34782
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: trying to scrape a profiles "lists"
Can you send me an example of a list? I don't think lists are supported, but I can take a look
Re: trying to scrape a profiles "lists"
It's kind of hard to explain without just saying its a list that you can create of other people on twitter and it is available to everyone else if you have it set to public. The best thing I can do is post some screen shots I think that might explain it a lot better than I am.
Img 1 shows where to find the lists. As shown here, this user has 9 lists created:
Img 2 shows what it looks like when you click on the lists/number. It now shows all 9 of the lists that the user made. I cut is off at 3 for space:
Img 3 shows what it looks like when you click on the list itself/list name. In this case I clicked on the list "Moments".
Img 4 shows what it looks like when you click on the list memebers. In this case I clicked on the number 9. It will show all 9 people in the list.
Here is the actul URL for the list members https://twitter.com/Twitter/lists/moments/members
Of course each list will have its own URL.
I hope that explained it well enough. If not please let me know. Thanks
Img 1 shows where to find the lists. As shown here, this user has 9 lists created:
Img 2 shows what it looks like when you click on the lists/number. It now shows all 9 of the lists that the user made. I cut is off at 3 for space:
Img 3 shows what it looks like when you click on the list itself/list name. In this case I clicked on the list "Moments".
Img 4 shows what it looks like when you click on the list memebers. In this case I clicked on the number 9. It will show all 9 people in the list.
Here is the actul URL for the list members https://twitter.com/Twitter/lists/moments/members
Of course each list will have its own URL.
I hope that explained it well enough. If not please let me know. Thanks
-
- Posts: 2317
- Joined: Tue Feb 02, 2016 1:58 pm
Re: trying to scrape a profiles "lists"
The explanation was perfect and is understood. This is really low amount of memebers actually. I am reuqesting martin for it and he will update you accordingly.
Regards
Regards
Re: trying to scrape a profiles "lists"
I just picked a random list as an example. The lists that I would like to use have 100s in some and 1000s in others.
Thanks again!
Thanks again!
- martin@rootjazz
- Site Admin
- Posts: 34782
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: trying to scrape a profiles "lists"
That's what I wanted, just save me for looking for oneSkullLife wrote: ↑Wed Mar 14, 2018 5:42 am
Here is the actul URL for the list members https://twitter.com/Twitter/lists/moments/members
Of course each list will have its own URL.
I hope that explained it well enough. If not please let me know. Thanks
- martin@rootjazz
- Site Admin
- Posts: 34782
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: trying to scrape a profiles "lists"
ok, it will be possible. Might have it ready this week, if not early next
Re: trying to scrape a profiles "lists"
That's Awesome! Thanks so much!
-
- Posts: 2317
- Joined: Tue Feb 02, 2016 1:58 pm
Re: trying to scrape a profiles "lists"
as you requested I do, I am "bumping" the threadsupport@rootjazz wrote: ↑Thu Mar 15, 2018 7:47 amIf not done in next week, please give this thread a life later which we call bumping a thread.