trying to scrape a profiles "lists"

Support / help / discussion forum for twitter bot
SkullLife
Posts: 40
Joined: Sat Mar 03, 2018 5:08 pm

trying to scrape a profiles "lists"

Post by SkullLife » Mon Mar 05, 2018 2:32 pm

I've been reading through the forum, watched the videos, and done searchers on this but can not figure this out. I would like to scrape a profile's list that they created so I may follow the users on their list. I been able to scrape a profile's followers and followings but not their lists. It seems like it should be doable since there are page urls to do this at, I just can't seem to find the way to do it. How is this done? Any help would be appreciated! Thanks!

User avatar
martin@rootjazz
Site Admin
Posts: 18502
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: trying to scrape a profiles "lists"

Post by martin@rootjazz » Wed Mar 07, 2018 2:21 pm

Can you send me an example of a list? I don't think lists are supported, but I can take a look

SkullLife
Posts: 40
Joined: Sat Mar 03, 2018 5:08 pm

Re: trying to scrape a profiles "lists"

Post by SkullLife » Wed Mar 14, 2018 5:42 am

It's kind of hard to explain without just saying its a list that you can create of other people on twitter and it is available to everyone else if you have it set to public. The best thing I can do is post some screen shots I think that might explain it a lot better than I am.

Img 1 shows where to find the lists. As shown here, this user has 9 lists created:
Image

Img 2 shows what it looks like when you click on the lists/number. It now shows all 9 of the lists that the user made. I cut is off at 3 for space:
Image

Img 3 shows what it looks like when you click on the list itself/list name. In this case I clicked on the list "Moments".
Image

Img 4 shows what it looks like when you click on the list memebers. In this case I clicked on the number 9. It will show all 9 people in the list.
Image

Here is the actul URL for the list members https://twitter.com/Twitter/lists/moments/members
Of course each list will have its own URL.

I hope that explained it well enough. If not please let me know. Thanks

support@rootjazz
Posts: 2317
Joined: Tue Feb 02, 2016 1:58 pm

Re: trying to scrape a profiles "lists"

Post by support@rootjazz » Wed Mar 14, 2018 7:03 am

The explanation was perfect and is understood. This is really low amount of memebers actually. I am reuqesting martin for it and he will update you accordingly.


Regards

SkullLife
Posts: 40
Joined: Sat Mar 03, 2018 5:08 pm

Re: trying to scrape a profiles "lists"

Post by SkullLife » Wed Mar 14, 2018 7:06 am

I just picked a random list as an example. The lists that I would like to use have 100s in some and 1000s in others.

Thanks again!

User avatar
martin@rootjazz
Site Admin
Posts: 18502
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: trying to scrape a profiles "lists"

Post by martin@rootjazz » Wed Mar 14, 2018 7:07 pm

SkullLife wrote:
Wed Mar 14, 2018 5:42 am

Here is the actul URL for the list members https://twitter.com/Twitter/lists/moments/members
Of course each list will have its own URL.

I hope that explained it well enough. If not please let me know. Thanks
That's what I wanted, just save me for looking for one :)

User avatar
martin@rootjazz
Site Admin
Posts: 18502
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: trying to scrape a profiles "lists"

Post by martin@rootjazz » Wed Mar 14, 2018 7:10 pm

ok, it will be possible. Might have it ready this week, if not early next

SkullLife
Posts: 40
Joined: Sat Mar 03, 2018 5:08 pm

Re: trying to scrape a profiles "lists"

Post by SkullLife » Wed Mar 14, 2018 9:15 pm

That's Awesome! Thanks so much! :D

support@rootjazz
Posts: 2317
Joined: Tue Feb 02, 2016 1:58 pm

Re: trying to scrape a profiles "lists"

Post by support@rootjazz » Thu Mar 15, 2018 7:47 am

SkullLife wrote:
Wed Mar 14, 2018 9:15 pm
That's Awesome! Thanks so much! :D
If not done in next week, please give this thread a life later which we call bumping a thread. :)

SkullLife
Posts: 40
Joined: Sat Mar 03, 2018 5:08 pm

Re: trying to scrape a profiles "lists"

Post by SkullLife » Fri Mar 23, 2018 10:06 pm

support@rootjazz wrote:
Thu Mar 15, 2018 7:47 am
SkullLife wrote:
Wed Mar 14, 2018 9:15 pm
That's Awesome! Thanks so much! :D
If not done in next week, please give this thread a life later which we call bumping a thread. :)
as you requested I do, I am "bumping" the thread :D

Post Reply