Page 1 of 2

trying to scrape a profiles "lists"

Posted: Mon Mar 05, 2018 2:32 pm
by SkullLife
I've been reading through the forum, watched the videos, and done searchers on this but can not figure this out. I would like to scrape a profile's list that they created so I may follow the users on their list. I been able to scrape a profile's followers and followings but not their lists. It seems like it should be doable since there are page urls to do this at, I just can't seem to find the way to do it. How is this done? Any help would be appreciated! Thanks!

Re: trying to scrape a profiles "lists"

Posted: Wed Mar 07, 2018 2:21 pm
by martin@rootjazz
Can you send me an example of a list? I don't think lists are supported, but I can take a look

Re: trying to scrape a profiles "lists"

Posted: Wed Mar 14, 2018 5:42 am
by SkullLife
It's kind of hard to explain without just saying its a list that you can create of other people on twitter and it is available to everyone else if you have it set to public. The best thing I can do is post some screen shots I think that might explain it a lot better than I am.

Img 1 shows where to find the lists. As shown here, this user has 9 lists created:
Image

Img 2 shows what it looks like when you click on the lists/number. It now shows all 9 of the lists that the user made. I cut is off at 3 for space:
Image

Img 3 shows what it looks like when you click on the list itself/list name. In this case I clicked on the list "Moments".
Image

Img 4 shows what it looks like when you click on the list memebers. In this case I clicked on the number 9. It will show all 9 people in the list.
Image

Here is the actul URL for the list members https://twitter.com/Twitter/lists/moments/members
Of course each list will have its own URL.

I hope that explained it well enough. If not please let me know. Thanks

Re: trying to scrape a profiles "lists"

Posted: Wed Mar 14, 2018 7:03 am
by support@rootjazz
The explanation was perfect and is understood. This is really low amount of memebers actually. I am reuqesting martin for it and he will update you accordingly.


Regards

Re: trying to scrape a profiles "lists"

Posted: Wed Mar 14, 2018 7:06 am
by SkullLife
I just picked a random list as an example. The lists that I would like to use have 100s in some and 1000s in others.

Thanks again!

Re: trying to scrape a profiles "lists"

Posted: Wed Mar 14, 2018 7:07 pm
by martin@rootjazz
SkullLife wrote: Wed Mar 14, 2018 5:42 am
Here is the actul URL for the list members https://twitter.com/Twitter/lists/moments/members
Of course each list will have its own URL.

I hope that explained it well enough. If not please let me know. Thanks
That's what I wanted, just save me for looking for one :)

Re: trying to scrape a profiles "lists"

Posted: Wed Mar 14, 2018 7:10 pm
by martin@rootjazz
ok, it will be possible. Might have it ready this week, if not early next

Re: trying to scrape a profiles "lists"

Posted: Wed Mar 14, 2018 9:15 pm
by SkullLife
That's Awesome! Thanks so much! :D

Re: trying to scrape a profiles "lists"

Posted: Thu Mar 15, 2018 7:47 am
by support@rootjazz
SkullLife wrote: Wed Mar 14, 2018 9:15 pm That's Awesome! Thanks so much! :D
If not done in next week, please give this thread a life later which we call bumping a thread. :)

Re: trying to scrape a profiles "lists"

Posted: Fri Mar 23, 2018 10:06 pm
by SkullLife
support@rootjazz wrote: Thu Mar 15, 2018 7:47 am
SkullLife wrote: Wed Mar 14, 2018 9:15 pm That's Awesome! Thanks so much! :D
If not done in next week, please give this thread a life later which we call bumping a thread. :)
as you requested I do, I am "bumping" the thread :D