Page 1 of 1

Soundcloud scrape instagram/twitter links + profile details issue

Posted: Thu Sep 12, 2019 5:59 pm
by Bartekef
Hey so

1. I believe lately when you checked "profile details" in webscrape in soundcloud manager, it would scrape urls, bio AND instagram/twitter/tumblr/facebook and other URLs that user provides in his profile. Is this not supported anymore? Since I'm not getting it in .txt.

2. I chose to scrape profile details of .txt which as 12k urls, but it returned only about 2k. Could you please take a look at logs? (this action I cancelled about 7k processed items, and it returned only like ~400 profiles details)

Logs: 55389

I made sure there are no filters.

I believe it's the same issue I asked about on Instadub forum. But there is no filter.

Edit: now I think that might be cool option though - to scrape both WITH and WITHOUT emails (so for those that don't have contact info, I would send DMs through Soundcloud).

Re: Soundcloud scrape instagram/twitter links + profile details issue

Posted: Fri Sep 13, 2019 12:55 pm
by martin@rootjazz
Bartekef wrote: Thu Sep 12, 2019 5:59 pm Hey so

1. I believe lately when you checked "profile details" in webscrape in soundcloud manager, it would scrape urls, bio AND instagram/twitter/tumblr/facebook and other URLs that user provides in his profile. Is this not supported anymore? Since I'm not getting it in .txt.
No this info has never been scraped via PROFILE DETAILS option for email scrape
2. I chose to scrape profile details of .txt which as 12k urls, but it returned only about 2k. Could you please take a look at logs? (this action I cancelled about 7k processed items, and it returned only like ~400 profiles details)
It was an email scrape, most do not include their email in the bio

I believe it's the same issue I asked about on Instadub forum. But there is no filter.
Not sure I understand. You performed an email scrape, save only details if email in bio.
Edit: now I think that might be cool option though - to scrape both WITH and WITHOUT emails (so for those that don't have contact info, I would send DMs through Soundcloud).
Suggestion noted for an "include email in bio" filter option

Re: Soundcloud scrape instagram/twitter links + profile details issue

Posted: Sun Sep 15, 2019 9:20 pm
by Bartekef
martin@rootjazz wrote: Fri Sep 13, 2019 12:55 pm Not sure I understand. You performed an email scrape, save only details if email in bio.
Oh I didn't see "scrape profile details" option on the bottom smh :lol:

Re: Soundcloud scrape instagram/twitter links + profile details issue

Posted: Mon Sep 16, 2019 2:53 pm
by martin@rootjazz
Bartekef wrote: Sun Sep 15, 2019 9:20 pm
martin@rootjazz wrote: Fri Sep 13, 2019 12:55 pm Not sure I understand. You performed an email scrape, save only details if email in bio.
Oh I didn't see "scrape profile details" option on the bottom smh :lol:
Just incase others misunderstood / didn't see.

EMAIL SCRAPE at the top, will ONLY save out if an email is found.

Lower down is profile / track scrape options, that will save all results (or results that meet filter if filter specified)



Regards,
Martin