Soundcloud scrape instagram/twitter links + profile details issue

Ask any support / help / issues / problem or question related to Soundcloud Manager
Post Reply
Bartekef
Posts: 595
Joined: Thu Sep 22, 2016 12:24 pm

Soundcloud scrape instagram/twitter links + profile details issue

Post by Bartekef » Thu Sep 12, 2019 5:59 pm

Hey so

1. I believe lately when you checked "profile details" in webscrape in soundcloud manager, it would scrape urls, bio AND instagram/twitter/tumblr/facebook and other URLs that user provides in his profile. Is this not supported anymore? Since I'm not getting it in .txt.

2. I chose to scrape profile details of .txt which as 12k urls, but it returned only about 2k. Could you please take a look at logs? (this action I cancelled about 7k processed items, and it returned only like ~400 profiles details)

Logs: 55389

I made sure there are no filters.

I believe it's the same issue I asked about on Instadub forum. But there is no filter.

Edit: now I think that might be cool option though - to scrape both WITH and WITHOUT emails (so for those that don't have contact info, I would send DMs through Soundcloud).

User avatar
martin@rootjazz
Site Admin
Posts: 22163
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Soundcloud scrape instagram/twitter links + profile details issue

Post by martin@rootjazz » Fri Sep 13, 2019 12:55 pm

Bartekef wrote:
Thu Sep 12, 2019 5:59 pm
Hey so

1. I believe lately when you checked "profile details" in webscrape in soundcloud manager, it would scrape urls, bio AND instagram/twitter/tumblr/facebook and other URLs that user provides in his profile. Is this not supported anymore? Since I'm not getting it in .txt.
No this info has never been scraped via PROFILE DETAILS option for email scrape
2. I chose to scrape profile details of .txt which as 12k urls, but it returned only about 2k. Could you please take a look at logs? (this action I cancelled about 7k processed items, and it returned only like ~400 profiles details)
It was an email scrape, most do not include their email in the bio

I believe it's the same issue I asked about on Instadub forum. But there is no filter.
Not sure I understand. You performed an email scrape, save only details if email in bio.
Edit: now I think that might be cool option though - to scrape both WITH and WITHOUT emails (so for those that don't have contact info, I would send DMs through Soundcloud).
Suggestion noted for an "include email in bio" filter option

Bartekef
Posts: 595
Joined: Thu Sep 22, 2016 12:24 pm

Re: Soundcloud scrape instagram/twitter links + profile details issue

Post by Bartekef » Sun Sep 15, 2019 9:20 pm

martin@rootjazz wrote:
Fri Sep 13, 2019 12:55 pm
Not sure I understand. You performed an email scrape, save only details if email in bio.
Oh I didn't see "scrape profile details" option on the bottom smh :lol:

User avatar
martin@rootjazz
Site Admin
Posts: 22163
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Soundcloud scrape instagram/twitter links + profile details issue

Post by martin@rootjazz » Mon Sep 16, 2019 2:53 pm

Bartekef wrote:
Sun Sep 15, 2019 9:20 pm
martin@rootjazz wrote:
Fri Sep 13, 2019 12:55 pm
Not sure I understand. You performed an email scrape, save only details if email in bio.
Oh I didn't see "scrape profile details" option on the bottom smh :lol:
Just incase others misunderstood / didn't see.

EMAIL SCRAPE at the top, will ONLY save out if an email is found.

Lower down is profile / track scrape options, that will save all results (or results that meet filter if filter specified)



Regards,
Martin

Post Reply