Hey so
1. I believe lately when you checked "profile details" in webscrape in soundcloud manager, it would scrape urls, bio AND instagram/twitter/tumblr/facebook and other URLs that user provides in his profile. Is this not supported anymore? Since I'm not getting it in .txt.
2. I chose to scrape profile details of .txt which as 12k urls, but it returned only about 2k. Could you please take a look at logs? (this action I cancelled about 7k processed items, and it returned only like ~400 profiles details)
Logs: 55389
I made sure there are no filters.
I believe it's the same issue I asked about on Instadub forum. But there is no filter.
Edit: now I think that might be cool option though - to scrape both WITH and WITHOUT emails (so for those that don't have contact info, I would send DMs through Soundcloud).
Soundcloud scrape instagram/twitter links + profile details issue
- martin@rootjazz
- Site Admin
- Posts: 35057
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Soundcloud scrape instagram/twitter links + profile details issue
No this info has never been scraped via PROFILE DETAILS option for email scrapeBartekef wrote: ↑Thu Sep 12, 2019 5:59 pm Hey so
1. I believe lately when you checked "profile details" in webscrape in soundcloud manager, it would scrape urls, bio AND instagram/twitter/tumblr/facebook and other URLs that user provides in his profile. Is this not supported anymore? Since I'm not getting it in .txt.
It was an email scrape, most do not include their email in the bio2. I chose to scrape profile details of .txt which as 12k urls, but it returned only about 2k. Could you please take a look at logs? (this action I cancelled about 7k processed items, and it returned only like ~400 profiles details)
Not sure I understand. You performed an email scrape, save only details if email in bio.I believe it's the same issue I asked about on Instadub forum. But there is no filter.
Suggestion noted for an "include email in bio" filter optionEdit: now I think that might be cool option though - to scrape both WITH and WITHOUT emails (so for those that don't have contact info, I would send DMs through Soundcloud).
Re: Soundcloud scrape instagram/twitter links + profile details issue
Oh I didn't see "scrape profile details" option on the bottom smhmartin@rootjazz wrote: ↑Fri Sep 13, 2019 12:55 pm Not sure I understand. You performed an email scrape, save only details if email in bio.
- martin@rootjazz
- Site Admin
- Posts: 35057
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Soundcloud scrape instagram/twitter links + profile details issue
Just incase others misunderstood / didn't see.Bartekef wrote: ↑Sun Sep 15, 2019 9:20 pmOh I didn't see "scrape profile details" option on the bottom smhmartin@rootjazz wrote: ↑Fri Sep 13, 2019 12:55 pm Not sure I understand. You performed an email scrape, save only details if email in bio.
EMAIL SCRAPE at the top, will ONLY save out if an email is found.
Lower down is profile / track scrape options, that will save all results (or results that meet filter if filter specified)
Regards,
Martin