Page 1 of 1

Soundcloud email scraper - not scraping all emails

Posted: Wed Aug 28, 2013 11:25 pm
by martin@rootjazz
> I have a problem, I have one list very long
> of user soundcloud I try to scrape the email, but everytime
> software find only 12 email (the same 12 addresses to any attempt).
> Maybe I need to change something in the configuration settings?
> I try to search in forum support, but the video it's an old version of the
> software.
The email scrape routine, will only find emails IF the user has added their email to their PROFILE BIO. Not many do this (as it can attract spam ;-)

So you will not expect to get the full emails from all users. If users are not displaying their email, you cannot access it.

As you are scraping the same 12 emails every time, that would sugget only 12 users of your list are publicly displaying the email

Re: Soundcloud email scraper - not scraping all emails

Posted: Fri Oct 11, 2013 6:47 am
by stantheman
couldn't you have it search the description?

Re: Soundcloud email scraper - not scraping all emails

Posted: Fri Oct 11, 2013 12:59 pm
by martin@rootjazz
Sorry I do not understand your question.

The SCM routine pulls the profile (eg URL http://soundcloud.com/ninja-warrior). It then tries to find an email ANYWHERE on the page. If found it is noted, if not, ignored.

Re: Soundcloud email scraper - not scraping all emails

Posted: Fri Oct 18, 2013 2:14 am
by stantheman
ah, so profile bio is same as description.

was confused as soundcloud calls it description

Re: Soundcloud email scraper - not scraping all emails

Posted: Fri Oct 18, 2013 1:48 pm
by martin@rootjazz
Oh yes, my mistake I use similar words interchangeably with the hope that some of the time I use the right one.

Bio / description / user info
Likes / favs / favourites

etc etc

:-)