Typical profile detail scrape return rate?

Ask any support / help / issues / problem or question related to Soundcloud Manager
remiremiremiremi
Posts: 4
Joined: Mon Jul 31, 2017 7:36 pm

Typical profile detail scrape return rate?

Postby remiremiremiremi » Tue Aug 08, 2017 6:45 pm

Hi all,

I've been scraping soundcloud followers then scraping the profile details from there. The profile detail scrape typically returns about 3% of the profiles from the follower scrape - is that normal? It means that between the follower scrape and the profile detail scrape, I can only return between 3 and 4 thousand profile details after 6 hours of scraping (120,000 profiles).

I'd love to hear what a normal return rate is so I know that I'm not doing anything wrong, or if I can change anything to get better results!

User avatar
martin@rootjazz
Site Admin
Posts: 13472
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Typical profile detail scrape return rate?

Postby martin@rootjazz » Wed Aug 09, 2017 2:28 pm

I Am not sure I understand.

1) you scrape the followers to a file
2) you use the file from (1) to scrape profile details from?


If so, then you should have the same number of profile details as you do results from (1)

Or did you mean you are performing a scrape with email details scrape as well? If so, then yes you will only get a fraction as most accounts DO NOT include an email in the bio, you will only scrape users with an email in the bio

IF you want all results details, then do a specific profile details scrape action

remiremiremiremi
Posts: 4
Joined: Mon Jul 31, 2017 7:36 pm

Re: Typical profile detail scrape return rate?

Postby remiremiremiremi » Thu Aug 10, 2017 2:45 pm

Hi martin,

Thanks for the reply - yes, I was referring to an email scrape for the second step that would also include profile details.

I guess I was just surprised that so few accounts have an attached email.

thanks again!

User avatar
martin@rootjazz
Site Admin
Posts: 13472
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Typical profile detail scrape return rate?

Postby martin@rootjazz » Fri Aug 11, 2017 3:53 pm

It can depend.

Search for record labels and you probably get lots of emails

Search for other keywords and probably get less


Return to “Support Soundcloud Manager”

Who is online

Users browsing this forum: No registered users and 1 guest