Typical profile detail scrape return rate?
Posted: Tue Aug 08, 2017 6:45 pm
Hi all,
I've been scraping soundcloud followers then scraping the profile details from there. The profile detail scrape typically returns about 3% of the profiles from the follower scrape - is that normal? It means that between the follower scrape and the profile detail scrape, I can only return between 3 and 4 thousand profile details after 6 hours of scraping (120,000 profiles).
I'd love to hear what a normal return rate is so I know that I'm not doing anything wrong, or if I can change anything to get better results!
I've been scraping soundcloud followers then scraping the profile details from there. The profile detail scrape typically returns about 3% of the profiles from the follower scrape - is that normal? It means that between the follower scrape and the profile detail scrape, I can only return between 3 and 4 thousand profile details after 6 hours of scraping (120,000 profiles).
I'd love to hear what a normal return rate is so I know that I'm not doing anything wrong, or if I can change anything to get better results!