Scrape Emails from United Kingdom Profiles
Posted: Mon Jan 02, 2017 7:30 pm
Hi guys,
First of all, kudos to the developers here, this is a great piece of kit which I'm going to have lots of fun with
I've ran into one problem. I am trying to scrape emails from UK users only, I've looked on the YouTube guides but it seems that they are old and the software has been upgraded since.
The process I tried:
Soundcloud Modules -> Scraper
Using 5 proxies
Set Artist filter to United Kingdom
Scrape Followers of: "filepath of four popular UK profiles"
-> Scrape Users
This quickly scraped the users, but it did NOT scrape all users. For example, some accounts had a total of 400k followers, my TOTAL results from all four accounts was around 10k.
Using the user data scraped, I then ran another process:
Soundcloud Modules -> Scraper
Using 5 proxies
Set Artist filter to United Kingdom
Scrape Emails from Profiles: "filepath of the scrape above"
-> Scrape
The process has just about finished now, I've checked the output file and there are a LOT of US users on there, it seems the filter I applied did not work for some reason.
Can someone help me in the right direction please?
Thanks in advance, and all the best for the new year guys
First of all, kudos to the developers here, this is a great piece of kit which I'm going to have lots of fun with
I've ran into one problem. I am trying to scrape emails from UK users only, I've looked on the YouTube guides but it seems that they are old and the software has been upgraded since.
The process I tried:
Soundcloud Modules -> Scraper
Using 5 proxies
Set Artist filter to United Kingdom
Scrape Followers of: "filepath of four popular UK profiles"
-> Scrape Users
This quickly scraped the users, but it did NOT scrape all users. For example, some accounts had a total of 400k followers, my TOTAL results from all four accounts was around 10k.
Using the user data scraped, I then ran another process:
Soundcloud Modules -> Scraper
Using 5 proxies
Set Artist filter to United Kingdom
Scrape Emails from Profiles: "filepath of the scrape above"
-> Scrape
The process has just about finished now, I've checked the output file and there are a LOT of US users on there, it seems the filter I applied did not work for some reason.
Can someone help me in the right direction please?
Thanks in advance, and all the best for the new year guys