Hello,
I noticed that the Soundcloud Manager's Scraper has its own Proxy list that is separate from the proxies list in settings. Can someone please explain what the difference is, and how to use the Scraper's Proxy list when scraping? I've added proxies to the Scrapper List but the Processor's log says that there is no proxy being used when I scrape accounts.
Please help,
Jazz
Scraper Proxies Vs Proxy Settings
- martin@rootjazz
- Site Admin
- Posts: 31937
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scraper Proxies Vs Proxy Settings
errr I don't remember. I think custom scrape list should be used AS well, I will need to check. Been a while since I looked at itJazzyFresh wrote: ↑Mon Oct 17, 2022 1:52 am Hello,
I noticed that the Soundcloud Manager's Scraper has its own Proxy list that is separate from the proxies list in settings.
what do you mean you "added proxies to scraper list". You mean you added proxy site URLs? But if no proxies found, then the page source did not contain proxies, maybe the site hides them in code so they cannot be extracted with regexCan someone please explain what the difference is, and how to use the Scraper's Proxy list when scraping? I've added proxies to the Scrapper List but the Processor's log says that there is no proxy being used when I scrape accounts.
-
- Posts: 2
- Joined: Mon Jun 13, 2022 5:36 pm
Re: Scraper Proxies Vs Proxy Settings
Hey I'm talking about the scrapper function's proxy list
on the scraper function/module there is an option to add "proxies used for scraping" which is different than the Proxy Scrape URLs in the Settings. I have added proxies to both list, however the when i click on a process in the log keeps saying that its not using any proxies.
on the scraper function/module there is an option to add "proxies used for scraping" which is different than the Proxy Scrape URLs in the Settings. I have added proxies to both list, however the when i click on a process in the log keeps saying that its not using any proxies.
- martin@rootjazz
- Site Admin
- Posts: 31937
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scraper Proxies Vs Proxy Settings
These proxies are used for the SCRAPING actions you create from the SCRAPE TABJazzyFresh wrote: ↑Sat Oct 22, 2022 4:38 pm Hey I'm talking about the scrapper function's proxy list
on the scraper function/module there is an option to add "proxies used for scraping"
these are the sites the program will look for public proxies when you run a PROXY SCRAPE (from the PLAYS tab for example)which is different than the Proxy Scrape URLs in the Settings.
Don't add PROXIES to the "proxy scrape URLs" that should only be URLs that you want to look for proxiesI have added proxies to both list,
As for PROXIES USED FOR SCRAPING, should work, let me test
- martin@rootjazz
- Site Admin
- Posts: 31937
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scraper Proxies Vs Proxy Settings
Working here.As for PROXIES USED FOR SCRAPING, should work, let me test
SCRAPER TAB
click PROXIES
Enter proxies
Run a SCRAPE FOLLOWERS OF action
Uses proxy
Please provide screenshots and exact instructions on how to do the above so it does NOT use the proxies
Regards,
Martin