Page 1 of 1

Scraper Proxies Vs Proxy Settings

Posted: Mon Oct 17, 2022 1:52 am
by JazzyFresh
Hello,

I noticed that the Soundcloud Manager's Scraper has its own Proxy list that is separate from the proxies list in settings. Can someone please explain what the difference is, and how to use the Scraper's Proxy list when scraping? I've added proxies to the Scrapper List but the Processor's log says that there is no proxy being used when I scrape accounts.

Please help,
Jazz

Re: Scraper Proxies Vs Proxy Settings

Posted: Mon Oct 17, 2022 4:10 pm
by martin@rootjazz
JazzyFresh wrote: Mon Oct 17, 2022 1:52 am Hello,

I noticed that the Soundcloud Manager's Scraper has its own Proxy list that is separate from the proxies list in settings.
errr I don't remember. I think custom scrape list should be used AS well, I will need to check. Been a while since I looked at it
Can someone please explain what the difference is, and how to use the Scraper's Proxy list when scraping? I've added proxies to the Scrapper List but the Processor's log says that there is no proxy being used when I scrape accounts.
what do you mean you "added proxies to scraper list". You mean you added proxy site URLs? But if no proxies found, then the page source did not contain proxies, maybe the site hides them in code so they cannot be extracted with regex

Re: Scraper Proxies Vs Proxy Settings

Posted: Sat Oct 22, 2022 4:38 pm
by JazzyFresh
Hey I'm talking about the scrapper function's proxy list

on the scraper function/module there is an option to add "proxies used for scraping" which is different than the Proxy Scrape URLs in the Settings. I have added proxies to both list, however the when i click on a process in the log keeps saying that its not using any proxies.

Re: Scraper Proxies Vs Proxy Settings

Posted: Mon Oct 24, 2022 6:40 pm
by martin@rootjazz
JazzyFresh wrote: Sat Oct 22, 2022 4:38 pm Hey I'm talking about the scrapper function's proxy list

on the scraper function/module there is an option to add "proxies used for scraping"
These proxies are used for the SCRAPING actions you create from the SCRAPE TAB
which is different than the Proxy Scrape URLs in the Settings.
these are the sites the program will look for public proxies when you run a PROXY SCRAPE (from the PLAYS tab for example)
I have added proxies to both list,
Don't add PROXIES to the "proxy scrape URLs" that should only be URLs that you want to look for proxies

As for PROXIES USED FOR SCRAPING, should work, let me test

Re: Scraper Proxies Vs Proxy Settings

Posted: Mon Oct 24, 2022 6:44 pm
by martin@rootjazz
As for PROXIES USED FOR SCRAPING, should work, let me test
Working here.
SCRAPER TAB
click PROXIES
Enter proxies
Run a SCRAPE FOLLOWERS OF action
Uses proxy


Please provide screenshots and exact instructions on how to do the above so it does NOT use the proxies


Regards,
Martin