Couldn't pull page: 403
Couldn't pull page: 403
Hi, I have this problem and no idea what it's related to (few weeks ago everything worked good)
I try to scrape user details from file. It works for few minutes, and then I am getting error:
FAILED: Couldn't pull page 403
GET RESP: 403
The same happens when I give software some other task.
Also, I notice that when I am using the software (and some time after I close it) I have no access to SoundCloud for some time:
https://i.imgur.com/luqfK5S.png
Could you advise why is this happening?
It looks like it doesn't happen when I am hotspotting my phone data; but only when I am on wi-fi. It didn't happen before though.
Thank you!
I try to scrape user details from file. It works for few minutes, and then I am getting error:
FAILED: Couldn't pull page 403
GET RESP: 403
The same happens when I give software some other task.
Also, I notice that when I am using the software (and some time after I close it) I have no access to SoundCloud for some time:
https://i.imgur.com/luqfK5S.png
Could you advise why is this happening?
It looks like it doesn't happen when I am hotspotting my phone data; but only when I am on wi-fi. It didn't happen before though.
Thank you!
- Just A User
- Posts: 170
- Joined: Fri Jan 25, 2019 2:55 am
Re: Couldn't pull page: 403
SoundCloud changed a single IP can do on the website. This effects everything you can do.
From scraping to simply update your stats from your accounts.
Cheers
From scraping to simply update your stats from your accounts.
Cheers
- martin@rootjazz
- Site Admin
- Posts: 34816
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Couldn't pull page: 403
As above, IP limitations now kick in so you will hit a 403 if you do too much on a single IP.
I guess the SCRAPER tab needs to be updated to allow scraping via accounts now, which I guess will help this, as SCRAPER tab performs searches not logged in.
That and to provide multiple proxies for the scraping, that would also help I suppose.
I guess the SCRAPER tab needs to be updated to allow scraping via accounts now, which I guess will help this, as SCRAPER tab performs searches not logged in.
That and to provide multiple proxies for the scraping, that would also help I suppose.
Re: Couldn't pull page: 403
any update on this? scraping is the main reason why I bought the software I love scraping
- martin@rootjazz
- Site Admin
- Posts: 34816
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
- martin@rootjazz
- Site Admin
- Posts: 34816
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Couldn't pull page: 403
hi Martin, hope everything is going well
is this error related?
* FAILED: Couldn't pull page: -1 https://soundcloud.com/XXXXXXX
Failed pulled details for: https://soundcloud.com/XXXXX
* FAILED: 87345 : Couldn't scrape profile ID
GET RESP: -1
I get that on most of the users I want to scrape
is this error related?
* FAILED: Couldn't pull page: -1 https://soundcloud.com/XXXXXXX
Failed pulled details for: https://soundcloud.com/XXXXX
* FAILED: 87345 : Couldn't scrape profile ID
GET RESP: -1
I get that on most of the users I want to scrape
Re: Couldn't pull page: 403
is there any way this scraper can use proxies? I loaded my proxies but it ends up scraping with my home IP, thus getting blocked after 300 requests. i find it easier than using accounts
https://i.imgur.com/TQqdjHk.png
thank you!!
https://i.imgur.com/TQqdjHk.png
thank you!!
- martin@rootjazz
- Site Admin
- Posts: 34816
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Couldn't pull page: 403
bmsietta wrote: ↑Mon Feb 20, 2023 2:37 pm hi Martin, hope everything is going well
is this error related?
* FAILED: Couldn't pull page: -1 https://soundcloud.com/XXXXXXX
Failed pulled details for: https://soundcloud.com/XXXXX
* FAILED: 87345 : Couldn't scrape profile ID
GET RESP: -1
I get that on most of the users I want to scrape
-1 / empty / <null> means no response received.
This is either your network was down, the proxy wasn't working, something on your machine blocked the request / the site server timed out and didn't respond in time (unlikely but does happen)
If using a proxy, test it:
Please confirm your proxy is working, more info on how to do that here:
viewtopic.php?f=15&t=3453
If the proxy appears to be working fine, please run the action again as it could have been a network "blip".
If the issue appears to be persistent, please check your anti virus / security software as they *may* block the app from the accessing the network: the two most common are:
* Windows Defender
* Smart screen
Make sure the applications program files folder:
c:\program files (x86)\instadub
is whitelisted and / or all the .exe and .dlls in that folder.
Regards,
Martin
- martin@rootjazz
- Site Admin
- Posts: 34816
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact: