I AM NOT SURE IF IT IS A problem of proxy, but even it is, could you do something about this:
Checking Filter: If not follower
Checking Filter: Default Av
* IGNORE: Default Av
* IGNORE: Filtered: https://twitter.com/Antonioquiones7
Results: 36697
Next cursor: 1510928494801707534
FAILED GET: (327421) -1
* ERROR: Object reference not set to an instance of an object.
Results: 0
Saving to: C:\Users\Administrator\AppData\Roaming\rootjazz\Twitterdub\saved_data\search_httpstwittercomhoneyb69_2018-08-24.txt
Started: 24/08/2018 07:07 AM
Finished: 24/08/2018 12:29 PM
ID: db180776-b854-4f88-8d8c-f95de99decfe
Action ran for: 5hr:22min:18s
There are too many logs so I DON'T SUBMIT THIS TIME, but I AM SURE YOU KNOW ABOUT THIS ISSUE.
There might be other more reasons, but that's not the point.
The point is to find a way switch to another account to carry on scraping job when something is going wrong.
martin@rootjazz wrote: ↑Sat Aug 25, 2018 5:14 pm
something failed and it dropped out. Am going to need your logs to find out where this occurred so it can fixed to carry on rather than drop out
HELP > LOGS > SUBMIT
then send your logs ID - the first 4 numbers is sufficient (displayed after successful uploading of logs)
An update is coming to save results as found. In the mean time, set your scrapes and use accounts with quality proxies (if used) that are not prone to failing
I didn't clear the logs before I tried, so the log maybe too many:
Log submitted: 52832
Some realtime log:
Errors in row: 3
Paused for 4secs
FAILED GET: (740141) -1
Errors in row: 4
Paused for 6secs
FAILED GET: (674465) -1
Errors in row: 5
* ERROR: Object reference not set to an instance of an object.
Results: 0
Saving to: C:\Users\Administrator\AppData\Roaming\rootjazz\Twitterdub\saved_data\insearch_httpstwittercomhottychix_2018-09-05.txt
Started: 05/09/2018 00:50 AM
Finished: 05/09/2018 04:38 AM
ID: 1d96dee5-cd98-4bf0-b6ba-20ae00dfaece
Action ran for: 3hr:47min:19s
Danny000 wrote: ↑Wed Sep 05, 2018 8:36 am
Errors in row: 3
Paused for 4secs FAILED GET: (740141) -1
Errors in row: 4
Paused for 6secs FAILED GET: (674465) -1
The program tries to make a GET request, it gets no response (network / proxy fail). It tries 5 times to see if it was a blip, it failed another 5 times.
in your logs, there are 100s of fail requests logged
http://<proxy ip>/
<html><head><title>502 Bad Gateway</title></head>
<body><h2>502 Bad Gateway</h2><h3>Host Not Found or connection failed</h3></body></html>
If your proxies are not working, the program cannot function and will drop out as shown above
