Page 1 of 1

Email Scraper not Working

Posted: Tue Feb 11, 2020 8:26 pm
by shaner4042
Hi,

It seems there is a problem with the email scraper in Twitterdub

Everyday I scrape twitter URL lists of about 6000 profiles for emails, which would consistently result in around 10% profiles returning emails (around 600 results).

As of yesterday these lists are only returning a handful of emails (less than 1%).

I am certain this isn't just an anomaly, as I have tried scraping old lists of mine which previously yielded 10% emails, only to find they are returning just a few results now as well.

Any reason the scraper finding less emails?

LOGS: 52860

Re: Email Scraper not Working

Posted: Wed Feb 12, 2020 3:27 pm
by shaner4042
Just bumping as I believe it may have been missed due to many other posts after mine. Thanks

Re: Email Scraper not Working

Posted: Wed Feb 12, 2020 4:35 pm
by martin@rootjazz
Are you using proxies for email scrapes? Are they working?

Maybe your input profiles are different quality (perhaps you are scraping many fake profiles)?

Prepare a list of know profiles with emails. Load that in and confirm the results are correct.
i.e. a list of 10 profiles, 6 with emails 4 without, and confirm the results has 6 emails




Regards,
Martin

Re: Email Scraper not Working

Posted: Fri Feb 14, 2020 12:44 am
by shaner4042
I have tried w/ and without proxies. Am using working private proxy.

My selected account is also active and doesn't have any bans or restrictions on it. Just not returning emails anymore.

I have followed your instruction and made up a notepad file of known twitter URL's that do in fact have email in their bio. I have tried the email scraper on this list, and it returns 0 emails, despite all 5 URL's having one.

I have sent this file to your support email so you can test yourself if you wish.

LOGS:44409

Re: Email Scraper not Working

Posted: Fri Feb 14, 2020 2:49 pm
by martin@rootjazz
The next update will fix this. I shall let you know when it is ready.



Regards,
Martin

Re: Email Scraper not Working

Posted: Fri Feb 14, 2020 3:47 pm
by martin@rootjazz