Email Scraper not Working

Support / help / discussion forum for twitter bot
Post Reply
shaner4042
Posts: 84
Joined: Sun Sep 04, 2016 5:25 pm

Email Scraper not Working

Post by shaner4042 » Tue Feb 11, 2020 8:26 pm

Hi,

It seems there is a problem with the email scraper in Twitterdub

Everyday I scrape twitter URL lists of about 6000 profiles for emails, which would consistently result in around 10% profiles returning emails (around 600 results).

As of yesterday these lists are only returning a handful of emails (less than 1%).

I am certain this isn't just an anomaly, as I have tried scraping old lists of mine which previously yielded 10% emails, only to find they are returning just a few results now as well.

Any reason the scraper finding less emails?

LOGS: 52860

shaner4042
Posts: 84
Joined: Sun Sep 04, 2016 5:25 pm

Re: Email Scraper not Working

Post by shaner4042 » Wed Feb 12, 2020 3:27 pm

Just bumping as I believe it may have been missed due to many other posts after mine. Thanks

User avatar
martin@rootjazz
Site Admin
Posts: 23636
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Email Scraper not Working

Post by martin@rootjazz » Wed Feb 12, 2020 4:35 pm

Are you using proxies for email scrapes? Are they working?

Maybe your input profiles are different quality (perhaps you are scraping many fake profiles)?

Prepare a list of know profiles with emails. Load that in and confirm the results are correct.
i.e. a list of 10 profiles, 6 with emails 4 without, and confirm the results has 6 emails




Regards,
Martin

shaner4042
Posts: 84
Joined: Sun Sep 04, 2016 5:25 pm

Re: Email Scraper not Working

Post by shaner4042 » Fri Feb 14, 2020 12:44 am

I have tried w/ and without proxies. Am using working private proxy.

My selected account is also active and doesn't have any bans or restrictions on it. Just not returning emails anymore.

I have followed your instruction and made up a notepad file of known twitter URL's that do in fact have email in their bio. I have tried the email scraper on this list, and it returns 0 emails, despite all 5 URL's having one.

I have sent this file to your support email so you can test yourself if you wish.

LOGS:44409

User avatar
martin@rootjazz
Site Admin
Posts: 23636
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Email Scraper not Working

Post by martin@rootjazz » Fri Feb 14, 2020 2:49 pm

The next update will fix this. I shall let you know when it is ready.



Regards,
Martin


Post Reply