Hi,
It seems there is a problem with the email scraper in Twitterdub
Everyday I scrape twitter URL lists of about 6000 profiles for emails, which would consistently result in around 10% profiles returning emails (around 600 results).
As of yesterday these lists are only returning a handful of emails (less than 1%).
I am certain this isn't just an anomaly, as I have tried scraping old lists of mine which previously yielded 10% emails, only to find they are returning just a few results now as well.
Any reason the scraper finding less emails?
LOGS: 52860
Email Scraper not Working
-
- Posts: 86
- Joined: Sun Sep 04, 2016 5:25 pm
Re: Email Scraper not Working
Just bumping as I believe it may have been missed due to many other posts after mine. Thanks
- martin@rootjazz
- Site Admin
- Posts: 34390
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Email Scraper not Working
Are you using proxies for email scrapes? Are they working?
Maybe your input profiles are different quality (perhaps you are scraping many fake profiles)?
Prepare a list of know profiles with emails. Load that in and confirm the results are correct.
i.e. a list of 10 profiles, 6 with emails 4 without, and confirm the results has 6 emails
Regards,
Martin
Maybe your input profiles are different quality (perhaps you are scraping many fake profiles)?
Prepare a list of know profiles with emails. Load that in and confirm the results are correct.
i.e. a list of 10 profiles, 6 with emails 4 without, and confirm the results has 6 emails
Regards,
Martin
-
- Posts: 86
- Joined: Sun Sep 04, 2016 5:25 pm
Re: Email Scraper not Working
I have tried w/ and without proxies. Am using working private proxy.
My selected account is also active and doesn't have any bans or restrictions on it. Just not returning emails anymore.
I have followed your instruction and made up a notepad file of known twitter URL's that do in fact have email in their bio. I have tried the email scraper on this list, and it returns 0 emails, despite all 5 URL's having one.
I have sent this file to your support email so you can test yourself if you wish.
LOGS:44409
My selected account is also active and doesn't have any bans or restrictions on it. Just not returning emails anymore.
I have followed your instruction and made up a notepad file of known twitter URL's that do in fact have email in their bio. I have tried the email scraper on this list, and it returns 0 emails, despite all 5 URL's having one.
I have sent this file to your support email so you can test yourself if you wish.
LOGS:44409
- martin@rootjazz
- Site Admin
- Posts: 34390
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Email Scraper not Working
The next update will fix this. I shall let you know when it is ready.
Regards,
Martin
Regards,
Martin
- martin@rootjazz
- Site Admin
- Posts: 34390
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact: