Scrape followings for calibration - taking nearly 24hrs

Support / help / discussion forum for twitter bot
Post Reply
Bri
Posts: 524
Joined: Fri Nov 13, 2015 10:53 am

Scrape followings for calibration - taking nearly 24hrs

Post by Bri »

Scrape followings for calibration - taking nearly 24hrs, I canceled it, can you please look at the log mate.

I've done this a few times, and it NEVER completely finishes.

Logs: 42596
User avatar
martin@rootjazz
Site Admin
Posts: 34360
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scrape followings for calibration - taking nearly 24hrs

Post by martin@rootjazz »

How many followers / followings does the account have?
Bri
Posts: 524
Joined: Fri Nov 13, 2015 10:53 am

Re: Scrape followings for calibration - taking nearly 24hrs

Post by Bri »

Followers 34.6K
Following 1,611
Bri
Posts: 524
Joined: Fri Nov 13, 2015 10:53 am

Re: Scrape followings for calibration - taking nearly 24hrs

Post by Bri »

Could really do with a ghost feature, to remove followers who DO NOT engage
User avatar
martin@rootjazz
Site Admin
Posts: 34360
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scrape followings for calibration - taking nearly 24hrs

Post by martin@rootjazz »

Bri wrote: Mon Sep 28, 2020 10:26 pm Followers 34.6K
Following 1,611
That's not too many. Maybe Twitter is doing something funny with the results causing them to loop, or something has changed and is going wrong.

Will investigate
User avatar
martin@rootjazz
Site Admin
Posts: 34360
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scrape followings for calibration - taking nearly 24hrs

Post by martin@rootjazz »

Bri wrote: Mon Sep 28, 2020 10:27 pm Could really do with a ghost feature, to remove followers who DO NOT engage
Noted, but issue with twitter is, you cannot get all engagements. Likers / retweeters are not all given, just the first (n). So we cannot know who has engaged if you have a lot of engagers.

If you don't have many, then you can do it manually


CUSTOM SEARCH:
input: your profile
STEPS:
USERFEED / USER TWEETS (100)
TWEET INTERACTIONS (100000)


so we scrape all engagement of your last 100 posts. (a)
Then scrape your followers. (b)
Map all those in (b) who are not in (a) and force those to unfollow you (or target them to try and get them to engaged then unfollow if not)
Post Reply