How to avoid twitter api limit "88 - Rate limit exceeded"

[letran]

Hi!

When i scrape twitter user by Build search " FollowerOf" , processing show error "88 - Rate limit exceeded" and stop run

How to avoid twitter api limit "88 - Rate limit exceeded"

[martin@rootjazz]

are you using a complex filter? That can eat up your api limit.

How many users are you trying to scrape? IF you are trying to scrape 100s of 1000s then you will run into difficulty. Do ensure you need however many you are trying to scrape.

Can you also submit your logs. The too many API limit message should be detected and force a pause, but from your screen shot I cannot tell what is going on (in future please paste logs in rather than screen shot)


HELP > LOGS > SUBMIT

then send your logs ID - the first 4 numbers is sufficient (displayed after successful uploading of logs)

[biagle]

hello, new user here

log id: 15492
screenshot of filters: http://i.imgur.com/bwy4QrA.png

I just started to scrape users for follows and got same error. Can you help?

[jrichards]

I also have problems with this. I tried to scrape 3K users, but it got stucked after 480

[martin@rootjazz]

hello, new user here

log id: 15492
screenshot of filters: http://i.imgur.com/bwy4QrA.png

I just started to scrape users for follows and got same error. Can you help?

Let me test. The program should detect the rate limit - pause then start again when the rate limit is removed.