Hi!
When i scrape twitter user by Build search " FollowerOf" , processing show error "88 - Rate limit exceeded" and stop run
How to avoid twitter api limit "88 - Rate limit exceeded"
How to avoid twitter api limit "88 - Rate limit exceeded"
- martin@rootjazz
- Site Admin
- Posts: 34712
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: How to avoid twitter api limit "88 - Rate limit exceeded"
are you using a complex filter? That can eat up your api limit.
How many users are you trying to scrape? IF you are trying to scrape 100s of 1000s then you will run into difficulty. Do ensure you need however many you are trying to scrape.
Can you also submit your logs. The too many API limit message should be detected and force a pause, but from your screen shot I cannot tell what is going on (in future please paste logs in rather than screen shot)
HELP > LOGS > SUBMIT
then send your logs ID - the first 4 numbers is sufficient (displayed after successful uploading of logs)
How many users are you trying to scrape? IF you are trying to scrape 100s of 1000s then you will run into difficulty. Do ensure you need however many you are trying to scrape.
Can you also submit your logs. The too many API limit message should be detected and force a pause, but from your screen shot I cannot tell what is going on (in future please paste logs in rather than screen shot)
HELP > LOGS > SUBMIT
then send your logs ID - the first 4 numbers is sufficient (displayed after successful uploading of logs)
Re: How to avoid twitter api limit "88 - Rate limit exceeded"
hello, new user here
log id: 15492
screenshot of filters: http://i.imgur.com/bwy4QrA.png
I just started to scrape users for follows and got same error. Can you help?
log id: 15492
screenshot of filters: http://i.imgur.com/bwy4QrA.png
I just started to scrape users for follows and got same error. Can you help?
Re: How to avoid twitter api limit "88 - Rate limit exceeded"
I also have problems with this. I tried to scrape 3K users, but it got stucked after 480
- martin@rootjazz
- Site Admin
- Posts: 34712
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: How to avoid twitter api limit "88 - Rate limit exceeded"
biagle wrote:hello, new user here
log id: 15492
screenshot of filters: http://i.imgur.com/bwy4QrA.png
I just started to scrape users for follows and got same error. Can you help?
Let me test. The program should detect the rate limit - pause then start again when the rate limit is removed.