Page 1 of 1
User Tweets - Get All
Posted: Wed Apr 17, 2024 11:52 pm
by aritwitter
I tried scraping for 'User tweets' but seems to be getting only tweets from last month up to the present. Is there a way to get all tweets (including older tweets)? Same thing with other kinds of scrape (ex. Tweet Search)
P.S. I tried setting the filter for 'Age in hours' to 0:0 (which I assume is no limit then 0:99999999 (max), but still got the same result, earliest is from last month and no tweets older than that
log: 86404
Re: User Tweets - Get All
Posted: Thu Apr 18, 2024 3:02 pm
by martin@rootjazz
what do the logs say, why does the search stop?
Re: User Tweets - Get All
Posted: Thu Apr 18, 2024 4:20 pm
by martin@rootjazz
23:22:38: WARNING: No results returned, 0
23:22:38: NOTICE: no results source logged to id: noresults_619485
23:22:38: only tweets, ignore retweets
23:22:38: WARNING: twitter returned same results as before: 1
Search results page appeared to be the same as before, no new tweets found, program stopped searching
ok I think I see the issue. Been an issue for a while I think. I "improved" the searching to remove items earlier in the flow, which cause this bug to be exposed.
The next update will (should hopefully) fix this. I shall let you know when it is ready.
Regards,
Martin
Re: User Tweets - Get All
Posted: Thu Apr 25, 2024 12:34 pm
by aritwitter
Hi Martin,
Just wanted to follow up if this has already been fixed in the latest update
Re: User Tweets - Get All
Posted: Thu Apr 25, 2024 3:58 pm
by martin@rootjazz
aritwitter wrote: ↑Thu Apr 25, 2024 12:34 pm
Hi Martin,
Just wanted to follow up if this has already been fixed in the latest update
https://rootjazz.com/twitterdub/updatetesting.html
Sorry forgot to update the thread. Please try this and let me know if works better
Regards,
Martin