Page 1 of 1

User Tweets - Get All

Posted: Wed Apr 17, 2024 11:52 pm
by aritwitter
I tried scraping for 'User tweets' but seems to be getting only tweets from last month up to the present. Is there a way to get all tweets (including older tweets)? Same thing with other kinds of scrape (ex. Tweet Search)

P.S. I tried setting the filter for 'Age in hours' to 0:0 (which I assume is no limit then 0:99999999 (max), but still got the same result, earliest is from last month and no tweets older than that

log: 86404

Re: User Tweets - Get All

Posted: Thu Apr 18, 2024 3:02 pm
by martin@rootjazz
what do the logs say, why does the search stop?

Re: User Tweets - Get All

Posted: Thu Apr 18, 2024 4:20 pm
by martin@rootjazz
23:22:38: WARNING: No results returned, 0
23:22:38: NOTICE: no results source logged to id: noresults_619485
23:22:38: only tweets, ignore retweets
23:22:38: WARNING: twitter returned same results as before: 1
Search results page appeared to be the same as before, no new tweets found, program stopped searching


ok I think I see the issue. Been an issue for a while I think. I "improved" the searching to remove items earlier in the flow, which cause this bug to be exposed.


The next update will (should hopefully) fix this. I shall let you know when it is ready.



Regards,
Martin

Re: User Tweets - Get All

Posted: Thu Apr 25, 2024 12:34 pm
by aritwitter
Hi Martin,

Just wanted to follow up if this has already been fixed in the latest update :)

Re: User Tweets - Get All

Posted: Thu Apr 25, 2024 3:58 pm
by martin@rootjazz
aritwitter wrote: Thu Apr 25, 2024 12:34 pm Hi Martin,

Just wanted to follow up if this has already been fixed in the latest update :)
https://rootjazz.com/twitterdub/updatetesting.html

Sorry forgot to update the thread. Please try this and let me know if works better



Regards,
Martin