Page 1 of 1

I used to be able to output csv from the scraper, but no longer can.

Posted: Mon Sep 26, 2022 6:20 am
by hiro55ab
I have tested other keywords and it seems that some can be output and some cannot.
How can I get it to work?

ScrapeToTweet
Custom Search > User ID or URL > User's Tweet

Example: A_account
csv output OK

Example: B_account
csv output No

Log submitted.
ID_42653
Please check.

I was using a daily scraper to collect tweets from my account.
I selected that CSV file from the UnretweetList after 24 hours and canceled the retweets.
Therefore, you cannot undo a RT unless the file is output.

Also, I had edited the Unretweeted process to run daily from Proccessing, but when I restart twitterdub, the output file name (yyyy-mm-dd.txt) changes, so it needs to be reconfigured.

Is there a good way to remove the previous day's RTs the next day?

Re: I used to be able to output csv from the scraper, but no longer can.

Posted: Mon Sep 26, 2022 6:04 pm
by martin@rootjazz
hiro55ab wrote: Mon Sep 26, 2022 6:20 am I have tested other keywords and it seems that some can be output and some cannot.
How can I get it to work?

ScrapeToTweet
Custom Search > User ID or URL > User's Tweet

Example: A_account
csv output OK

Example: B_account
csv output No
So you create a SCRAPER action for both accounts, both CSV OUTPUT and one of them does and one doesn't?

That doesn't make any sense. The most obvious reason would be the output type changed. I just tested 3 acccounts all output CSV
Log submitted.
ID_42653
Please check.

log say:
insearch_henomue92_return_urls_2022-09-13_2.txt
I Can only assume you had return URLs selected

Also, I had edited the Unretweeted process to run daily from Proccessing, but when I restart twitterdub, the output file name (yyyy-mm-dd.txt) changes, so it needs to be reconfigured.

Is there a good way to remove the previous day's RTs the next day?
are you only retweeting from within Twitterdub? If so, I can add an option to unretweet the last (x) days retweets if you want? But the program would have had to have posted the retweets to know what to delete. That would help I think?

Let me know

Re: I used to be able to output csv from the scraper, but no longer can.

Posted: Tue Sep 27, 2022 6:12 am
by hiro55ab
Thank you for contacting me.
What is the best way to achieve what I want to implement?

1.
How do I delete a retweet on twitterdub after (x) days?

2.
I have been retweeting manually in addition to twitterdub. How can I delete them after (x) days?

Perhaps I can use UnretweetList to delete retweets, but how do I create a list?

Re: I used to be able to output csv from the scraper, but no longer can.

Posted: Tue Sep 27, 2022 3:01 pm
by martin@rootjazz
hiro55ab wrote: Tue Sep 27, 2022 6:12 am Thank you for contacting me.
What is the best way to achieve what I want to implement?

1.
How do I delete a retweet on twitterdub after (x) days?

2.
I have been retweeting manually in addition to twitterdub. How can I delete them after (x) days?

Perhaps I can use UnretweetList to delete retweets, but how do I create a list?
As you retweeting manually, the program won't have a Database record.
So you need to scrape your profiles tweets.
But this raises the issue, if you only want tweets older than 7 days, does the program scape ALL yoru tweets, to look for them?
Probably you want to scrape all tweets with a FILTER that are older than 7 days, but less than 30 days.
Then hope the filter works that after 30 days it stops looking as it knows all results that will come will be over 30 days (I think it does.... hopefully)

However this will return ALL your tweets. There is no FILTER option to get ONLY retweets.

But you could try and UNRETWEET FROM LIST. The tweets that are retweets will fail and the retweets will be unretweeted.



It's not ideal, but that's the way to do it


Now, if you want to UNRETWEET retweets made by TD
goto RETWEET tab
right click the account > EXPORT PROCESSED ITEMS OF LAST (X) days
Then use the list saved, in the UNRETWEET FROM LIST


Much easier. But will not unretweet your manual retweets.




Regards,
Martin

Re: I used to be able to output csv from the scraper, but no longer can.

Posted: Thu Sep 29, 2022 2:42 pm
by hiro55ab
Thanks for the reply, I found the solution I wanted.
viewtopic.php?f=30&t=11144&p=71778&hili ... ist#p71778

Thank you for your help, I will try to find a solution to my problem.

PS.
Sorry I made a mistake on where to post the forum first. I didn't know how to delete it and left it there.

Re: I used to be able to output csv from the scraper, but no longer can.

Posted: Fri Sep 30, 2022 3:10 pm
by martin@rootjazz
<moved to twitter board>




Regards,
Martin