I used to be able to output csv from the scraper, but no longer can.

Support / help / discussion forum for twitter bot
Post Reply
hiro55ab
Posts: 12
Joined: Mon Aug 29, 2022 5:51 pm

I used to be able to output csv from the scraper, but no longer can.

Post by hiro55ab »

I have tested other keywords and it seems that some can be output and some cannot.
How can I get it to work?

ScrapeToTweet
Custom Search > User ID or URL > User's Tweet

Example: A_account
csv output OK

Example: B_account
csv output No

Log submitted.
ID_42653
Please check.

I was using a daily scraper to collect tweets from my account.
I selected that CSV file from the UnretweetList after 24 hours and canceled the retweets.
Therefore, you cannot undo a RT unless the file is output.

Also, I had edited the Unretweeted process to run daily from Proccessing, but when I restart twitterdub, the output file name (yyyy-mm-dd.txt) changes, so it needs to be reconfigured.

Is there a good way to remove the previous day's RTs the next day?
User avatar
martin@rootjazz
Site Admin
Posts: 34345
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: I used to be able to output csv from the scraper, but no longer can.

Post by martin@rootjazz »

hiro55ab wrote: Mon Sep 26, 2022 6:20 am I have tested other keywords and it seems that some can be output and some cannot.
How can I get it to work?

ScrapeToTweet
Custom Search > User ID or URL > User's Tweet

Example: A_account
csv output OK

Example: B_account
csv output No
So you create a SCRAPER action for both accounts, both CSV OUTPUT and one of them does and one doesn't?

That doesn't make any sense. The most obvious reason would be the output type changed. I just tested 3 acccounts all output CSV
Log submitted.
ID_42653
Please check.

log say:
insearch_henomue92_return_urls_2022-09-13_2.txt
I Can only assume you had return URLs selected

Also, I had edited the Unretweeted process to run daily from Proccessing, but when I restart twitterdub, the output file name (yyyy-mm-dd.txt) changes, so it needs to be reconfigured.

Is there a good way to remove the previous day's RTs the next day?
are you only retweeting from within Twitterdub? If so, I can add an option to unretweet the last (x) days retweets if you want? But the program would have had to have posted the retweets to know what to delete. That would help I think?

Let me know
hiro55ab
Posts: 12
Joined: Mon Aug 29, 2022 5:51 pm

Re: I used to be able to output csv from the scraper, but no longer can.

Post by hiro55ab »

Thank you for contacting me.
What is the best way to achieve what I want to implement?

1.
How do I delete a retweet on twitterdub after (x) days?

2.
I have been retweeting manually in addition to twitterdub. How can I delete them after (x) days?

Perhaps I can use UnretweetList to delete retweets, but how do I create a list?
User avatar
martin@rootjazz
Site Admin
Posts: 34345
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: I used to be able to output csv from the scraper, but no longer can.

Post by martin@rootjazz »

hiro55ab wrote: Tue Sep 27, 2022 6:12 am Thank you for contacting me.
What is the best way to achieve what I want to implement?

1.
How do I delete a retweet on twitterdub after (x) days?

2.
I have been retweeting manually in addition to twitterdub. How can I delete them after (x) days?

Perhaps I can use UnretweetList to delete retweets, but how do I create a list?
As you retweeting manually, the program won't have a Database record.
So you need to scrape your profiles tweets.
But this raises the issue, if you only want tweets older than 7 days, does the program scape ALL yoru tweets, to look for them?
Probably you want to scrape all tweets with a FILTER that are older than 7 days, but less than 30 days.
Then hope the filter works that after 30 days it stops looking as it knows all results that will come will be over 30 days (I think it does.... hopefully)

However this will return ALL your tweets. There is no FILTER option to get ONLY retweets.

But you could try and UNRETWEET FROM LIST. The tweets that are retweets will fail and the retweets will be unretweeted.



It's not ideal, but that's the way to do it


Now, if you want to UNRETWEET retweets made by TD
goto RETWEET tab
right click the account > EXPORT PROCESSED ITEMS OF LAST (X) days
Then use the list saved, in the UNRETWEET FROM LIST


Much easier. But will not unretweet your manual retweets.




Regards,
Martin
hiro55ab
Posts: 12
Joined: Mon Aug 29, 2022 5:51 pm

Re: I used to be able to output csv from the scraper, but no longer can.

Post by hiro55ab »

Thanks for the reply, I found the solution I wanted.
viewtopic.php?f=30&t=11144&p=71778&hili ... ist#p71778

Thank you for your help, I will try to find a solution to my problem.

PS.
Sorry I made a mistake on where to post the forum first. I didn't know how to delete it and left it there.
User avatar
martin@rootjazz
Site Admin
Posts: 34345
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: I used to be able to output csv from the scraper, but no longer can.

Post by martin@rootjazz »

<moved to twitter board>




Regards,
Martin
Post Reply