Hi,
I've been playing around with the scrape feature and haven't yet been able to figure out if it can download images included in tweets, or at least include the link in the created tweet file to the attached image. Is this possible?
Secondly, scraped tweets don't seem to include links contained in tweets either?
Lastly, is it possible to set the location of the file for scraped tweets besides the default?
Thanks for the help
Scrape Tweet Images/Links?
- martin@rootjazz
- Site Admin
- Posts: 34375
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scrape Tweet Images/Links?
No not currently possible. I will make a note to look at it. Remind me next week sometime if you don't hear from me
Can you send a sample. A Tweet Url that was scraped, and how it was saved. Probably it is due to how the tweet is formatted in the response from twitter, maybe this is correct, maybe not and it needs some post scrape processing to format, but it will depend on where / how the link is specified for that tweetSecondly, scraped tweets don't seem to include links contained in tweets either?
No, this is not possibleLastly, is it possible to set the location of the file for scraped tweets besides the default?
Thanks for the help
Re: Scrape Tweet Images/Links?
Thanks for looking into this.
I'll run a few scrapes on tweets with links and see whether not including links is the norm or perhaps it was limited to a few based on format as you mentioned.
I'll run a few scrapes on tweets with links and see whether not including links is the norm or perhaps it was limited to a few based on format as you mentioned.
- martin@rootjazz
- Site Admin
- Posts: 34375
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scrape Tweet Images/Links?
do let me know as soon as you have some samples of it not working
Regards,
Martin
Regards,
Martin
Re: Scrape Tweet Images/Links?
Log ID: 4195
Okay, here's one that failed. From the output file in TwitterDub it looks like it messed up the Tweet URL by including the text in the actual URL (Error shown: Couldn't extract tweet ID: https://twitter.com/Find out what the definition...). At the very end of that string are two URLs, so one is likely an external link from the tweet, the other the URL of the attached image. So it does appear to be grabbing the URL at least.
The steps to create this (Scraper tab obviously):
- Max Results = 7 (just for testing)
- Scrape Tweets form/section:
- Custom Search = Recent Tweets of
- Scrape Tweets = (ID of the user)
- ID/URLs/Details = Details checked
- Click the Scrape Body button
I should note that in that test the output file saved in my local folder included a list of tweet IDs. I understand that the process failed, but shouldn't the output to the file be the actual tweet body/bodies? Is there something I'm doing wrong in the setup?
Thanks for the help.
Okay, here's one that failed. From the output file in TwitterDub it looks like it messed up the Tweet URL by including the text in the actual URL (Error shown: Couldn't extract tweet ID: https://twitter.com/Find out what the definition...). At the very end of that string are two URLs, so one is likely an external link from the tweet, the other the URL of the attached image. So it does appear to be grabbing the URL at least.
The steps to create this (Scraper tab obviously):
- Max Results = 7 (just for testing)
- Scrape Tweets form/section:
- Custom Search = Recent Tweets of
- Scrape Tweets = (ID of the user)
- ID/URLs/Details = Details checked
- Click the Scrape Body button
I should note that in that test the output file saved in my local folder included a list of tweet IDs. I understand that the process failed, but shouldn't the output to the file be the actual tweet body/bodies? Is there something I'm doing wrong in the setup?
Thanks for the help.
- martin@rootjazz
- Site Admin
- Posts: 34375
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scrape Tweet Images/Links?
can you include the output saved file
and let me know the URL that was scraped and output wrongly
and let me know the URL that was scraped and output wrongly
Re: Scrape Tweet Images/Links?
Thanks for your reply. How do I include the output saved file?
- martin@rootjazz
- Site Admin
- Posts: 34375
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scrape Tweet Images/Links?
email it (sorry I should have said before)
Or just tell who was scraped who gave teh bad output and I can repeat it
Code: Select all
support[at]rootjazz[dot]com
- martin@rootjazz
- Site Admin
- Posts: 34375
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact: