Hi Martin,
I tried using the scrape feature with download media. Here is what I did:
On Scraper tab:
1. Scrape Tweets
2. Custom Search Selection: Tweet Search (Videos Only)
3. Select Details and Select Checkbox: Download Media
4. Keyword ArtificialIntelligence
5. Press Scrape Tweets.
The output extracts a few videos and more pictures (jpeg)... though it should only extract videos only.
Please take a look.
Cheers,
Shaily
Scrape Video feature downloads Pictures also
- martin@rootjazz
- Site Admin
- Posts: 34659
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scrape Video feature downloads Pictures also
Can you submit logs please showing the actionshaily wrote: ↑Tue Sep 29, 2020 2:43 am Hi Martin,
I tried using the scrape feature with download media. Here is what I did:
On Scraper tab:
1. Scrape Tweets
2. Custom Search Selection: Tweet Search (Videos Only)
3. Select Details and Select Checkbox: Download Media
4. Keyword ArtificialIntelligence
5. Press Scrape Tweets.
The output extracts a few videos and more pictures (jpeg)... though it should only extract videos only.
Please take a look.
Cheers,
Shaily
HELP > LOGS > SUBMIT
then send your logs ID - the first 4 numbers is sufficient (displayed after successful uploading of logs)
Regards,
Martin
Re: Scrape Video feature downloads Pictures also
Log sent: Log ID: 73348
Please let me know what went wrong.
Cheers,
Shaily
Please let me know what went wrong.
Cheers,
Shaily
- martin@rootjazz
- Site Admin
- Posts: 34659
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scrape Video feature downloads Pictures also
Everything looks fine in the logs.
Tested and working fine here.
Can you run a test
Scrape tab
scrape tweets
custom search TWEET SEARCH VIDEOS
max results = 10
output URLS
Run the scrape
Send me the results file
Indicate which results are wrong.
Regards,
Martin
Tested and working fine here.
Can you run a test
Scrape tab
scrape tweets
custom search TWEET SEARCH VIDEOS
max results = 10
output URLS
Run the scrape
Send me the results file
Indicate which results are wrong.
Regards,
Martin
Re: Scrape Video feature downloads Pictures also
Hi Martin,
Here are the results based on what you suggested....
I only got 9 URLs.
https://mobile.twitter.com/techreview/s ... 2344605697 --> Not a Video
https://mobile.twitter.com/RepChrisStew ... 2721956865 --> A Video
https://mobile.twitter.com/Berci/status ... 0973238272 --> Not a Video
https://mobile.twitter.com/dataartisan1 ... 9108226048 --> Not a Video
https://mobile.twitter.com/Slate/status ... 6634079232 --> Not a Video
https://mobile.twitter.com/TamaraMcClea ... 1523768321 --> Not a Video
https://mobile.twitter.com/Will__Juice/ ... 0229134342 --> Not a Video
https://mobile.twitter.com/PeterVolper/ ... 6796348416 --> Not a Video
https://mobile.twitter.com/machinelearn ... 6802366464 --> Not a Video
Log submitted as well... Log ID: 61375
Hope this is helpful.
Here are the results based on what you suggested....
Can you run a test
Scrape tab
scrape tweets
custom search TWEET SEARCH VIDEOS
max results = 10
output URLS
I only got 9 URLs.
https://mobile.twitter.com/techreview/s ... 2344605697 --> Not a Video
https://mobile.twitter.com/RepChrisStew ... 2721956865 --> A Video
https://mobile.twitter.com/Berci/status ... 0973238272 --> Not a Video
https://mobile.twitter.com/dataartisan1 ... 9108226048 --> Not a Video
https://mobile.twitter.com/Slate/status ... 6634079232 --> Not a Video
https://mobile.twitter.com/TamaraMcClea ... 1523768321 --> Not a Video
https://mobile.twitter.com/Will__Juice/ ... 0229134342 --> Not a Video
https://mobile.twitter.com/PeterVolper/ ... 6796348416 --> Not a Video
https://mobile.twitter.com/machinelearn ... 6802366464 --> Not a Video
Log submitted as well... Log ID: 61375
Hope this is helpful.
- martin@rootjazz
- Site Admin
- Posts: 34659
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scrape Video feature downloads Pictures also
well searching on twitter, not all seem to be videos
https://mobile.twitter.com/search?q=art ... ck&f=video
But the ratio is no where like your results. I'll check again
https://mobile.twitter.com/search?q=art ... ck&f=video
But the ratio is no where like your results. I'll check again
- martin@rootjazz
- Site Admin
- Posts: 34659
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scrape Video feature downloads Pictures also
my results
https://mobile.twitter.com/sonofnels/st ... 3738993664
https://mobile.twitter.com/admiraldotai ... 0765243392
https://mobile.twitter.com/Daily_Expres ... 4658076672
https://mobile.twitter.com/SciShow/stat ... 6367223813
https://mobile.twitter.com/Stefano_Budo ... 5895270400
https://mobile.twitter.com/ID_Xbox/stat ... 4322941952
https://mobile.twitter.com/BeyondB62280 ... 9761169408
https://mobile.twitter.com/neolms/statu ... 0885957634
https://mobile.twitter.com/Kevin_Agee/s ... 5078021121
https://mobile.twitter.com/BUZZSHARER/s ... 2638059520
https://mobile.twitter.com/sonofnels/st ... 3738993664
https://mobile.twitter.com/admiraldotai ... 0765243392
https://mobile.twitter.com/Daily_Expres ... 4658076672
https://mobile.twitter.com/SciShow/stat ... 6367223813
https://mobile.twitter.com/Stefano_Budo ... 5895270400
https://mobile.twitter.com/ID_Xbox/stat ... 4322941952
https://mobile.twitter.com/BeyondB62280 ... 9761169408
https://mobile.twitter.com/neolms/statu ... 0885957634
https://mobile.twitter.com/Kevin_Agee/s ... 5078021121
https://mobile.twitter.com/BUZZSHARER/s ... 2638059520
- martin@rootjazz
- Site Admin
- Posts: 34659
- Joined: Fri Jan 25, 2013 10:06 pm
- Location: The Funk
- Contact:
Re: Scrape Video feature downloads Pictures also
Most of those are images this time. However, I just search on the twitter again and this time I got 9 images and one actual video in the results. I think is just how twitter show the results to video.