Scrape Video feature downloads Pictures also

Support / help / discussion forum for twitter bot
Post Reply
shaily
Posts: 95
Joined: Mon Aug 12, 2019 2:30 am

Scrape Video feature downloads Pictures also

Post by shaily »

Hi Martin,

I tried using the scrape feature with download media. Here is what I did:
On Scraper tab:
1. Scrape Tweets
2. Custom Search Selection: Tweet Search (Videos Only)
3. Select Details and Select Checkbox: Download Media
4. Keyword ArtificialIntelligence
5. Press Scrape Tweets.

The output extracts a few videos and more pictures (jpeg)... though it should only extract videos only.

Please take a look.

Cheers,
Shaily
User avatar
martin@rootjazz
Site Admin
Posts: 34598
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scrape Video feature downloads Pictures also

Post by martin@rootjazz »

shaily wrote: Tue Sep 29, 2020 2:43 am Hi Martin,

I tried using the scrape feature with download media. Here is what I did:
On Scraper tab:
1. Scrape Tweets
2. Custom Search Selection: Tweet Search (Videos Only)
3. Select Details and Select Checkbox: Download Media
4. Keyword ArtificialIntelligence
5. Press Scrape Tweets.

The output extracts a few videos and more pictures (jpeg)... though it should only extract videos only.

Please take a look.

Cheers,
Shaily
Can you submit logs please showing the action
HELP > LOGS > SUBMIT

then send your logs ID - the first 4 numbers is sufficient (displayed after successful uploading of logs)




Regards,
Martin
shaily
Posts: 95
Joined: Mon Aug 12, 2019 2:30 am

Re: Scrape Video feature downloads Pictures also

Post by shaily »

Log sent: Log ID: 73348

Please let me know what went wrong.

Cheers,
Shaily
User avatar
martin@rootjazz
Site Admin
Posts: 34598
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scrape Video feature downloads Pictures also

Post by martin@rootjazz »

Everything looks fine in the logs.
Tested and working fine here.


Can you run a test
Scrape tab
scrape tweets
custom search TWEET SEARCH VIDEOS
max results = 10
output URLS

Run the scrape
Send me the results file
Indicate which results are wrong.



Regards,
Martin
shaily
Posts: 95
Joined: Mon Aug 12, 2019 2:30 am

Re: Scrape Video feature downloads Pictures also

Post by shaily »

Hi Martin,

Here are the results based on what you suggested....
Can you run a test
Scrape tab
scrape tweets
custom search TWEET SEARCH VIDEOS
max results = 10
output URLS


I only got 9 URLs.

https://mobile.twitter.com/techreview/s ... 2344605697 --> Not a Video
https://mobile.twitter.com/RepChrisStew ... 2721956865 --> A Video
https://mobile.twitter.com/Berci/status ... 0973238272 --> Not a Video
https://mobile.twitter.com/dataartisan1 ... 9108226048 --> Not a Video
https://mobile.twitter.com/Slate/status ... 6634079232 --> Not a Video
https://mobile.twitter.com/TamaraMcClea ... 1523768321 --> Not a Video
https://mobile.twitter.com/Will__Juice/ ... 0229134342 --> Not a Video
https://mobile.twitter.com/PeterVolper/ ... 6796348416 --> Not a Video
https://mobile.twitter.com/machinelearn ... 6802366464 --> Not a Video


Log submitted as well... Log ID: 61375

Hope this is helpful.
User avatar
martin@rootjazz
Site Admin
Posts: 34598
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scrape Video feature downloads Pictures also

Post by martin@rootjazz »

well searching on twitter, not all seem to be videos

https://mobile.twitter.com/search?q=art ... ck&f=video

But the ratio is no where like your results. I'll check again
User avatar
martin@rootjazz
Site Admin
Posts: 34598
Joined: Fri Jan 25, 2013 10:06 pm
Location: The Funk
Contact:

Re: Scrape Video feature downloads Pictures also

Post by martin@rootjazz »

Most of those are images this time. However, I just search on the twitter again and this time I got 9 images and one actual video in the results. I think is just how twitter show the results to video.
Post Reply