How to scrape links to media tweets from a specific user?

[hacking]

For instance, https://twitter.com/elonmusk/media, and the links are formatted like https://twitter.com/elonmusk/status/175 ... 58/video/1. I don't need to download the media files; I just want to obtain the links for all media files.

[martin@rootjazz]

Scrape tab
Tweet search
OUTPUT TYPE: details

input: @elonmusk
Search steps: User Media tweets


This will save a CSV of all the details, including the media URL, just copy the column you want

Regards,
Martin




Twitterdub custom search tutorial
- Explains how to build a search and specify how many results per step (optional)

https://www.youtube.com/watch?v=D1W2KnNciPI

[hacking]

It seems like the program did not run successfully; there are no results.
Logfile:logs_60781

[martin@rootjazz]

ok twitter changed how they return the results.

I'll update the format file

[martin@rootjazz]

The next update will fix this. I shall let you know when it is ready.



Regards,
Martin

[martin@rootjazz]

https://rootjazz.com/twitterdub/updatetesting.html



Regards,
Martin

[hacking]

As a test, I set it to retrieve 10,000 results, but the program, after obtaining a small number of results (around 10), switches to a completed status.
logfile:logs_55009

[martin@rootjazz]

My apologies, I only tested the first page, seems the paging had changed and I didn't realise.

[hacking]

No problem, just let me know once you've fixed it.

[martin@rootjazz]

done

The next update will fix this. I shall let you know when it is ready.



Regards,
Martin