datahoarder

6758 readers

1 users here now

Who are we?

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

We are one. We are legion. And we're trying really hard not to forget.

-- 5-4-3-2-1-bang from this thread

founded 4 years ago

MODERATORS

[email protected]

Get URLs for all tweets within date range? (sh.itjust.works)

submitted 9 months ago by [email protected] to c/[email protected]

1 comments fedilink hide all child comments

cross-posted from: https://sh.itjust.works/post/14280067

What is the best tool to get URLs for all tweets within a given date range?

The ideal behaviour I'm looking for would be something like this:

Input: https://twitter.com/SpaceX 2023-09-01 2024-02-08

Output:

https://twitter.com/SpaceX/status/1755763378449183003#m

https://twitter.com/SpaceX/status/1755759459765567825#m

https://twitter.com/SpaceX/status/1755752291578302545#m

...

What would be the best tool to achieve this? Thanks in advance!

top 1 comments

sorted by: hot top controversial new old

[–] [email protected] 1 points 9 months ago* (last edited 9 months ago)

Update: I found a partial solution using Nitter and the Link Gopher Firefox extension.

Using a public Nitter instance, one can visit an account page, jump to the bottom, click "Load more", and use Link Gopher's "Extract Links by Filter" tool to extract all links of the form https://nitter.freedit.eu/SpaceX/status/. This method allows one to collect 20 links at a time. It's still a bit more work than I would ideally like, but better than trying to find and copy each tweet URL manually. Also not sure how much longer this method will work given that public Nitter instances will likely stop working soon.