Lemmy Federation

154 readers

2 users here now

Focus on Lemmy to Lemmy issues with post/comment sharing, servers being upgraded to new releases, reports of technical problems, etc.

founded 1 year ago

MODERATORS

[email protected]

Lemmy data replication - a "backfill" tool to identify missing posts and comments to try and trigger copy of missing data between servers (lemmy.ml)

submitted 1 year ago* (last edited 1 year ago) by [email protected] to c/[email protected]

3 comments fedilink hide all child comments

If anyone is working on such a tool, please speak up. I've got some clumsy Javascript code in the form of a SvelteKit app I named "lemmy_helper" that I am thinking of adding this as a command line where you can put in the URL of two servers for a specific community and crawl postings and comments and try to discover missing ones.

As I understand it, the Federation protocols have no 'bulk copy' ability, no way to send a list of comments and postings and get them all at once. So each individual missing comment and posting would need to be triggered by a search on the server that is missing them?

I propose "lemmy-remote-data-repair" as the working name for this concept code/app.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 2 points 1 year ago* (last edited 1 year ago)

My instance is often not syncing with anything bigger at all (.world, .ml) so I too have been thinking about this.

Though my idea is a python (or anything quick) script that would run as a sidecar to the lemmy database, it would accept a link (thru cli or secured http request) to community, post or comment and insert it directly into database.