Fediverse

28387 readers

710 users here now

A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, KBin, etc).

If you wanted to get help with moderating your own community then head over to [email protected]!

Rules

Posts must be on topic.
Be respectful of others.
Cite the sources used for graphs and other statistics.
Follow the general Lemmy.world rules.

Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration), Search Lemmy

founded 1 year ago

MODERATORS

[email protected]

273

I'm Starting A Search Engine For The Fediverse (lemmy.ca)

submitted 11 months ago by [email protected] to c/[email protected]

70 comments fedilink hide all child comments

Hey everyone,

This isn't an announcement, just wanted peoples thoughts on this.

I think everyone knows searching the fediverse can be better. Googling doesn't work too well, etc. So I wanted to do my part and help out.

Indexing all posts, etc is quite a lot to handle, so I wanted to start small and just focus on video search. I've started indexing videos from Peertube and other video websites. (Even YouTube but this could be removed to just focus on independent sites)

I know Peertube has their own search engine for videos. I will be reaching out to them. Compared to my site I'm planning it'll have other video sources and be easier to use.

So that leads to feedback from you guys.

What do you think about indexing videos posted on the fediverse and other independent platforms?
Are there similar services?
Am I just wasting my time?

(page 2) 21 comments

sorted by: hot top controversial new old

[–] [email protected] 1 points 10 months ago (1 children)

I don't know anything about the technical side of this. But I would (possibly naively) think that it would be simpler to have a filter that you could automatically apply to sift bog-standard search engine results for Fediverse instances? Like adding "site:uk" to the end of a normal search, except that your filter term would check a list of Fediverse instances to return the relevant results.

And make it an app/add-on so that people can use it with their usual search strategies.

[–] [email protected] 1 points 10 months ago

People been doing that now but it comes with limitations. Thanks for the input.

[–] [email protected] -4 points 11 months ago (1 children)

Just, for the love of god, make sure to make it opt-in. Don't scan people's posts without their consent.

Also, if you're going with this, make sure to respect people's requests for removal, e.g. deleting their posts from the engine when they delete them from their instances. Otherwise you'd get in trouble with the EU regarding GDPR...

[–] [email protected] 1 points 11 months ago

Your public posts are not protected from GDPR from indexing...

load more comments