284
13 Feet Ladder (github.com)
submitted 8 months ago by [email protected] to c/[email protected]

A site similar to 12ft.io but is self hosted and works with websites that 12ft.io doesn't work with.

How does it work?

It pretends to be GoogleBot (Google's web crawler) and gets the same content that google will get. Google gets the whole page so that the content of the article can be indexed properly and this takes advantage of that.

link: https://github.com/wasi-master/13ft

you are viewing a single comment's thread
view the rest of the comments
[-] [email protected] 2 points 8 months ago

It's not necessarily a moving target when entire blocks can be associated with Google.

[-] [email protected] 3 points 8 months ago

Unless they are permanently only using specific addresses or blocks and will never change that up, I’d consider it a moving target.

[-] [email protected] 1 points 8 months ago

Google literally has an official list of IP ranges for their crawlers, complete with an API that returns the current IP ranges that you can use to automate a check. Hardly a moving target, and even if it is, it doesn't matter if you know exactly where the target is at all times.

this post was submitted on 05 Jan 2024
284 points (97.7% liked)

Selfhosted

39251 readers
353 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS