I don't think you understand how AIs work

@Dogyote @Zetaphor

I've been webscraping in my job for 6 years. Yes, it's a constant headache, they keep updating their sites and improving their antibot protections. But it can be done and some companies are doing it (on a biiiiig scale). It's just not very realistic that an open-source project would be able to invest that much effort into all the updates. Well some do, youtube-dl is basically webscraping and they are pretty up-to-date. It's just very rare.

@Dogyote @Zetaphor

And we also explored the AI option, it always turned out unrealistic. Either you would have to scrape the content and send it to the AI to parse the info, but then you'd be paying for every scrape, or run a powerful rig nonstop, but the results would still be hit and miss. Or you might let the AI generate the code for the scraping module, still not ideal, they were constantly hallucinating things that weren't there.