Firefox

I don't understand the hate. It's just a sidebar for the supported LLMs. Maybe I'm misunderstanding?

Yes, I would prefer Mozilla focus on the browser, but to me, this seems like it was done in an afternoon.

Unpopular opinion, I think they're doing it right as well as it can be at least. It's completely optional and doesn't seem to be intrusive.

That was there before 133, don’t remember the exact release that added it.

Thing is, for your average user with no GPU and whp never thinks about RAM, running a local LLM is intimidating. But it shouldn't be. Any system with an integrated GPU, and the more RAM the better, can run simple models locally.

The not so dirty secret is that ChatGPT 3 vs 4 isn't that big a difference, and neither are leaps and bounds ahead of the publically available models for about 99% of tasks. For that 1% people will ooh and aah over it, but 99% of use cases are only seeing marginal gains on 4o.

And the simplified models that run "only" 95% as well? They can use 90% fewer resources give pretty much identical answers outside of hyperspecific use cases.

Running a a "smol" model as some are called, gets you all the bang for none of the buck, and your data stays on your system and never leaves.

I've been yelling from the rooftops to some stupid corporate types that once the model is trained, it's trained. Unless you are training models yourself, there is no need for the massive AI clusters, just for the model. Run it local on your hardware at a fraction of the cost.

Didn't want it in Opera, don't want it in Firefox. I mean they can keep trying and I'll just keep on ignoring this shit :/

They better not decide to enable it by default.

I wish I had telemetry on such features.

I really doubt a significant number of people use AI chatbots often enough that having it in a dedicated sidebar is worth it.

Thanks for nothing, Mozilla.

why a fucking chatbot? translate a page better for me you fucking losers, all the translation options suck for privacy outside of specifically trained local AIs. this is the BEST use case for a small local LLM yet mozilla with all its brains and resources couldnt rub two neurons together for this.

or they could do character prediction on your typing to make typing faster. just some legit examples, why waste resources to build a chat ai into my browser when i can just open a website???

I mean, if you're going to do it, where's the Ollama love?

Luckily, it seems to be disabled by default. At the moment.

This happened ages ago, didn't it? Am I missing something new?

Are any of these open source or trustworthy?

https://support.mozilla.org/en-US/kb/ai-chatbot

Note that you need an account to use one of these supported systems. HuggingChat allows for a few connections as a gues before cutting the access; basically a trial version, so you have to create an account.

For a second I thought it said "experimental failure". Would be more accurate, I think.

as someone who's never dabbled with ai bots, what does this feature do? is it only to query for information like a web search?

If they do it in a privacy-preseeving way, this could help them get back market share which will generally benefit an open internet.

Now add support for GPT4All and everyone is happy again.

I will say, the Le Chat provider is pretty decent. You really can use it more natural language. "Rewrite it with a better rhyme scheme" "remove the last line" and it just got it.

Why no local option though? Why no anonmysing option?

Edit: There is a right click option which does make this officially actually useful for me now (summarize this!).

Other models do have RAG options and Mist real supports making agents with specified documentation too to at least fine tune too (not as good as full grounding though IMHO)

Wow, great job Firefox. Thanks.

If I wanted unreliable bullshit like AI, I'd use Chrome.

Wasn't this there for a while, or just me.

Sigh. I'm glad to have switched to LibreWolf.

I wonder if this can be removed at compile time, like Pocket.