this post was submitted on 31 May 2024
342 points (98.3% liked)

Linux

48682 readers
646 users here now

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] -2 points 6 months ago (8 children)

We are approaching the use of AI in Firefox — which many, many of you have been asking about — in the same way. We’re focused on giving you AI features that solve tangible problems, respect your privacy, and give you real choice.

We’re looking at how we can use local, on-device AI models — i.e., more private — to enhance your browsing experience further. One feature we’re starting with next quarter is AI-generated alt-text for images inserted into PDFs, which makes it more accessible to visually impaired users and people with learning disabilities.

NO! I don't want AI in my Firefox. If Mozilla really adds AI, I will consider switching my main browser since Firefox 1 came out.

[–] [email protected] 49 points 6 months ago (1 children)

AI generated alt-text running locally is actually a fantastic accessibility feature. It's reliable, it provides a service, it can absolutely be deployed securely.

It's fine to be critical of technology, it's not fine to become as irrational about it as the tech bros trying to make a buck.

[–] [email protected] 13 points 6 months ago (1 children)

Not irrational to be concerned for a number of reasons. Even if local and secure AI image processing and LLMs add fairly significant processing costs to a simple task like this. It means higher requirements for the browser, higher energy use and therefore emissions (noting here that AI has blown Microsoft's climate mitigation plan our of the water even with some accounting tricks).

Additionally, you have to think about the long term changes to behaviours this will generate. A handy tool for when people forget to produce proper accessible documents suddenly becomes the default way of making accessible documents. Consider two situations: a culture that promotes and enforces content providers to consider different types of consumer and how they will experience the content; they know that unless they spend the 1% extra time making it accessibile for all it will exclude certain people. Now compare that to a situation where AI is pitched as an easy way not to think about the peoples experiences: the AI will sort it. Those two situations imply very different outcomes: in one there is care and thought about difference and diversity and in another there isn't. Disabled people are an after thought. Within those two different scenarios there's also massively different energy and emissions requirements because its making every user perform AI to get some alt text rather than generate it at source.

Finally, it worth explaining about Alt texts a bit and how people use them because its not just text descriptions of an image (which AI could indeed likely produce). Alt texts should be used to summarise the salient aspects of the image the author wants a reader to take away for it in a conscise way and sometimes that message might be slightly different for Alt Text users. AI can't do this because it should be about the message the content creator wants to send and ensuring it's accessible. As ever with these tech fixes for accessibility the lived experience of people with those needs isn't actually present. Its an assumed need rather than what they are asking for.

[–] [email protected] 5 points 6 months ago

Local and secure image recognition is fairly trivial in terms of power consumption, but hey, there's likely going to be some option to turn it off, just like hardware acceleration for video and image rendering, which uses the same GPU in similar ways. The power consumption argument is not invalid, but the way people deploy it is baffling to me, and is often based on worst-case estimates that are not realistic by design.

To be clear, Apple is building CPUs that can parse these queries in seconds into iPads now, running at a few tens of watts. Each time I boot up Tekken on my 1000W gaming PC for five minutes I'm burning up more power than my share of AI queries for weeks, if not months.

On the second point I absolutely disagree. There is no practical advantage to making accessibility annoying to implement. Accessibility should be structural, mandatory and automatic, not a nice thing people do for you. Eff that.

As for the third part, every alt text I've seen deployed is not adding much of value beyond a description of the content. What is measurable and factual is that the coverage of alt-text, even in places where it's disproportionately popular like Mastodon, is spotty at best and residual at worst. There is no question that automated alt-text is better than no alt-text, and most content has no alt-text.

That is only the tip of the iceberg for ML applied to accessibility, too. You could do active queries, you could have users be able to ask for additional context or clarification, you could have much smoother, automated voice reading of text, including visual description on demand... This tech is powerful in many areas, and this is clearly one. In fact, this is a much better application than search, by a lot. It's frustrating that search and factual queries, where this stuff is pretty bad at being reliable, are the thing everybody is thinking about.

[–] [email protected] 20 points 6 months ago (2 children)

Just use librewolf or something, or if they incorporate ai, I'd be surprised if an ai-free fork doesn't pop up quickly

[–] [email protected] 7 points 6 months ago (1 children)

+1 for LibreWolf. I've been using it for ~2 years and it's better than Firefox from a privacy perspective. Development is active, so updates are being pushed regularly. As for vertical tabs, you can easily achieve it with Tree Style Tabs. I strongly recommend it.

[–] [email protected] 3 points 6 months ago

Tree style tabs is amazing, +1 for that

[–] [email protected] 3 points 6 months ago (1 children)

I've looked at alternative forks of Firefox before, but there were two problems for me: a) most are not up to date or slow to update, and b) hard to trust my browser to any community or other company. You see, I actually trust Mozilla, specifically Firefox and Thunderbird. At least the AI is local only, but it would add another attack vector and bloat for no reason to me. We'll see if it can be disabled.

[–] [email protected] 11 points 6 months ago

Librewolf is quick to update, it's just a hardened fork of firefox

[–] [email protected] 16 points 6 months ago (1 children)

I think that sounds like a cool use case. If it runs locally what's not to like?

[–] [email protected] 11 points 6 months ago (1 children)

Plus I think there will be a way to disable it (like with local translation we have rn).

[–] [email protected] 1 points 6 months ago* (last edited 6 months ago)

Local translation is amazing, they just need to improve the settings.

[–] [email protected] 11 points 6 months ago* (last edited 6 months ago)

Are you aware that Firefox Translate uses AI models[1] to translate text and it’s already included in current versions of Firefox?

[1]: not a completion/instruction LLM, but still very much a “language” model

[–] [email protected] 7 points 6 months ago (1 children)

I don’t want AI in my Firefox. If Mozilla really adds AI, I will consider switching my main browser

Don't know why you anti-AI so much. An on-device AI is absolutely fine to me, and it's not like Mozilla will force you to use it. Remember the world is not about only you but also people having disabilities.

[–] [email protected] 3 points 6 months ago (1 children)

Meh, if it will do stuff like merging results in the awesome bar, I'll happily take it.

[–] [email protected] 0 points 6 months ago (1 children)

The problem is, this should be an addon that people can install or at least, remove. I don't want AI in my text editor, in my browser or in my operating system.

[–] [email protected] 4 points 6 months ago (1 children)

I mean the address bar. If I type in a port which I know something is on locally, it shows me five different entries pointing to the same thing. I'm saying they should be merged. You and I know that this is programmatically simple and should be the default behaviour, however in this age, at least according to marketing, it's AI.

[–] [email protected] 1 points 6 months ago (1 children)

And I am saying, if they want to it, then it should be an addon and not installed by default that cannot be removed.

[–] [email protected] 3 points 6 months ago (1 children)

I'm sorry, but you're being ridiculous. Why should it be an add-on to say merge two identical rows from a database query?

[–] [email protected] 1 points 6 months ago (2 children)

Why not? I think you are ridiculous. Just for two identical rows to merge them is not a good reason to introduce AI into the system. This could have been done without AI, but if they really want an AI, then it has to be an addon. If its really that simple, then there is no need for an AI.

[–] [email protected] 5 points 6 months ago (1 children)

I'm guessing you haven't had your coffee yet, because I blatantly said

You and I know that this is programmatically simple and should be the default behaviour, however in this age, at least according to marketing, it's AI.

If you want to fight for the sake of fighting, please go find someone else. It's too early for this stupidness.

[–] [email protected] -1 points 6 months ago (1 children)

Maybe you should stop insulting people like an idiot.

You asked me why this AI for this simple two line merger should be an addon and I explained to you it should because its an AI. If you have no good argument, then insulting people won't make you right. You make an dumbass example, I give you an answer and you give me this stupid reply. idiots get blocked.

[–] [email protected] 6 points 6 months ago

I honestly don't think you're a bad person, I just think that you're blinded by a red mist right now. You'll think back to this later and laugh about it, I'm sure. Have a good day.

[–] [email protected] -1 points 6 months ago (1 children)

You're just irrationally disliking it based on the name "AI" and nothing factual.

[–] [email protected] 1 points 6 months ago

You have no idea why I dislike it and create nonsense judgement over my disliking. I think this is a normal human defending position of you, because I dislike something (there are good reasons for) that you like.

[–] [email protected] 2 points 6 months ago (1 children)

I am just hoping governments will see the massive issues and copyright problems with AI and ban that garbage outright soon so all these companies eager to add their AI trash to every single product they ship will stop.

[–] [email protected] 8 points 6 months ago (1 children)

There is no general copyright issue with AIs. It completely depends on the training material (if even then), so it's not possible to make blanket statements like that. Banning technology, because a particular implementation is problematic, makes no sense.

[–] [email protected] 1 points 6 months ago (1 children)

The only relevant training material to make a truly complete dataset must include copyrighted material or you do not have a full set of data to draw from and thus it is useless. Stop defending this horrible technology.

[–] [email protected] 1 points 6 months ago* (last edited 6 months ago) (1 children)

What do you mean "full set if data"?

Obviously you can not train on 100% of material ever created, so you pick a subset. There is a a lot of permissively licensed content (e.g. Wikipedia) and content you can license (e.g. Reddit). While not sufficient for an advanced LLM, it certainly is for smaller models that do not need wide knowledge.

[–] [email protected] 1 points 6 months ago (1 children)

You can't even rely on Wikipedia to be right, and how is reddit "content you can license"? Its articles are owned by their sites, and the original stuff posted there is from the poster and is usually wildly inaccurate or outright wrong (or even downright dangerous). And even when they do pull in tons of stuff they shouldn't, the results are frequently laughably wrong.

You're not making a good argument for LLM crap here. Just accept the fact that it's a failed technology that needs to be shut down. Please. How are people so excited and gung-ho over this garbage, failed, laughably bad technology? It's almost like people WANT chaos.

[–] [email protected] 0 points 6 months ago (1 children)

Wikipedia is no less reliable than other content. There's even academic research about it (no, I will not dig for sources now, so feel free to not believe it). But factual correctness only matters for models that deal with facts: for e.g a translation model it does not matter.

Reddit has a massive amount of user-generated content it owns, e.g. comments. Again, the factual correctness only matters in some contexts, not all.

I'm not sure why you keep mentioning LLMs since that is not what is being discussed. Firefox has no plans to use some LLM to generate content where facts play an important role.

[–] [email protected] 1 points 6 months ago (1 children)

Sure hasn't helped AI/LLMs with accuracy yet. And never will. Computing doesn't actually think and reason, it's just mashing together bits of data it has, and if what it has now isn't accurate, how is anything going to be?

You and others continue to harp on how great this new technology is and meanwhile we have seen it do nothing but absolutely, laughably fail. You keep saying it will get better, but it won't. It is limited by the fact that computers don't work that way. Sick and tired of the people justifying this garbage "tech" that is stealing art, code, text, etc, sucking up huge amounts of power, and giving wrong information, telling people to do dangerous things and even kill themselves because computers don't know the difference.

Just admit it. AI/LLM is garbage. Please. Stop being a massive fanboy for something that has clearly, evidently, 100% failed miserably and dangerously.

[–] [email protected] 1 points 6 months ago

I think you are replying to the wrong person?

I did not say it helps with accuracy. I did not say LLMs will get better. I did not even say we should use LLMs.

But even if I did, non of your points are relevant for the Firefox usecase.