this post was submitted on 27 Nov 2024
161 points (95.0% liked)

Firefox

18053 readers
247 users here now

A place to discuss the news and latest developments on the open-source browser Firefox

founded 5 years ago
MODERATORS
[email protected]
161
Firefox introduces AI as experimental feature (lemmy.fish)
submitted 3 weeks ago by [email protected] to c/[email protected]
100 comments fedilink hide all child comments
 

They support Claude, ChatGPT, Gemini, HuggingChat, and Mistral.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 3 points 3 weeks ago (2 children)

Can you point me to some resources to running smol llm?

My use case prob just to help "typing" miscellaneous idea I have or check for my grammatical error, in english.

Thanks, in advance.

[–] [email protected] 3 points 3 weeks ago

Here you go: Review of SmolVLM https://www.marktechpost.com/2024/11/26/hugging-face-releases-smolvlm-a-2b-parameter-vision-language-model-for-on-device-inference/

Model itself: https://huggingface.co/spaces/HuggingFaceTB/SmolVLM

And you can use Ollama to run it locally, and Open WebUI to access it in browser.