Chat with Documents - Ollama or Other? (beehaw.org)

submitted 1 month ago by [email protected] to c/[email protected]

2 comments fedilink hide all child comments

Been having too much fun using LLMs hosted locally, but can't seem to get Ollama's chat with documents to work well. Lots of "what are you talking about? There are no documents here" issues. Does anyone have any recommendations to either a) figure out what's going wrong or b) Alternative locally hosted options that chat with documents works well with (GPT4all or something?)

top 2 comments

sorted by: hot top controversial new old

[-] [email protected] 1 points 1 month ago* (last edited 1 month ago)

I haven't tested it extensively, but open webui also has RAG functionality (chat with documents).

The UI it self is also kinda cool and it has other useful features like commands (for common prompts) and searching for stuff online (e.g. with searx). It works quite well with Ollama.

[-] [email protected] 1 points 1 month ago

Thanks for this. Time to play around and experiment.

this post was submitted on 22 Jul 2024

2 points (100.0% liked)

Free and Open Source Software

17731 readers

3 users here now

If it's free and open source and it's also software, it can be discussed here. Subcommunity of Technology.

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago

MODERATORS

[email protected]