this post was submitted on 11 Jun 2024
9 points (84.6% liked)

Free Open-Source Artificial Intelligence

2882 readers
2 users here now

Welcome to Free Open-Source Artificial Intelligence!

We are a community dedicated to forwarding the availability and access to:

Free Open Source Artificial Intelligence (F.O.S.A.I.)

More AI Communities

LLM Leaderboards

Developer Resources

GitHub Projects

FOSAI Time Capsule

founded 1 year ago
MODERATORS
 

I noticed ai likes to assume ur a boy and ignore if ur not. When i played NovelAI it let me ban words so i would add every boy pronoun. Is it there a FOSS selfhosted way? I currently use koboldai with tavernai

top 11 comments
sorted by: hot top controversial new old
[–] [email protected] 5 points 5 months ago (1 children)

SillyTavern is a fork of TavernAI that lets you do more things. Perhaps look into that? Also you can just adjust the system prompt to have the LLM assume that you're not a boy.

[–] [email protected] 1 points 5 months ago (1 children)

I tried SillyTavern but the ui looked terrible. Do i put "i am a girl" in the prompt? How will it know im talking about me not the character

[–] [email protected] 3 points 5 months ago (1 children)

If you use the persona system, you can put " is a girl", otherwise "Refer to me as a girl throughout the conversation" would be fine

[–] [email protected] 2 points 5 months ago (1 children)

It worked. Thanks. Another question, how do i stop the random person who says get a room and similar?

[–] [email protected] 1 points 5 months ago (1 children)

What kind of LLM are you using? Depending on its effectiveness, you can put "this is a chat between you and me" (or whatever you and AI identify as) in the system prompt.

[–] [email protected] 1 points 5 months ago (1 children)

I am using DavidAU/Psyonic-Cetacean-Ultra-Quality-20b in koboldai horde. I plan to selfhost tho when i get my 3090 installed

[–] [email protected] 1 points 5 months ago (1 children)

OK, I gave it a look and it said that it's good at following instructions, so the aforementioned advice would still apply

[–] [email protected] 1 points 5 months ago (1 children)

I actually found the ai koboldcpp/crestfall-mythomax-L2-13b-q5_k_m works perfectly

[–] [email protected] 1 points 5 months ago

The models gone from the list...rip

[–] [email protected] 3 points 5 months ago* (last edited 5 months ago)

It would probably be more effective to put an explicit mention in the system prompt. "Your interlocutor is a and will be greatly offended to be refered to as a boy or a man."

[–] [email protected] 2 points 5 months ago

KoboldCPP has ban tokens that prevent those tokens from being output. Otherwise just put it in the prompt and it should probably work.