Free Open-Source Artificial Intelligence

Starting a Mistral Megathread to aggregate resources.

This is my new favorite 7B model. It is really good for what it is. I am excited to see what we can tune together. I will be using this thread as a living document, expect a lot of changes and notes, revisions and updates.

Let me know if there's something in particular you want to see here. I will be adding to this thread throughout my fine-tuning journey with Mistral.

Mistral Model Megathread

Key

• Link #1 - Base Model
• Link #2 - Instruct Model

Quantized Base Models from TheBloke

GPTQ

• https://huggingface.co/TheBloke/Mistral-7B-v0.1-GPTQ
• https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GPTQ

GGUF

• https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF
• https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF

AWQ

• https://huggingface.co/TheBloke/Mistral-7B-v0.1-AWQ
• https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-AWQ

Quantized Samantha Models from TheBloke

GPTQ

• https://huggingface.co/TheBloke/samantha-mistral-7B-GPTQ
• https://huggingface.co/TheBloke/samantha-mistral-instruct-7B-GPTQ

GGUF

• https://huggingface.co/TheBloke/samantha-mistral-7B-GGUF
• https://huggingface.co/TheBloke/samantha-mistral-instruct-7B-GGUF

AWQ

• https://huggingface.co/TheBloke/samantha-mistral-7B-AWQ
• https://huggingface.co/TheBloke/samantha-mistral-instruct-7B-AWQ

Quantized Kimiko Models from TheBloke

GPTQ

• https://huggingface.co/TheBloke/Kimiko-Mistral-7B-GPTQ

GGUF

• https://huggingface.co/TheBloke/Kimiko-Mistral-7B-GGUF

AWQ

• https://huggingface.co/TheBloke/Kimiko-Mistral-7B-AWQ

Quantized Dolphin Models from TheBloke

GPTQ

• https://huggingface.co/TheBloke/dolphin-2.0-mistral-7B-GPTQ

GGUF

• https://huggingface.co/TheBloke/dolphin-2.0-mistral-7B-GGUF

AWQ

• https://huggingface.co/TheBloke/dolphin-2.0-mistral-7B-AWQ

Quantized Orca Models from TheBloke

GPTQ

• https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-GPTQ

GGUF

• https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-GGUF

AWQ

• https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-AWQ

Quantized Airoboros Models from TheBloke

GPTQ

• https://huggingface.co/TheBloke/airoboros-mistral2.2-7B-GPTQ

GGUF

• https://huggingface.co/TheBloke/airoboros-mistral2.2-7B-GGUF

AWQ

• https://huggingface.co/TheBloke/airoboros-mistral2.2-7B-AWQ

If you like to run any of the quantized/optimized models from TheBloke, do visit the full model pages from each of the quantized model cards to see and support the developers of each fine-tuned model.

• Mistral - Mistral.ai
• Mistral Samantha - Eric Hartford
• Mistral Kimiko - nRuaif
• Mistral Dolphin - Eric Hartford
• Mistral OpenOrca - OpenOrca/Alignment Lab
• Mistral Airoboros - teknium