base_model:
- IlyaGusev/saiga_nemo_12b
- elinas/Chronos-Gold-12B-1.0
- Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24
- MarinaraSpaghetti/NemoMix-Unleashed-12B
library_name: transformers
tags:
- mergekit
- merge
- rp
- role-play
- mistral
language:
- ru
- en
SAINEMO-reMIX混音版

GGUF格式:感谢mradermacher团队
https://huggingface.co/mradermacher/SAINEMO-reMIX-GGUF
GGUF imatrix增强版
https://huggingface.co/mradermacher/SAINEMO-reMIX-i1-GGUF
排行榜表现

推荐预设参数
以下预设参数适配本模型:https://huggingface.co/MarinaraSpaghetti/SillyTavern-Settings/tree/main/Customized/Mistral%20Improved
采样器设置
温度系数 - 0.7 - 1.2 区间
TopA - 0.1
动态重复惩罚 - 0.8 1.75 2 0
建议尝试SillyTavern的基础预设方案,例如simple-1模式。
这是使用mergekit工具合并的预训练语言模型。
合并详情
合并方法
本模型采用della_linear线性合并法,以E:\Programs\TextGen\text-generation-webui\models\IlyaGusev_saiga_nemo_12b作为基础模型。
参与合并的模型
合并包含以下模型:
- E:\Programs\TextGen\text-generation-webui\models\elinas_Chronos-Gold-12B-1.0
- E:\Programs\TextGen\text-generation-webui\models\Vikhrmodels_Vikhr-Nemo-12B-Instruct-R-21-09-24
- E:\Programs\TextGen\text-generation-webui\models\MarinaraSpaghetti_NemoMix-Unleashed-12B
配置参数
合并使用的YAML配置文件如下:
models:
- model: E:\Programs\TextGen\text-generation-webui\models\IlyaGusev_saiga_nemo_12b
parameters:
weight: 0.55
density: 0.4
- model: E:\Programs\TextGen\text-generation-webui\models\MarinaraSpaghetti_NemoMix-Unleashed-12B
parameters:
weight: 0.2
density: 0.4
- model: E:\Programs\TextGen\text-generation-webui\models\elinas_Chronos-Gold-12B-1.0
parameters:
weight: 0.15
density: 0.4
- model: E:\Programs\TextGen\text-generation-webui\models\Vikhrmodels_Vikhr-Nemo-12B-Instruct-R-21-09-24
parameters:
weight: 0.25
density: 0.4
merge_method: della_linear
base_model: E:\Programs\TextGen\text-generation-webui\models\IlyaGusev_saiga_nemo_12b
parameters:
epsilon: 0.05
lambda: 1
dtype: float16
tokenizer_source: base