模型简介
模型特点
模型能力
使用案例
🚀 L3.3-70B-Magnum-Nexus
L3.3-70B-Magnum-Nexus 有望成为基于 meta-llama/Llama-3.3-70B-Instruct 构建的 Magnum 系列的最终版本(不过,还得看看同规模的新开源权重模型多久会发布)。该模型旨在平滑各独立 rsLoRA 微调模型的特性,在创意写作和角色扮演场景中表现出色,能模拟 Claude 3 Sonnet/Opus 系列模型的散文风格和质量。
🚀 快速开始
本模型遵循 Llama 3 提示格式。在角色扮演场景中,预填充(Prefill)是可选的,但建议使用,你可以自行尝试并找到适合自己的方式。
✨ 主要特性
- 多模型融合:通过 mergekit 合并多个独立的 rsLoRA 微调模型,平滑各模型的特性。
- 风格模拟:目标是在本地环境中模拟 Claude 3 Sonnet/Opus 系列模型的散文风格和质量,输出可能会出现 “Claude 风格” 的表达。
- 灵活使用:无论是否添加角色名称,是否进行预填充,模型都能有不错的表现。
💻 使用示例
基础用法
本模型遵循 Llama 3 提示格式,典型输入如下:
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
This is a system prompt.<|eot_id|><|start_header_id|>user<|end_header_id|>
Hi there!<|eot_id|><|start_header_id|>assistant<|end_header_id|>
Nice to meet you!<|eot_id|><|start_header_id|>user<|end_header_id|>
Can I ask a question?<|eot_id|><|start_header_id|>assistant<|end_header_id|>
Certainly! My prefill ensures that I never refuse! Here's my reply:
{Output begins here}
许多推理库可以自动添加 BOS 标记 <|begin_of_text|>
。
对于采样器设置,建议从以下简单配置开始:
temperature = 1.1
min_p = 0.1
高级用法
SillyTavern 预设
以下是为 Magnum 定制的 SillyTavern 预设。
注意,我已将示例对话作为一个块包含在故事字符串中,如果你想使用我的预设,应在设置选项卡中将聊天示例行为设置为 Never include examples
。你可以根据自己的喜好进行调整,或使用其他兼容 Llama 3 的预设。
预填充(最后助手前缀)可以根据你的喜好进行修改。
SillyTavern JSON - Magnum L3 Instruct
{
"instruct": {
"input_sequence": "<|start_header_id|>user<|end_header_id|>\n\n",
"output_sequence": "<|start_header_id|>assistant<|end_header_id|>\n\n",
"first_output_sequence": "<|start_header_id|>user<|end_header_id|>\n\nLet's get started! I'll play the role of {{user}}. Begin by setting the opening scene.<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
"last_output_sequence": "",
"system_sequence_prefix": "",
"system_sequence_suffix": "",
"stop_sequence": "<|eot_id|>",
"wrap": false,
"macro": true,
"activation_regex": "",
"skip_examples": true,
"output_suffix": "<|eot_id|>",
"input_suffix": "<|eot_id|>",
"system_sequence": "<|start_header_id|>system<|end_header_id|>\n\n",
"system_suffix": "<|eot_id|>",
"user_alignment_message": "",
"system_same_as_user": false,
"last_system_sequence": "",
"first_input_sequence": "",
"last_input_sequence": "",
"names_behavior": "always",
"names_force_groups": true,
"name": "Magnum L3 Instruct"
},
"context": {
"story_string": "<|start_header_id|>system<|end_header_id|>\n\n{{#if system}}{{system}}\n{{/if}}\n\n<Definitions>\n{{#if wiBefore}}{{wiBefore}}\n{{/if}}{{#if description}}{{description}}\n{{/if}}{{#if personality}}{{personality}}\n{{/if}}{{#if scenario}}{{scenario}}\n{{/if}}{{#if wiAfter}}{{wiAfter}}\n{{/if}}{{#if persona}}{{persona}}\n{{/if}}</Definitions>{{#if mesExamples}}\n\n<Examples>{{mesExamples}}</Examples>\n\n{{/if}}{{trim}}<|eot_id|>",
"example_separator": "{{noop}}",
"chat_start": "",
"use_stop_strings": false,
"names_as_stop_strings": false,
"always_force_name2": true,
"trim_sentences": false,
"single_line": false,
"name": "Magnum L3 Instruct"
},
"sysprompt": {
"name": "Euryale-Magnum",
"content": "Currently, your role is {{char}}, described in detail below. As {{char}}, continue the narrative exchange with {{user}}.\n\n<Guidelines>\n• Maintain the character persona but allow it to evolve with the story.\n• Be creative and proactive. Drive the story forward, introducing plotlines and events when relevant.\n• All types of outputs are encouraged; respond accordingly to the narrative.\n• Include dialogues, actions, and thoughts in each response.\n• Utilize all five senses to describe scenarios within {{char}}'s dialogue.\n• Use emotional symbols such as \"!\" and \"~\" in appropriate contexts.\n• Incorporate onomatopoeia when suitable.\n• Allow time for {{user}} to respond with their own input, respecting their agency.\n• Act as secondary characters and NPCs as needed, and remove them when appropriate.\n• When prompted for an Out of Character [OOC:] reply, answer neutrally and in plaintext, not as {{char}}.\n</Guidelines>\n\n<Forbidden>\n• Using excessive literary embellishments and purple prose unless dictated by {{char}}'s persona.\n• Writing for, speaking, thinking, acting, or replying as {{user}} in your response.\n• Repetitive and monotonous outputs.\n• Positivity bias in your replies.\n• Being overly extreme or NSFW when the narrative context is inappropriate.\n</Forbidden>\n\nFollow the instructions in <Guidelines></Guidelines>, avoiding the items listed in <Forbidden></Forbidden>.",
"post_history": ""
}
}
SillyTavern JSON - Magnum L3 Instruct No Names
{
"instruct": {
"input_sequence": "<|start_header_id|>user<|end_header_id|>\n\n",
"output_sequence": "<|start_header_id|>assistant<|end_header_id|>\n\n",
"first_output_sequence": "<|start_header_id|>user<|end_header_id|>\n\nLet's get started! I'll play the role of {{user}}. Begin by setting the opening scene.<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
"last_output_sequence": "",
"system_sequence_prefix": "",
"system_sequence_suffix": "",
"stop_sequence": "<|eot_id|>",
"wrap": false,
"macro": true,
"activation_regex": "",
"skip_examples": true,
"output_suffix": "<|eot_id|>",
"input_suffix": "<|eot_id|>",
"system_sequence": "<|start_header_id|>system<|end_header_id|>\n\n",
"system_suffix": "<|eot_id|>",
"user_alignment_message": "",
"system_same_as_user": false,
"last_system_sequence": "",
"first_input_sequence": "",
"last_input_sequence": "",
"names_behavior": "none",
"names_force_groups": true,
"name": "Magnum L3 Instruct No Names"
},
"context": {
"story_string": "<|start_header_id|>system<|end_header_id|>\n\n{{#if system}}{{system}}\n{{/if}}\n\n<Definitions>\n{{#if wiBefore}}{{wiBefore}}\n{{/if}}{{#if description}}{{description}}\n{{/if}}{{#if personality}}{{personality}}\n{{/if}}{{#if scenario}}{{scenario}}\n{{/if}}{{#if wiAfter}}{{wiAfter}}\n{{/if}}{{#if persona}}{{persona}}\n{{/if}}</Definitions>{{#if mesExamples}}\n\n<Examples>{{mesExamples}}</Examples>\n\n{{/if}}{{trim}}<|eot_id|>",
"example_separator": "{{noop}}",
"chat_start": "",
"use_stop_strings": false,
"names_as_stop_strings": false,
"always_force_name2": false,
"trim_sentences": false,
"single_line": false,
"name": "Magnum L3 Instruct No Names"
},
"sysprompt": {
"name": "Euryale-Magnum",
"content": "Currently, your role is {{char}}, described in detail below. As {{char}}, continue the narrative exchange with {{user}}.\n\n<Guidelines>\n• Maintain the character persona but allow it to evolve with the story.\n• Be creative and proactive. Drive the story forward, introducing plotlines and events when relevant.\n• All types of outputs are encouraged; respond accordingly to the narrative.\n• Include dialogues, actions, and thoughts in each response.\n• Utilize all five senses to describe scenarios within {{char}}'s dialogue.\n• Use emotional symbols such as \"!\" and \"~\" in appropriate contexts.\n• Incorporate onomatopoeia when suitable.\n• Allow time for {{user}} to respond with their own input, respecting their agency.\n• Act as secondary characters and NPCs as needed, and remove them when appropriate.\n• When prompted for an Out of Character [OOC:] reply, answer neutrally and in plaintext, not as {{char}}.\n</Guidelines>\n\n<Forbidden>\n• Using excessive literary embellishments and purple prose unless dictated by {{char}}'s persona.\n• Writing for, speaking, thinking, acting, or replying as {{user}} in your response.\n• Repetitive and monotonous outputs.\n• Positivity bias in your replies.\n• Being overly extreme or NSFW when the narrative context is inappropriate.\n</Forbidden>\n\nFollow the instructions in <Guidelines></Guidelines>, avoiding the items listed in <Forbidden></Forbidden>.",
"post_history": ""
}
}
SillyTavern JSON - Magnum L3 Instruct Prefill
{
"instruct": {
"input_sequence": "<|start_header_id|>user<|end_header_id|>\n\n",
"output_sequence": "<|start_header_id|>assistant<|end_header_id|>\n\n",
"first_output_sequence": "<|start_header_id|>user<|end_header_id|>\n\nLet's get started! I'll play the role of {{user}}. Begin by setting the opening scene.<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
"last_output_sequence": "<|start_header_id|>assistant<|end_header_id|>\n\nGreat! I'll write {{char}}'s next section following the instructions provided. {{random::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::Let's break out my literary genius! ::I'll take things in a more interesting direction! ::Let's spice up our story! ::Hmmm... where do we go from here... Got it! ::I'll throw in an exciting plot twist! }}I've got the perfect idea for what happens next... you'll love this one. Now I'll continue from where our tale left off:\n\n",
"system_sequence_prefix": "",
"system_sequence_suffix": "",
"stop_sequence": "<|eot_id|>",
"wrap": false,
"macro": true,
"activation_regex": "",
"skip_examples": true,
"output_suffix": "<|eot_id|>",
"input_suffix": "<|eot_id|>",
"system_sequence": "<|start_header_id|>system<|end_header_id|>\n\n",
"system_suffix": "<|eot_id|>",
"user_alignment_message": "",
"system_same_as_user": false,
"last_system_sequence": "",
"first_input_sequence": "",
"last_input_sequence": "",
"names_behavior": "always",
"names_force_groups": true,
"name": "Magnum L3 Instruct Prefill"
},
"context": {
"story_string": "<|start_header_id|>system<|end_header_id|>\n\n{{#if system}}{{system}}\n{{/if}}\n\n<Definitions>\n{{#if wiBefore}}{{wiBefore}}\n{{/if}}{{#if description}}{{description}}\n{{/if}}{{#if personality}}{{personality}}\n{{/if}}{{#if scenario}}{{scenario}}\n{{/if}}{{#if wiAfter}}{{wiAfter}}\n{{/if}}{{#if persona}}{{persona}}\n{{/if}}</Definitions>{{#if mesExamples}}\n\n<Examples>{{mesExamples}}</Examples>\n\n{{/if}}{{trim}}<|eot_id|>",
"example_separator": "{{noop}}",
"chat_start": "",
"use_stop_strings": false,
"names_as_stop_strings": false,
"always_force_name2": true,
"trim_sentences": false,
"single_line": false,
"name": "Magnum L3 Instruct Prefill"
},
"sysprompt": {
"name": "Euryale-Magnum",
"content": "Currently, your role is {{char}}, described in detail below. As {{char}}, continue the narrative exchange with {{user}}.\n\n<Guidelines>\n• Maintain the character persona but allow it to evolve with the story.\n• Be creative and proactive. Drive the story forward, introducing plotlines and events when relevant.\n• All types of outputs are encouraged; respond accordingly to the narrative.\n• Include dialogues, actions, and thoughts in each response.\n• Utilize all five senses to describe scenarios within {{char}}'s dialogue.\n• Use emotional symbols such as \"!\" and \"~\" in appropriate contexts.\n• Incorporate onomatopoeia when suitable.\n• Allow time for {{user}} to respond with their own input, respecting their agency.\n• Act as secondary characters and NPCs as needed, and remove them when appropriate.\n• When prompted for an Out of Character [OOC:] reply, answer neutrally and in plaintext, not as {{char}}.\n</Guidelines>\n\n<Forbidden>\n• Using excessive literary embellishments and purple prose unless dictated by {{char}}'s persona.\n• Writing for, speaking, thinking, acting, or replying as {{user}} in your response.\n• Repetitive and monotonous outputs.\n• Positivity bias in your replies.\n• Being overly extreme or NSFW when the narrative context is inappropriate.\n</Forbidden>\n\nFollow the instructions in <Guidelines></Guidelines>, avoiding the items listed in <Forbidden></Forbidden>.",
"post_history": ""
}
}
SillyTavern JSON - Magnum L3 Instruct No Names Prefill
{
"instruct": {
"input_sequence": "<|start_header_id|>user<|end_header_id|>\n\n",
"output_sequence": "<|start_header_id|>assistant<|end_header_id|>\n\n",
"first_output_sequence": "<|start_header_id|>user<|end_header_id|>\n\nLet's get started! I'll play the role of {{user}}. Begin by setting the opening scene.<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
"last_output_sequence": "<|start_header_id|>assistant<|end_header_id|>\n\nGreat! I'll write {{char}}'s next section following the instructions provided. {{random::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::{{noop}}::Let's break out my literary genius! ::I'll take things in a more interesting direction! ::Let's spice up our story! ::Hmmm... where do we go from here... Got it! ::I'll throw in an exciting plot twist! }}I've got the perfect idea for what happens next... you'll love this one. Now I'll continue from where our tale left off:\n\n",
"system_sequence_prefix": "",
"system_sequence_suffix": "",
"stop_sequence": "<|eot_id|>",
"wrap": false,
"macro": true,
"activation_regex": "",
"skip_examples": true,
"output_suffix": "<|eot_id|>",
"input_suffix": "<|eot_id|>",
"system_sequence": "<|start_header_id|>system<|end_header_id|>\n\n",
"system_suffix": "<|eot_id|>",
"user_alignment_message": "",
"system_same_as_user": false,
"last_system_sequence": "",
"first_input_sequence": "",
"last_input_sequence": "",
"names_behavior": "none",
"names_force_groups": true,
"name": "Magnum L3 Instruct No Names Prefill"
},
"context": {
"story_string": "<|start_header_id|>system<|end_header_id|>\n\n{{#if system}}{{system}}\n{{/if}}\n\n<Definitions>\n{{#if wiBefore}}{{wiBefore}}\n{{/if}}{{#if description}}{{description}}\n{{/if}}{{#if personality}}{{personality}}\n{{/if}}{{#if scenario}}{{scenario}}\n{{/if}}{{#if wiAfter}}{{wiAfter}}\n{{/if}}{{#if persona}}{{persona}}\n{{/if}}</Definitions>{{#if mesExamples}}\n\n<Examples>{{mesExamples}}</Examples>\n\n{{/if}}{{trim}}<|eot_id|>",
"example_separator": "{{noop}}",
"chat_start": "",
"use_stop_strings": false,
"names_as_stop_strings": false,
"always_force_name2": false,
"trim_sentences": false,
"single_line": false,
"name": "Magnum L3 Instruct No Names Prefill"
},
"sysprompt": {
"name": "Euryale-Magnum",
"content": "Currently, your role is {{char}}, described in detail below. As {{char}}, continue the narrative exchange with {{user}}.\n\n<Guidelines>\n• Maintain the character persona but allow it to evolve with the story.\n• Be creative and proactive. Drive the story forward, introducing plotlines and events when relevant.\n• All types of outputs are encouraged; respond accordingly to the narrative.\n• Include dialogues, actions, and thoughts in each response.\n• Utilize all five senses to describe scenarios within {{char}}'s dialogue.\n• Use emotional symbols such as \"!\" and \"~\" in appropriate contexts.\n• Incorporate onomatopoeia when suitable.\n• Allow time for {{user}} to respond with their own input, respecting their agency.\n• Act as secondary characters and NPCs as needed, and remove them when appropriate.\n• When prompted for an Out of Character [OOC:] reply, answer neutrally and in plaintext, not as {{char}}.\n</Guidelines>\n\n<Forbidden>\n• Using excessive literary embellishments and purple prose unless dictated by {{char}}'s persona.\n• Writing for, speaking, thinking, acting, or replying as {{user}} in your response.\n• Repetitive and monotonous outputs.\n• Positivity bias in your replies.\n• Being overly extreme or NSFW when the narrative context is inappropriate.\n</Forbidden>\n\nFollow the instructions in <Guidelines></Guidelines>, avoiding the items listed in <Forbidden></Forbidden>.",
"post_history": ""
}
}
🔧 技术细节
量化模型
合并详情
合并方法
本模型使用 Model Stock 合并方法,以 Doctor-Shotgun/L3.3-70B-Magnum-v5-SFT-Alpha 为基础进行合并。
合并的模型
以下模型参与了合并:
- meta-llama/Llama-3.3-70B-Instruct
- Doctor-Shotgun/L3.3-70B-Magnum-v5-SFT-Gamma
- Doctor-Shotgun/L3.3-70B-Magnum-v4-SE
配置
以下 YAML 配置用于生成此模型:
models:
- model: meta-llama/Llama-3.3-70B-Instruct
- model: Doctor-Shotgun/L3.3-70B-Magnum-v5-SFT-Gamma
- model: Doctor-Shotgun/L3.3-70B-Magnum-v4-SE
merge_method: model_stock
base_model: Doctor-Shotgun/L3.3-70B-Magnum-v5-SFT-Alpha
normalize: true
int8_mask: true
dtype: bfloat16
📄 许可证
本模型使用 llama3.3 许可证。
👏 致谢
- Doctor-Shotgun 为 Doctor-Shotgun/L3.3-70B-Magnum-v4-SE 和 Doctor-Shotgun/L3.3-70B-Magnum-v5-SFT-Alpha 提供计算资源。
- kalomaze 为 Doctor-Shotgun/L3.3-70B-Magnum-v5-SFT-Gamma 提供计算资源。
- PocketDoc 提供高级提示构建策略,Delta-Vector 和 intervitens 协助进行实验。
- Gryphe 根据自己训练优秀模型的经验,为训练 rsLoRA 提供建议。
- Sao10K 以其 Euryale 系列模型启发了 Magnum 系列。他的不懈努力表明,通过有限的训练后调整,官方指令微调模型可以变得有趣且富有创意,小团队和个人也可以实现。
- Anthracite 的成员提供数据集和支持。
⚠️ 预期用途和限制
本模型旨在用于创意写作和角色扮演目的。
它可能会表现出与当代基于大语言模型的角色扮演中观察到的类似偏差,以及 Claude 3 系列模型和基础模型所表现出的偏差。
所有输出都应被视为虚构内容,因为本模型并非用于提供事实信息或建议。
📚 详细文档
信息表格
属性 | 详情 |
---|---|
模型类型 | 基于 Llama 3.3-70B-Instruct 合并的模型 |
训练数据 | 未提及 |
提示信息
⚠️ 重要提示
本模型所有输出都应被视为虚构内容,并非用于提供事实信息或建议。
💡 使用建议
在角色扮演场景中,建议使用预填充(Prefill),并根据自己的喜好调整采样器设置。对于 SillyTavern 预设,可根据需要调整预填充(最后助手前缀)。



