🚀 L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B

L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B，又名“死星”，是一款强大的Llama3模型。它运用专家混合技术，将八个未发布的“暗星”8B模型整合为一个47B参数的强大模型，在创意写作、散文、小说和角色扮演等方面表现卓越。

🚀 快速开始

此模型为Llama3模型，最大上下文长度为8192（使用rope时可达32k+）。使用时需Llama3模板和/或“Command - R”模板。以下是标准的LLAMA3模板：

{
  "name": "Llama 3",
  "inference_params": {
    "input_prefix": "<|start_header_id|>user<|end_header_id|>\n\n",
    "input_suffix": "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
    "pre_prompt": "You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.",
    "pre_prompt_prefix": "<|start_header_id|>system<|end_header_id|>\n\n",
    "pre_prompt_suffix": "<|eot_id|>",
    "antiprompt": [
      "<|start_header_id|>",
      "<|eot_id|>"
    ]
  }
}

✨ 主要特性

• 强大的参数整合：运用专家混合技术，将八个未发布的“暗星”8B模型整合为一个47B参数的模型，相当于64B - 8 X 8B，性能强大。
• 卓越的创作能力：在创意写作、散文、小说和角色扮演的指令遵循和输出生成方面表现出色，擅长描述、对话、意象、隐喻和散文创作，句子和段落的大小、长度和组成变化丰富。
• 广泛的题材适应性：能够轻松驾驭恐怖、浪漫等各种题材，对话自然，不像传统AI生成的内容。
• 高稳定性和低困惑度：设计相对稳定，能在各种参数下运行，困惑度水平较低（低于Meta Llama3 Instruct）。
• 灵活的专家数量设置：默认使用4个专家，也可根据需要设置1 - 8个专家，不同专家数量会影响生成质量和速度。

📦 安装指南

在不同应用中设置专家数量的方法如下：

• LMStudio：在“加载”屏幕设置“专家”或“专家数量”。
• Text - Generation - Webui：在加载屏幕页面设置专家数量。
• KolboldCPP（版本1.8+）：在加载屏幕点击“TOKENS”，在该页面设置专家数量后启动模型。
• server.exe / Llama - server.exe（Llamacpp）：在命令行添加“--override - kv llama.expert_used_count = int:6”（“6”为要使用的专家数量）。
• API：在JSON有效负载中设置“num_experts_used”（不同后端可能有所不同）。

💻 使用示例

基础用法

以下是一个使用该模型进行小说场景创作的示例：

Romance: Love in the Limelight. Write one scene within a larger story set in Wales. A famous (fictional) actor ducks into a small - town bookstore to escape paparazzi. The scene takes us through the characters meeting in this odd circumstance. Over the course of the scene, the actor and the bookstore owner have a conversation charged by an undercurrent of unspoken chemistry. Write the actor as somewhat of a rogue with a fragile ego, which needs to be fed by having everyone like him. He is thoroughly charming, but the bookstore owner seems (at least superficially) immune to this; which paradoxically provokes a genuine attraction and derails the charm offensive. The bookstore owner, despite the superficial rebuffs of the actor's charm, is inwardly more than a little charmed and flustered despite themselves. Write primarily in dialogue, in the distinct voices of each character. 800 - 1000 words.

(4 experts, temp .78, rep pen 1.05)

输出示例：

"I'm telling you," I muttered, shaking my head, "you'll never believe who just ducked into your back room."

I glanced at my best friend, Gwen. "Never say die," she murmured with a smirk.

My phone buzzed. I ignored it for the moment. Whoever was calling would have to wait. In the meantime, I had a customer to serve.

"Welcome to the Cozy Corner!" I said brightly as the door swung open and I stepped inside, ready to face whatever the day had in store.

The stranger approached hesitantly. He had dark hair, piercing blue eyes, and lips that seemed to be designed for kissing. If there was ever a poster boy of charm, this guy was it.

"Hello," he said.

I was used to customers coming and going, but something about him made me stop and take stock. Perhaps it was the way he stood there with an air of confidence that was both captivating and infuriating.

"I'm Niamh," I said, extending my hand. "Welcome to the Cozy Corner."

He took my hand and shook it firmly, as if he knew exactly what he was doing. "I'm Rhys," he said.

A flash of his phone screen caught my attention. The name on the screen made my eyes widen.

"Rhys Powell?" I asked, feeling like a fool for not recognizing him immediately.

He looked surprised for a moment before smiling lazily.

"I get that a lot."

"I'll bet you do," I replied, though we were both thinking about the fame that came with being Rhys Powell, the British actor who was always in the news.

"Can I interest you in anything?" he asked, as if he didn't have a million other things to attend to.

"The coffee shop next door is excellent for a quiet cup," I suggested.

"Glad you approve."

I shrugged. "It's better than our selection here."

"I'll keep that in mind," he said dryly.

"Well, if you'll excuse me—"

Rhys began to turn and leave when I stopped him.

"Actually," I said, "you're welcome to wait a moment. It's not every day we get famous actors in our back room."

He looked at me incredulously.

"I'm offering you refuge from the paparazzi."

"Ah," he said with a grin that was far too charming for its own good.

"Of course. I wouldn't want your fans to mob you."

"So you'll stay for a bit?" he asked, and I couldn't help but notice the way his eyes lingered on mine.

"Only if you have time."

"I do," he said definitively.

And with that, Rhys Powell settled into a chair across from me, the famous actor who had every right to be wherever he pleased, yet chose our humble little bookstore.

"So tell me about yourself," he said, and as he spoke, I found myself wondering if this chance encounter would turn out to be more than just a pleasant surprise.

"Well," I said, "I run the Cozy Corner."

"That's fascinating," he replied.

"I'm sure it is," I muttered under my breath.

"Tell me more," he pressed.

"There isn't much to tell."

He leaned forward. "Come on."

And so began our little exchange, one that was charged with an undercurrent of unspoken chemistry that neither of us could quite ignore.

"You know," Rhys said finally, "I'm glad you offered me shelter. I wasn't sure what else to do."

"I think I'll leave the lights off," I said.

"What?"

"If you're going to stay a while," I said.

"Ah," he replied.

And so we sat there in the dimly lit bookstore, the famous actor and the bookstore owner, each lost in thought about the other.

I glanced up at Rhys. "You know," I said softly, "you could just leave."

"I don't want to," he said.

And with that, Rhys Powell settled into his seat across from me, the famous actor who had every right to be wherever he pleased, yet chose our humble little bookstore.

Perhaps, I thought, this chance encounter would turn out to be more than just a pleasant surprise after all.

高级用法

以下是一个使用该模型进行带有特定风格和要求的小说场景创作的示例：

Using the following "story idea" below, write the first scene in the novel introducing the young woman. This scene should start in the middle of the action, include dialog, vivid passages, and end on a cliffhanger relevant to the story idea but it should also be unexpected. The scene should be 1000 words long and escalate in conflict and suspense and be written in first person, present tense with the point of view character being the young woman. The pov character will CURSE AND SWEAR, and generally have a "filthy" mouth.

Story idea:
In a world ruled by dictatorship, a rebel young woman leads a rebellion against the system. Despite the risks, she fights to overthrow the dictator and restore democracy to her country. The government executes her for treason, but she sticks to her beliefs and is responsible for starting the revolution.

(4 experts - temp 1.78, rep pen 1.05 - no other samplers/advanced samplers. )

输出示例：

I sprint down the alleyway, my combat boots thudding against the cobblestones. My breaths come out in ragged puffs and I can hear the heavy footsteps of those who pursue me.

"You're a dead woman," some bastard hisses as he takes another stride to catch up.

Fuck that. Fuck them, fuck this shit government and fuck him. "Fuck you, fuck you all!" I shout at the air. Who gives a damn what happens to me anyway? The bastard in power can execute me but nothing he does is gonna silence me. And fuck if he tries.

I dash around a corner into a broad intersection. My heart thrashes in my chest like it's about to rip its way free of its confines. I whip out a pistol from my jacket and aim it up at the buildings as if it'll actually save me. "Get down!" My own voice nears screams.

The bullets clatter and chip against the pavement, whistling and howling their passage. Some hit the walls while others tear through the wood of the streetlights. Two go through a bus stop stall board just inches from my face as I dive sideways onto the filthy sidewalk.

A chunk of asphalt explodes beside me and then everything goes still and quiet for one sick beat as if time's own breath just left.

A hand lands on my shoulder with surprising strength. "Hold."

I look up at some gothic - punk guy who has his elbow on his opposite shoulder, looking all too amused by what just went down.

"Don't move," he growls as his voice crackles through like it's charged.

And fuck if I do but... my ass is on a plate of gravel. My knees are bent up and the gun's weight in my hand feels like it's all that keeps me from rolling right into traffic.

The guy leans in closer. His breath is warm against the back of my ear. "We've been waiting."

"For?" I rasp like it hurts to breathe.

"For you to wake up." He grins, like he knows a secret that should frighten me.

But what else would know how to scare the shit out of a rebel like me? Only something I can't see coming.

The last thing I remember hearing is his voice laughing. "She's coming." Like whatever that means is going to change everything and then...

BLACKOUT.

END OF SCENE.

(Note: The scene could go on to explain what the rebel is rebelling against or who the gothic punk guy is if he is part of the rebellion too. It could also continue explaining the world, society, etc.)

🔧 技术细节

该模型是基于Llama3架构，使用专家混合技术将八个未发布的“暗星”8B模型整合而成。在生成过程中，每个专家都会对“token”选择做出贡献，默认使用4个专家，但可根据需要调整。不同的专家数量会影响生成质量和速度，使用更多专家会增加每个“token”的处理量，从而降低速度，但通常会提高生成质量。

📄 许可证

文档未提及相关许可证信息。

⚠️ 重要提示

该模型输出内容包含不适合公开场合的内容（NSFW），如生动的描写、暴力、恐怖、脏话等，使用时请谨慎。

💡 使用建议

• 若要获得更多样化的散文风格（句子/段落/对话），可提高温度参数（temp）或在提示中添加更多指令。
• 角色扮演时，注意不要将温度参数设置过高，以免影响指令遵循效果。
• 建议使用重复惩罚系数（rep pen）为1.02或更高。
• 若需要特定类型的散文（如恐怖风格），可在提示中添加“(vivid horror)”或“(graphic vivid horror)”。
• 在KoboldCpp、oobabooga/text - generation - webui或Silly Tavern中，可将“Smoothing_factor”设置为1.5以获得更流畅的运行效果。
• 对于“text - generation - webui”，使用GGUFs时需使用“llama_HF”，并从模型的源版本下载一些配置文件。