license: apache-2.0 language:

• zh
• en tags:
• text-generation-inference

凉宫春日对话抽取模型

我们希望构建一个能从小说片段中批量提取摘要和对话的模型。

本模型实现了这一目标。使用约3万部中文小说和2万部英文小说数据进行训练，基于qwen-1.8模型进行了3个epoch的微调。该模型理论上支持中英文小说的内容抽取。

主项目地址 https://github.com/LC1332/Chat-Haruhi-Suzumiya

• 李鲁鲁完成数据收集工作，并将推理程序扩展至连续文本块处理
• 刘崇寒负责模型训练
• 米唯实完成模型测试及Hugging Face平台部署

推理代码

https://github.com/LC1332/Chat-Haruhi-Suzumiya/blob/main/notebook/Dialogue_Speaker_Extract_Test.ipynb

from transformers import AutoTokenizer, AutoModel, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("silk-road/Haruhi-Dialogue-Speaker-Extract_qwen18", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("silk-road/Haruhi-Dialogue-Speaker-Extract_qwen18", device_map="auto", trust_remote_code=True)

sys_prompt = "给定输入段落，抽取其中对话并以json格式输出。请逐步思考：1. 将段落概括为要点形式，存入summary字段 2. 抽取每句对话内容(dialogue)，判断说话人(said by)，存入conversations字段"

text = "您的小说文本"
response_str, history = model.chat(tokenizer, text, history=[], system=sys_prompt)

标准提示词

中文版：

给定输入段落，抽取其中对话并以json格式输出。请逐步思考：1. 将段落概括为要点形式，存入summary字段 2. 抽取每句对话内容(dialogue)，判断说话人(said by)，存入conversations字段

英文版：

Given an input paragraph, extract the dialogues within it, and output them in JSON format.

Let's think about it step by step:
- Summarize the input paragraph into bullet points and store it in the 'summary' field.
- Extract the content of each dialogue ('dialogue'), identify the speaker for each sentence ('said by'), and store these in 'conversations'.

待办事项

• [x] 扩展至多文本块推理
• [x] 提供英文示例
• [ ] 提供多章节并行推理示例
• [ ] JSON解析失败时尝试从原始文本提取摘要
• [ ] 失败时额外调用OpenAI进行推理

中文输出示例

{'summary': '- 彭蠡不在家中，老刀感到担忧并等待着彭蠡回家的时间，同时观察周围环境和人们的消费行为，表现出内心的饥饿感和焦虑情绪。', 'conversations': [{'dialogue': '哎，你们知道那儿一盘回锅肉多少钱吗？', 'said_by': '小李'}, {'dialogue': '靠，菜里有沙子。', 'said_by': '小丁'}, {'dialogue': '人家那儿一盘回锅肉，就三百四。', 'said_by': '小李'}, {'dialogue': '什么玩意？这么贵。', 'said_by': '小丁'}, {'dialogue': '你吃不了这么多。', 'said_by': '小李'}]}
{'summary': '- 彭蠡在家等待彭蠡回家，表现出内心的饥饿感和焦虑情绪，同时对彭蠡的行为表示不满和失望。彭蠡则对老刀的行为表现出冷漠和不屑的态度。', 'conversations': [{'dialogue': '我没时间和你解释。我需要去第一空间，你告诉我怎么走。', 'said_by': '老刀'}, {'dialogue': '回我家说，要走也从那儿走。', 'said_by': '彭蠡'}, {'dialogue': '回家啦，回家啦。转换马上开始了。', 'said_by': '车上的人'}, {'dialogue': '你不告诉我为什么，我就不告诉你怎么走。', 'said_by': '彭蠡'}, {'dialogue': '你躲在垃圾道里？去第二空间？那你得等24小时啊。', 'said_by': '彭蠡'}, {'dialogue': '二十万块。等一礼拜也值啊。', 'said_by': '老刀'}, {'dialogue': '你就这么缺钱花？', 'said_by': '彭蠡'}, {'dialogue': '糖糖还有一年多该去幼儿园了。我来不及了。', 'said_by': '老刀'}, {'dialogue': '你别说了。', 'said_by': '彭蠡'}]}
{'summary': '- 彭蠡对彭蠡的行为表现出不满和失望，同时对老刀的行为表现出冷漠和不屑的态度。', 'conversations': [{'dialogue': '你真是作死，她又不是你闺女，犯得着吗。', 'said_by': '彭蠡'}, {'dialogue': '别说这些了。快告我怎么走。', 'said_by': '老刀'}, {'dialogue': '你可得知道，万一被抓着，可不只是罚款，得关上好几个月。', 'said_by': '彭蠡'}, {'dialogue': '你不是去过好多次吗？', 'said_by': '老刀'}, {'dialogue': '只有四次。第五次就被抓了。', 'said_by': '彭蠡'}, {'dialogue': '那也够了。我要是能去四次，抓一次也无所谓。', 'said_by': '老刀'}, {'dialogue': '别说了。你要是真想让我带你去，我就带你去。', 'said_by': '彭蠡'}]}

- 彭蠡不在家中，老刀感到担忧并等待着彭蠡回家的时间，同时观察周围环境和人们的消费行为，表现出内心的饥饿感和焦虑情绪。
小李 : 哎，你们知道那儿一盘回锅肉多少钱吗？
小丁 : 靠，菜里有沙子。
小李 : 人家那儿一盘回锅肉，就三百四。
小丁 : 什么玩意？这么贵。
小李 : 你吃不了这么多。
- 彭蠡在家等待彭蠡回家，表现出内心的饥饿感和焦虑情绪，同时对彭蠡的行为表示不满和失望。彭蠡则对老刀的行为表现出冷漠和不屑的态度。
老刀 : 我没时间和你解释。我需要去第一空间，你告诉我怎么走。
彭蠡 : 回我家说，要走也从那儿走。
车上的人 : 回家啦，回家啦。转换马上开始了。
彭蠡 : 你不告诉我为什么，我就不告诉你怎么走。
彭蠡 : 你躲在垃圾道里？去第二空间？那你得等24小时啊。
老刀 : 二十万块。等一礼拜也值啊。
彭蠡 : 你就这么缺钱花？
老刀 : 糖糖还有一年多该去幼儿园了。我来不及了。
彭蠡 : 你别说了。
- 彭蠡对彭蠡的行为表现出不满和失望，同时对老刀的行为表现出冷漠和不屑的态度。
彭蠡 : 你真是作死，她又不是你闺女，犯得着吗。
老刀 : 别说这些了。快告我怎么走。
彭蠡 : 你可得知道，万一被抓着，可不只是罚款，得关上好几个月。
老刀 : 你不是去过好多次吗？
彭蠡 : 只有四次。第五次就被抓了。
老刀 : 那也够了。我要是能去四次，抓一次也无所谓。
彭蠡 : 别说了。你要是真想让我带你去，我就带你去。

英文输出示例

{'summary': "雪中的巴黎，木村的工作室，艺术家与观察者展开对话。", 'conversations': [{'dialogue': 'You should hear the stories they tell of you at the café. If Émile is to be believed, you arrived here as an ukiyo-e courtesan, nothing more than paper wrapped around a porcelain bowl. A painter—he will not say which of us it was, of course—bought the bowl and the print along with it.', 'said_by': 'Artist'}, {'dialogue': 'And the painter pulled me from the print with the sheer force of his imagination, I’m sure. Émile is a novelist and can hardly be trusted to give an accurate account. The reality of my conception is vastly more mundane, I assure you…though it does involve a courtesan.', 'said_by': 'Woman'}, {'dialogue': 'A grain of truth makes for the best fiction. nude, but leave the jewelry and the shoes. I’ll paint you on the chaise. We’ll have three hours in the proper light, and I will pay you four francs.', 'said_by': 'Artist'}, {'dialogue': 'Victorine gets five!', 'said_by': 'Woman'}, {'dialogue': 'Victorine is a redhead.', 'said_by': 'Artist'}, {'dialogue': 'My name is Mariko, by the way, but everyone calls me Mari.', 'said_by': 'Mariko'}]}
{'summary': "雪中的巴黎，木村的工作室，艺术家与观察者进行亲密对话和互动。", 'conversations': [{'dialogue': 'I’m on the chaise', 'said_by': 'Artist'}, {'dialogue': 'Bring your left hip forward. No, not that far. Bend the leg a bit more, yes. Turn your head to face the canvas.', 'said_by': 'Artist'}, {'dialogue': 'Like a Manet', 'said_by': 'Artist'}, {'dialogue': 'Don’t like a model that talks while you work, huh?', 'said_by': 'Artist'}, {'dialogue': 'I don’t like being compared to other artists.', 'said_by': 'Artist'}, {'dialogue': 'Then you must paint me so well that I forget about the others.', 'said_by': 'Artist'}, {'dialogue': 'Tilt your head into the light. And look at me intently. Intently. As though I were the one naked on the chaise.', 'said_by': 'Artist'}, {'dialogue': 'You did better than I would have expected.', 'said_by': 'Artist'}, {'dialogue': 'There are other poses I could show you, if you like?', 'said_by': 'Artist'}, {'dialogue': 'But the sooner I get started on this portrait, the better.', 'said_by': 'Artist'}]}
{'summary': "木村的工作室，艺术家与观察者进行亲密对话和互动。木村以强烈而冷漠的拥抱回应，引发激情互动。事后艺术家入睡，留下叙述者感到不完整和渴望。", 'num': 14, 'conversations': [{'dialogue': 'I could show you other poses.', 'said_by': 'Kimura'}, {'dialogue': 'Yes.', 'said_by': 'Kimura'}, {'dialogue': 'See you tomorrow?', 'said_by': 'Artist'}]}

雪中的巴黎，木村的工作室，艺术家与观察者展开对话。
Artist : You should hear the stories they tell of you at the café. If Émile is to be believed, you arrived here as an ukiyo-e courtesan, nothing more than paper wrapped around a porcelain bowl. A painter—he will not say which of us it was, of course—bought the bowl and the print along with it.
Woman : And the painter pulled me from the print with the sheer force of his imagination, I’m sure. Émile is a novelist and can hardly be trusted to give an accurate account. The reality of my conception is vastly more mundane, I assure you…though it does involve a courtesan.
Artist : A grain of truth makes for the best fiction. nude, but leave the jewelry and the shoes. I’ll paint you on the chaise. We’ll have three hours in the proper light, and I will pay you four francs.
Woman : Victorine gets five!
Artist : Victorine is a redhead.
Mariko : My name is Mariko, by the way, but everyone calls me Mari.
雪中的巴黎，木村的工作室，艺术家与观察者进行亲密对话和互动。
Artist : I’m on the chaise
Artist : Bring your left hip forward. No, not that far. Bend the leg a bit more, yes. Turn your head to face the canvas.
Artist : Like a Manet
Artist : Don’t like a model that talks while you work, huh?
Artist : I don’t like being compared to other artists.
Artist : Then you must paint me so well that I forget about the others.
Artist : Tilt your head into the light. And look at me intently. Intently. As though I were the one naked on the chaise.
Artist : You did better than I would have expected.
Artist : There are other poses I could show you, if you like?
Artist : But the sooner I get started on this portrait, the better.
木村的工作室，艺术家与观察者进行亲密对话和互动。木村以强烈而冷漠的拥抱回应，引发激情互动。事后艺术家入睡，留下叙述者感到不完整和渴望。
Kimura : I could show you other poses.
Kimura : Yes.
Artist : See you tomorrow?