语言: 韩语 标签:

• 韩语

https://github.com/BM-K/Sentence-Embedding-is-all-you-need

韩语句子嵌入

🍭 韩语句子嵌入资源库。您可以下载预训练模型并立即进行推理，同时还提供了个人训练模型的环境。

快速体验

import torch
from transformers import AutoModel, AutoTokenizer

def cal_score(a, b):
    if len(a.shape) == 1: a = a.unsqueeze(0)
    if len(b.shape) == 1: b = b.unsqueeze(0)

    a_norm = a / a.norm(dim=1)[:, None]
    b_norm = b / b.norm(dim=1)[:, None]
    return torch.mm(a_norm, b_norm.transpose(0, 1)) * 100

model = AutoModel.from_pretrained('BM-K/KoSimCSE-bert') 
AutoTokenizer.from_pretrained('BM-K/KoSimCSE-bert')

sentences = ['猎豹穿过田野追逐猎物。',
             '一只猎豹正在猎物后面奔跑。',
             '一只猴子在打鼓。']

inputs = tokenizer(sentences, padding=True, truncation=True, return_tensors="pt")
embeddings, _ = model(**inputs, return_dict=False)

score01 = cal_score(embeddings[0][0], embeddings[1][0])
score02 = cal_score(embeddings[0][0], embeddings[2][0])

性能

• 语义文本相似度测试集结果