微件:

• 文本: "你真是个白痴!!"

NER毒性模型

基于toxic_dataset_ner数据集对cointegrated/rubert-tiny-toxicity模型进行微调

语言: 俄语

!pip install transformers > /dev/null

from transformers import (
    AutoModelForTokenClassification, 
    AutoTokenizer, 
    pipeline
)

model = AutoModelForTokenClassification.from_pretrained('tesemnikov-av/rubert-ner-toxicity')
tokenizer = AutoTokenizer.from_pretrained('tesemnikov-av/rubert-ner-toxicity')


pipe = pipeline(model=model, tokenizer=tokenizer, task='ner', aggregation_strategy='average')
text = "他们全都是些该死的白痴!!"

print(text)
print(pipe(text))