BERTOverflow

模型描述

我们在StackOverflow十年存档中的1.52亿个句子上对BERT-base模型进行了预训练。该模型的更多细节可以在我们的ACL 2020论文中找到：StackOverflow中的代码和命名实体识别。我们要感谢吴伟兰帮助我们训练这个模型。

使用方法

from transformers import *
import torch

tokenizer = AutoTokenizer.from_pretrained("jeniya/BERTOverflow")
model = AutoModelForTokenClassification.from_pretrained("jeniya/BERTOverflow")

BibTeX条目和引用信息

@inproceedings{tabassum2020code,
    title={Code and Named Entity Recognition in StackOverflow},
    author={Tabassum, Jeniya  and Maddela, Mounica  and Xu, Wei and Ritter, Alan },
    booktitle = {Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL)},
    url={https://www.aclweb.org/anthology/2020.acl-main.443/}
    year = {2020},
}