base_model:

• mistralai/Mistral-7B-Instruct-v0.2 library_name: transformers license: mit pipeline_tag: video-text-to-text

VideoChat2-TPO模型

本模型基于论文《任务偏好优化：通过视觉任务对齐改进多模态大语言模型》研发。

� 安装指南

pip install -r requirements.txt
python app.py

⚙️ 使用说明

from transformers import AutoModel, AutoTokenizer
from tokenizer import MultimodalLlamaTokenizer

model_path = "OpenGVLab/VideoChat-TPO"
tokenizer =  AutoTokenizer.from_pretrained(model_path,
trust_remote_code=True,
use_fast=False,)
model = AutoModel.from_pretrained(model_path,  trust_remote_code=True, _tokenizer=self.tokenizer).eval()