许可证: MIT
标签:

• 物体插入
  任务类型: 图像到图像

这是EraseDraw的模型权重文件。

使用此模型前，请先安装最新版diffusers。其API与InstructPix2Pix完全兼容

pip install diffusers accelerate safetensors transformers

import PIL  
import requests  
import torch  
from diffusers import StableDiffusionInstructPix2PixPipeline, EulerAncestralDiscreteScheduler  

model_id = "alpercanberk/erasedraw"  
pipe = StableDiffusionInstructPix2PixPipeline.from_pretrained(model_id, torch_dtype=torch.float16, safety_checker=None)  
pipe.to("cuda")  
pipe.scheduler = EulerAncestralDiscreteScheduler.from_config(pipe.scheduler.config)  

url = "https://raw.githubusercontent.com/timothybrooks/instruct-pix2pix/main/imgs/example.jpg"  
def download_image(url):  
    image = PIL.Image.open(requests.get(url, stream=True).raw)  
    image = PIL.ImageOps.exif_transpose(image)  
    image = image.convert("RGB")  
    return image  
image = download_image(url)  

prompt = "添加太阳镜"  
images = pipe(prompt, image=image, num_inference_steps=10, image_guidance_scale=1).images  
images[0]  

代码与数据集即将发布至GitHub（链接见官网）。