How to use vvtq/model with Diffusers:
pip install -U diffusers transformers accelerate
from diffusers import ControlNetModel, StableDiffusionControlNetPipeline controlnet = ControlNetModel.from_pretrained("vvtq/model") pipe = StableDiffusionControlNetPipeline.from_pretrained( "stabilityai/stable-diffusion-2-1-base", controlnet=controlnet )
These are controlnet weights trained on stabilityai/stable-diffusion-2-1-base with new type of conditioning.
Base model
