Introduction
This repository hosts the SDXS-512-DreamShaper model for the React Native ExecuTorch library. SDXS-512-DreamShaper is a distilled, single-step latent diffusion text-to-image model. It is provided as a single multi-method .pte program per backend (XNNPACK, Core ML, MLX), ready for use in the ExecuTorch runtime.
Use it via the useTextToImage hook / models.textToImage.SDXS_512_DREAMSHAPER constant. If you'd like to run these models in your own ExecuTorch runtime, refer to the official documentation.
Compatibility
If you intend to use this model outside of React Native ExecuTorch, make sure your runtime is compatible with the ExecuTorch version used to export the .pte files. These models were exported for the v0.10.0 release; no forward compatibility is guaranteed. When using React Native ExecuTorch, the library constants guarantee compatibility with the runtime used behind the scenes.
Pipeline contract
Each backend's .pte exports three methods (see the per-backend config.json for exact shapes/dtypes):
encodeβ CLIP text token idsint64 [1, 77]β text embeddingsfloat32 [1, 77, 768].denoiseβ latentsfloat32 [1, 4, 64, 64], timestepint64 [1], embeddingsfloat32 [1, 77, 768]β predicted noisefloat32 [1, 4, 64, 64].decodeβ latentsfloat32 [1, 4, 64, 64]β imagefloat32 [1, 3, 512, 512]in[0, 1].
The single-step scheduler (linear in the latents and the predicted noise) and CLIP tokenization run on the client.
Repository structure
xnnpack/,coreml/,mlx/β one multi-method.pteper backend plus aconfig.jsondeclaring its variants and method contract.tokenizer.json,tokenizer_config.jsonβ the CLIP tokenizer, in the repository root.config.jsonβ top-level model descriptor.
- Downloads last month
- 21