Diffusers

A Unity package to run pretrained diffusion models with Unity Sentis

OpenUPM·Documentation (coming soon)·Feedback/Questions

About

This is essentially a port of Hugging Face’sdiffuserslibrary.

It is stillveryearly though, so as of today only a limited number of pipelines and schedulers are supported (see below).

Installation

via OpenUPM

InEdit -> Project Settings -> Package Manager,add a new scoped registry:

Name: Doji
URL: https://package.openupm
Scope(s): com.doji

In the Package Manager installcom.doji.diffuserseither by name or select it in the list underPackage Manager -> My Registries

Roadmap

Some things that might be worked on next are:

• add/fix classifier-free guidance
• support more models
  • SD 1.5
  • SD 2.1
  • SDXL
  • SD-Turbo
  • SDXL-Turbo
  • LoRA models
• more scheduler implementations
  • PNDM
  • DDIM
  • EulerDiscrete
  • EulerAncestralDiscrete
  • LCM
  • DDPM
  • KDPM2Discrete
  • KDPM2AncestralDiscrete
• more pipeline/model types
  • txt2img
  • img2img,
  • inpaint,
  • upscale,
  • depth2img
  • marigold
• async pipeline methods (sliced inference)
• support multiple images per prompt
• write some documentation

Dependencies

• com.doji.transformers
• com.doji.pngcs