Comments (4)
Emad discusses that here: https://old.reddit.com/r/StableDiffusion/comments/x9xqap/ama_emad_here_hello/inqj7dy/
They do prompt editing on the way in and post processing on the way out basically.
from dreambooth-stable-diffusion.
Using the same prompt between images isn't a good idea as they generate images in different ways so its not a like for like test regardless one of the forms of post processing we know mj does is clip guidance which SD doesn't do mj also has rich data from users and ratings and can use that to improve things even further Emad also mentioned in a Center Stage that also do "something else" but didnt say exactly what
In short stable diffusion is a raw unprocessed output whereas mj does alot of pre and post processing which is why you can have different results in this way
from dreambooth-stable-diffusion.
My theory (without much evidence) is that they built a pre-processor model that works on the embedding of the prompt. So rather than just appending "digital art, Greg Rutkowski" it takes the tensor of your prompt and tries to steer it towards prompt embeddings that got highly rated by their community.
In addition Emad did say they're using CLIP guidance and he probably knows. You could also have other guidance models alongside CLIP guiding composition and style, and that could achieve a lot.
If that's not what they're doing then this could be an interesting idea for someone else to try... 😅
from dreambooth-stable-diffusion.
Its just some well made custom embeddings, along with things like GFP to fix faces etc.
Its like a very well done google colab notebook, but you pay for it.
from dreambooth-stable-diffusion.
Related Issues (20)
- Interface changed for add_argparse_args() of lightning.Trainer HOT 1
- RuntimeError HOT 4
- AttributeError: module 'torch.linalg' has no attribute 'solve'
- Is there any method for loop t-step denoising to restore images and parallel speed up in stable diffusion?
- .
- This repo has many problem on windows
- cuda out of memory on RTX 24gb 3090 HOT 4
- ERROR: Failed building wheel for dlib
- Nothing Habben when Traning
- How to use DreamBooth for unconditional image synthesis.
- Questions about parameters
- ERROR: huggingface_hub.utils._validators.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name':
- Implementation of metrics in the Dreambooth paper HOT 1
- RuntimeError: Error(s) in loading state_dict for LatentDiffusion: size mismatch
- Unable to train Dreambooth on Mac M1
- Dreambooth training with image captions HOT 1
- Size of the trained checkpoint (ckpt) file HOT 1
- Support for inpainting training for dreambooth?
- TypeError: __init__() missing 1 required positional argument: 'personalization_config' HOT 2
- 支持多GPU训练吗 HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dreambooth-stable-diffusion.