Flux release today to the public their Flux Kontext model which is designed to replace many different tools we’ve used like Inpainting, outpainting, controlnet, LoRA and its newest yet most powerful feature in context image editing with simple text prompts. No need for masks or segmentation, just ask the model to make the changes and most of the time it does just that.
Character consistency which had been an challenge with many models is no longer an issue.
Flux Kontext can generate consistently the provided subject in varying styles, environments and orientations. This means that we can now almost flawlessly create new images of our subject to build our clean and varied dataset.
In order to do this you first need to spend sometime figuring out how flux kontext actually alters and recreates a supplied image. Once you have this figured you can think of multiple prompts that will generate the person (man/woman) with the same consistent face again and again but in different clothes, expressions and posed angles. I have made some progress on this so this should give you a heads up in getting started.
Setup your ComfyUI Environment
Always make sure your ComfyUI is up to date, this is important when wanting to try newly released models or nodes. Next you need to download the model from the ComfyUI site.
- Distilled Kontext Model (flux1-dev-kontext_fp8_scaled.safetensors) for low VRAM GPU (12gb) or get the full model flux1-kontext-dev.safetensors (24gb), place these in the folder
ComfyUI/models/diffusion_models/ - Clip and VAE are the same as Flux Dev so no need to download them again.
If you want to run the 24GB model then you want to use RTX5090 with 32 GB VRAM, I can get cheap access to this GPU for less than $1 per hour at RunPod. Now if ComfyUI is running, make sure you restart it. Default workflow is embedded in this PNG file. You can upload it directly into ComfyUI or if you want to extract the JSON file try our new ComfyUI Workflow Extractor.
Generating LoRA Dataset
Once its all setup and ready you can get started with the generation. I have provided my prompts that I used for the below samples which you can download for free.
Here we have a sample image that we may want to use to generate the rest of the dataset for LoRA training.
Next you can install my Custom Nodes that are provided in my workflow (download below). Or search ComfyUI Manager for “WWAA Custom Nodes”.
Flux Kontext Dev LoRa Dataset Creation (295 downloads )
My prompt file contains 50 different variations (male and female version) that will help you generate the different sample but you can run it as much as you need to generate the sample image. Result is that we have below sample images that are generated with the consistent face however in different poses, clothes and backgrounds.
Resulting images can then be used in FluxGym or Ai Toolkit to train a Flux LoRA or SDXL LoRA. I have many posts and videos on this topic so it can certainly help you further in LoRA training.
Thanks for stopping buy hope you found this useful. Let me know if you have any questions or comments.
You can also checkout my video where I walk you through this process using RunPod.
You may also like:
If you'd like to support our site please consider buying us a Ko-fi, grab a product or subscribe. Need a faster GPU, get access to fastest GPUs for less than $1 per hour with RunPod.io