I’m very happy to share my LoRA Caption workflow for ComfyUI that will let you run a batch of images through two different captioning methods using Florence 2 model or using Clip Interrogator. Both these are paired with WD14 Tagger node which generates some additional tags/keywords for the caption.
Images must be PNG format, JPEGs are not supported currently in the workflow due to custom node.
You can enter the LoRA training “trigger” word which is added to the prompt.
Download Workflow
WWAA-LoRA-Caption-Workflow-v1.zip
12578 downloads
Useful tips
- Caption files generated cannot be overwritten – this a limitation of the custom node, if you want to re-run delete the original TXT file
- Once all images are run through you need to Reset the counter. Use the Reset counter (use once) switch – set to true. Remember to turn if off – set to false.
- List index out of range error – this means you are trying to run it but the txt file caption already exists. Or the counter has reached its limit, you need to reset it.
- I always recommend that you review the captions and finetune them to ensure you get the best result out of your LoRA.
If you'd like to support our site please consider buying us a Ko-fi, grab a product or subscribe. Need a faster GPU, get access to fastest GPUs for less than $1 per hour with RunPod.io
how do i reset the counter. keep getting List index out of range error
There’s a node in which you supposedly need to set it to “true”. But for me that does not work anyway.
A bit late but I just found this. If you do as in the video, Reset Counter – True. Then rename the folder in the directory path (IE: add a 1) then click start. Get the error, remove the added 1 and your ready to go. Probably an easier way but that works. I just found this worfklow and tried it. Havent had a chance to play around and find another way. This workflow is useful. Thank you. I had a florence2 workflow I had made myself but this one is better than the one I made.
glad you found it useful. Checkout our custom Nodes as well which are simplifying such processes.
Hi. I am having an error message. Comfyui is missing the clip_interrogator node and it is not appearing in the missing custom nodes menu. How can I install it?
Thanks!
fixed in latest version of the workflow