Comfyui blip analyze image node example reddit. com/drfhd9/htc-1-hygrometer-calibration.
Comfyui blip analyze image node example reddit. 0. ComfyUI doesnt save runtime data, similar to ComfyUI doesn't actually saves the images it loads (with a LoadImage node) into Apr 4, 2023 · You signed in with another tab or window. The other day on the comfyui subreddit, I published my LoRA Captioning custom nodes, very useful to create captioning directly from ComfyUI. . But captions are just half of the process for LoRA training. - `max_new_tokens`: Set the maximum number of new With these custom nodes, combined with WD 14 Tagger (available from COmfyUI Manager), I just need a folder of images (in png format though, I still have to update these nodes to work with every image format), then I let WD make the captions, review them manually, and train right away. 5 denoise to fix the distortion (although obviously its going to change your image. It’s not really possible to avoid the load time of a model, you can just change when that load happens. 24 frames: 23. And above all, BE NICE. And it's ready for testing. you should read the document data in Github about those nodes and see what could do the same of what are you looking for. If you are going to use an LLM then give it examples of good prompts from civitai to emulate. But this sort of research is what makes ComfyUI so awesome. ) How to use. Extension: WAS Node Suite A node suite for ComfyUI with many new nodes, such as image processing, text processing, and more. But, the yyyy will need to be fairly technically accurate, and expect a few/many hours iterating with it. Open-sourced the nodes and example workflow in this Github repo and my colleague Polina made a video walkthrough to help explain how they work! Nodes include: LoadOpenAIModel. The workflow posted here relies heavily on useless third-party nodes from unknown extensions. MultiLatentComposite 1. Initial Input block - where sources are selected using a switch, also contains the empty latent node it also resizes images loaded to ensure they conform to the resolution settings. Hope this helps you guys as much as its helping me. You signed out in another tab or window. looking at efficiency nodes - simpleEval, its just a matter of time before someone starts writing turing complete programs in ComfyUI :-) The WAS suite is really amazing and indispensible IMO especially the text concatenation stuff for starters, and the wiki has other examples of photoshop like stuff. The video is not meant to display quaility or resolution, only the sync. r/StableDiffusion. DocumentPackand DocumentNode. In comfyui though, start going bellow 0. A nested node (requires nested nodes to load correclty) this creats a very basic image from a simple prompt and sends it as a source. r/comfyui. transpose(-1, -2)) This happens for both the annotate and the interrogate model/mode, just the tensor sizes are different in both cases. In this case he also uses the ModelSamplingDiscrete node from the WAS node suite, supposedly for chained loras, however in my tests that node made no difference whatsoever so it can be ignored as well. matmul(query_layer, key_layer. Features. Generate documentation for the selected pack (node) If you can code, yes. To disable/mute a node (or group of nodes) select them and press CTRL + m. WAS Node Suite - ComfyUI - WAS #0263. To load the associated flow of a generated image, simply load the image via the Load button in the menu, or drag and drop it into the ComfyUI window. I have ComfyUI & SD installed and a workflow using BLIP Loader/Caption from ComfyUI-Art-Venture (installed). • 1 yr. In IP-adapter the idea is to incorporate style from a source image. 2. There should be 2 outputs: IMAGE and MASK. So that node helped with managing that. I've put a few labels in the flow for clarity May 29, 2023 · 2. Hello, could you suggest which nodes or packages in Comfyui would be best for adjusting the resolution and size of an image after it has been loaded as input? Normally, I might use Photoshop or Gimp for this task, but I prefer to do it within Comfyui. Same workflow as the image I posted but with the first image being different. (Bug: Doesn't display image Image Seamless Texture: Create a seamless texture out of a image with optional tiling Image Select Channel: Select a single channel of an RGB image Image Select Color: Return the select image only on a black canvas Image Shadows and Highlights: Adjust the shadows and highlights of an image Image Size to Number: Get Welcome to the unofficial ComfyUI subreddit. com A few examples of my ComfyUI workflow to make very detailed 2K images of real people (cosplayers in my case) using LoRAs and with fast renders (10 minutes on a laptop RTX3060) : r/StableDiffusion. Input sources-. I use Ipadapter, masks, controlnet and my node. So in this workflow each of them will run on your input image and you Here is how it works: Gather the images for your LoRA database, in a single folder. Add clicked node to selection: Ctrl + C/Ctrl + V: Copy and paste selected nodes (without maintaining connections to outputs of unselected nodes) Ctrl + C/Ctrl + Shift + V: Copy and paste selected nodes (maintaining connections from outputs of unselected nodes to inputs of pasted nodes) Shift + Drag: Move multiple selected nodes at the same time Curious if anyone knows the most modern, best ComfyUI solutions for these problems? Detailing/Refiner: Keeping same resolution but re-rendering it with a neural network to get a sharper, clearer image. I was also impressed that your nodes automatically take the names of the connected node and use that as the on/off toggle. However, since prompting is pretty much the core skill required to work with any gen-ai tool, it’ll be worthwhile studying that in more detail than ComfyUI, at least to begin with. They do overlap. With Style Aligned, the idea is to create a batch of 2 or more images that are aligned stylistically. 25 to . Read the nodes installation information on github. Only the LCM Sampler extension is needed, as shown in this video. (or just copy requirements. So when it all executes, it runs the code in my node. This subreddit is just getting started so apologies for the generic look. ) Reply reply. Sort by: Add a Comment. Reply. Welcome to the unofficial ComfyUI subreddit. Add the CLIPTextEncodeBLIP node; Connect the node with an image and select a value for min_length and max_length; Optional: if you want to embed the BLIP text in a prompt, use the keyword BLIP_TEXT (e. I'm not very experienced with Comfyui so any ideas on how I can set up a robust workstation utilizing common tools like img2img, txt2img, refiner I seriously think your nodes look like the best way to do switching in ComfyUi, since you fully disable nodes instead of letting the unwanted paths still run a la "random node that outputs 0 or 1" method. In your video, you mention that noise increases prompt accuracy, which is interesting - but I feel we need to see more data before substantiating that claim. 20K subscribers in the comfyui community. From there you can use 4x upscale model and run sample again at low denoise if you want higher resolution. Cheers. Copy that folder’s path and write it down in the widget of the Load node. will output this resolution to the bus. Simple example I can think of is re-calculating Bounding Box/Mask dimensions to a square. com to make it easier for people to share and discover ComfyUI workflows. I've noticed that after adding the AnimateDiff node, it seems to generate lower quality images compared to the simpler img2img process. BLIP Model Loader: Load a BLIP model to input into the BLIP Analyze node; BLIP Analyze Image: Get a text caption from a image, or interrogate the image with a question. 5, don't need that many steps. Image Analysis - Welcome to the unofficial ComfyUI subreddit. Oct 21, 2023 · NODES: BLIP Analyze Image, BLIP Model Loader, Blend Latents, Bounded Image Blend, Bounded Image Blend with Mask, Bounded Image Crop, Bounded Image Crop with Mask, Bus Node, CLIP Input Switch, CLIP Vision Input Switch, CLIPSeg Batch Masking, CLIPSeg Masking, CLIPSeg Model Loader, CLIPTextEncode (BlenderNeko Advanced + NSP), CLIPTextEncode (NSP Welcome to the unofficial ComfyUI subreddit. This tool revolutionizes the process by allowing users to visualize the MultiLatentComposite node, granting an advanced level of control over image synthesis. A lot of people are just discovering this technology, and want to show off what they created. DivinoAG. some anime images using prompt expansion node for comfyui and bluepencilXL. Reload to refresh your session. Belittling their efforts will get you banned. Did you tried by readme? "You must mirror your original checkpoint subdirs (not the checkpoint files!) to ComfyUI\custom_nodes\ComfyUI_Primere_Nodes\front_end\images\checkpoints\ path but only the preview images needed, same name as the checkpoint but with . It compares a bit with IPAdapter or similar techniques. We learned that downloading other workflows and trying to run them often doesn't work because of missing custom nodes, unknown model files, etc. pth. To drag select multiple nodes, hold down CTRL and drag. The BBOX stuff is a very specific object from the Impact Pack. Please share your tips, tricks, and workflows for using this software to create your AI art. Load an OpenAI LLM and embedding model. txt into the python folder so you don't need the path). A node suite for ComfyUI with many new nodes, such as image processing, text processing, and more. See full list on github. Latest Version Download. All the chooser nodes are replaced by one - 'Preview Chooser'. I don't know why you don't want to use manager, if you install nodes with manager, a new folder is created in the custom_nodes folder, if something is messed up after installation, you sort folders by modification date and remove the last one you installed. It allows you to create customized workflows such as image post processing, or conversions. Whereas in A111 when you select the model in the UI, it’s loaded. I am taking in the image from another node using the "IMAGE" type. But more useful is that you can now right-click an image in the `Preview for Image Chooser` and select `Progress this image` - which is the same as selecting it's number and pressing go So from VAE Decode you need a "Uplscale Image (using model)" under loaders. 1. attach to it a "latent_image" in this case it's "upscale latent" Many of the workflow guides you will find related to ComfyUI will also have this metadata included. I'm not the creator of this software, just a fan. The Batch count is located under the Queue Prompt button if The "Attention Couple" node lets you apply a different prompt to different parts of the image by computing the cross-attentions for each prompt, which corresponds to an image segment. For fucking around I still prefer the more normal UI. Something that could replace both the Save Image and Preview Image nodes. Been playing around with ComfyUI and got really frustrated with trying to remember what base model a lora uses and its trigger words. Hello everyone, I have a question that I'd like to ask for your insights. Also, if this is new and exciting to you, feel free to post Connect the node with an image and select a value for min_length and max_length; Optional: if you want to embed the BLIP text in a prompt, use the keyword BLIP_TEXT (e. ImageTextOverlay is a customizable Node for ComfyUI that allows users to easily add text overlays to images within their ComfyUI projects. png", and then have to trim the last few characters off with a bulk renamer tool. Hi, I'm looking for input and suggestions on how I can improve my output image results using tips and tricks as well as various workflow setups. Model will download automatically from default URL, but you can point the download to another location/caption model in was_suite_config; Models will be stored in ComfyUI/models New Features: Anthropic API Support: Harness the power of Anthropic's advanced language models like Claude-3 (Opus, Sonnet, and Haiku) to generate high-quality prompts and image descriptions. Jumping from one thing to another takes reloading or re-doing everything. ComfyUI impact pack, Inspire Pack and other auxiliary packs have some nodes to control mask behaviour. Mask editor already works on the Save Image node. this creats a very basic image from Jul 23, 2023 · File "C:\AI-Generation\ComfyUI\custom_nodes\was-node-suite-comfyui\repos\BLIP\models\med. 5. I have the file (got it off Google), but the workflow doesn't see it: no drop down menu when I Welcome to the unofficial ComfyUI subreddit. You signed in with another tab or window. As you can see we can understand a number of things Krea is doing here: a) likely LCM to do near real time generation (we can do this in comfy) b) allow the use of MULTIPLE images as part of ONE output Warning. txt. Make sure the images are all in png. g. Allows you to choose the resolution of all output resolutions in the starter groups. Your problem is that the metadata LIWD reads from image file into your workflow is created during runtime and passed on to the CLIP encoder during runtime. jpg only extension. - Post-processing Node (optional): If the composited image requires any post-processing like color correction or blending adjustments, you can use a post-processing node. Best Comfyui Workflows, Ideas, and Nodes/Settings. Here's a quick example where the lines from the scribble actually overlap with the pose. true. Here's an example: Krea, you can see the useful ROTATE/DIMENSION tool on the dogo image i pasted. Set the mode to incremental_image and then set the Batch count of comfyui to the number of images in the batch. In researching InPainting using SDXL 1. Was having some issues with the GPU still filled up by half even after image generation is done. Upscaling: Increasing the resolution and sharpness at the same time. Paste in the code to the closet node you can find and tell it to change it from doing xxx to doing yyyy. Hi Reddit! In October, we launched https://comfyworkflows. I am curious both which nodes are the best for this, and which models. With these exciting updates, the ComfyUI IF AI Tools repository offers a comprehensive suite of tools to streamline your image generation workflow: IF Share and Run ComfyUI workflows in the cloud. Breakdown of workflow content. You can see it's a bit chaotic in this case but it works. . 35, tile overlay of 96 and something like 4x_foolhardy_Remacri as the upscaler and you get something of an amazing result. If I use ToPILImage from torchvision. The reason I haven't been fixing the problems with Image Chooser caused by the the latest Comfy update is that I've been working on a unified node that will be *much* more stable able easy to use - and which adds most of the most requested features. Copy that (clipspace) and paste it (clipspace) into the load image node directly above (assuming you want two subjects). Don't use the wrong tool for the wrong job. After adding the AnimateDiff node, lower quality blurry images will be generated. Business_Net_916. Add clicked node to selection: Ctrl + C/Ctrl + V: Copy and paste selected nodes (without maintaining connections to outputs of unselected nodes) Ctrl + C/Ctrl + Shift + V: Copy and paste selected nodes (maintaining connections from outputs of unselected nodes to inputs of pasted nodes) Shift + Drag: Move multiple selected nodes at the same time a was node for saving output + a concatenate text, ( like this, I just have one node "title" for the full project, and this creat a new root folder for any new project ) and I have a different name node, (so folder ) for every output I need to save, and to avoid spagetti, I use SET node and GET node. - Generate text with various control parameters: - `prompt`: Provide a starting prompt for the text generation. Dec 16, 2023 · First, confirm I have read the instruction carefully I have searched the existing issues I have updated the extension to the latest version What happened? Hello guys Thank you for this effort and wonderful work I am facing a big problem - Composite Node: Use a compositing node like "Blend," "Merge," or "Composite" to overlay the refined masked image of the person onto the new background. Input image for I'm trying to create a node that pulls the exif data from an image. I tried with masking nodes but the results weren't what I was expecting, for example the original masked image of the product was still processed and the text Ok, comparing the two images, they are certainly different, but not necessarily showing a quality improvement. So, still early but, I wrote a Python code that automatically sync the animation made with AnimatedDiff to any given audio. When the load checkpoint node is executed, the model is loaded. To duplicate parts of a workflow from one Welcome to the unofficial ComfyUI subreddit. 5 ~ x2 - no need for model, can be a cheap latent upscale. "a photo of BLIP_TEXT", medium shot, intricate details, highly detailed). Then another node under loaders> "load upscale model" node. Mar 18, 2024 · 2. ComfyUI is an advanced node based UI utilizing Stable Diffusion. You switched accounts on another tab or window. I've already incorporated two controlnets, but I'm I had no-metadata problem in the past but only with custom nodes. Apr 3, 2023 · sd upscale script an image with the same prompt and a denoise of . Fill in your prompts. py", line 178, in forward attention_scores = torch. This Node leverages Python Imaging Library (PIL) and PyTorch to dynamically render text on images, supporting a wide range of customization options including font size, alignment, color, and padding. Go to comfyui. 0 in ComfyUI I've come across three different methods that seem to be commonly used: Base Model with Latent Noise Mask, Base Model using InPaint VAE Encode and using the UNET "diffusion_pytorch" InPaint specific model from Hugging Face. will load images in two ways, 1 direct load from HDD, 2 load from a folder (picks next image when generated) Prediffusion -. The title explains it, I am repeating the same action over and over on a number of input images and I would like, instead of having to manually load each image and then pressing on the "queue prompt", to be able to select a folder and have Comfy process all input images in that folder. The BLIP Loader node references "model_base_capfilt_large. I would like to include those images into ComfyUI workflow and experiment with different backgrounds - mist - lightrays - abstract colorful stuff behind and before the product subject. Generally a workflow like this gives good results: Generate initial image at 512x768. This approach allows selective attention coupling at relevant layers without having to recompute the entire UNet multiple times for different prompts, leading to Some images changes a lot to the point the details barely visible got pushed but not the original structure. so I wrote a custom node that shows a Lora's trigger words, examples and what base model it uses. 6GB. The little grey dot on the upper left of the various nodes will minimize a node if clicked. My custom nodes felt a little lonely without the other half. There should be a (true/false) toggle to actually save the image. if you want to stack lora you have to keep adding nodes. Workflow Not Included. I think people more used to node based tools love it. Also ComfyUI's internal apis are like horrendous. So I created another one to train a LoRA model directly from ComfyUI! Welcome to the unofficial ComfyUI subreddit. - `max_new_tokens`: Set the maximum number of new Something like this. pth". No, the idea is different. First of all, there a 'heads up display' (top left) that lets you cancel the Image Choice without finding the node (plus it lets you know that you are paused!). \python. Otherwise, anything else works, really. I created this subreddit to separate discussions from Automatic1111 and Stable Diffusion discussions in general. Queue the flow and you should get a yellow image from the Image Blank. This will automatically parse the details and load all the relevant nodes, including their settings. Upscale x1. Sample again, denoise=0. exe -m pip install *installpath*\custom_nodes\ComfyUI-Stable-Video-Diffusion\requirements. Installation hints (comfyui portable) open terminal in python_embedded folder (warning this can break torch cuda) . Please keep posted images SFW. And sometime right before ultimate sd upscaling, it suddenly uses a ton of memory for a sec and then calms down, that node helped fixing that too. (This is by using one of the custom image save nodes - was-node-suite I think - and changing 'filename prefix' to an input so you can wire the batch load's filename to it. I have tried adding a "load image" node, converting the /r/StableDiffusion is back open after the protest of Reddit killing open API access, which will bankrupt app developers, hamper moderation, and exclude blind users from the site. Plug the image output of the Load node into the Tagger, and the other two outputs in the inputs of the Save node. The best I've managed is to get "OriginalFileName-###. 🌟 Features : - Seamlessly integrate the SuperPrompter node into your ComfyUI workflows. this creats a very basic image from a simple prompt and sends it as a source. Welcome to the Reddit home for ComfyUI a graph/node style UI for Stable Diffusion. Lets take a look at some original examples to illustrate what I mean with this (and that differs from normal upscaling, ControlNets at least to me): - Leaves texture changed to be 100% different preserving structure. you can see it doing each section of the image. For example. Reply More replies More replies More replies. BLIP Loader node (Art-Venture): where to put model_base_capfilt_large. Connect the Load Upscale model with the Upscale Image (using model) to VAE Decode, then from that image to your preview/save image. 4. Go into the mask editor for each of the two and paint in where you want your subjects. If you are just wanting to loop through a batch of images for nodes that don't take an array of images like clipSeg, I use Add Node -> WAS Suite -> IO -> Load Image Batch. I agree wholeheartedly. 5 denoise and your in for a glitchy image. A group that allows the user to perform a multitude of blends between image sources as well as add custom effects to images using a central control panel. So I basically plug in a thing, and the node has a text field where I can type my python. 1” custom node introduces a new dimension of control and precision to your image generation endeavors. Enjoy and keep it civil. the quick fix is put your following ksampler on above 0. You feed it an input image to use as a style image to affect your prompt. In trying to convert this to a Pillow Image it appears this type is a tensor. The “MultiLatentComposite 1. Yes, you will need to install the nodes that way if its not in the managers list, sometimes you get a new workflow and it will be a missing node so can install via the manager that way. This would reduce the number of noodles outputting from a VAE Decode when you're going to send the image on to Welcome to the unofficial ComfyUI subreddit. If you don’t want the distortion, decode the latent, upscale image by, then encode it for whatever you want to do next; the image upscale is pretty much the only distortion-“free” way to do it. ago. transforms it tells me it is a 4d array which isn't valid. " And: "Don't use large files because the modal loading time. To move multiple nodes at once, select them and hold down SHIFT before moving. This model is a T5 77M parameter (small and fast) custom trained on prompt expansion dataset. As a test, make the simplest blip analyze workflow you can and see if the error remains: (For anyone else wondering what those green tags are in my screenshot and in OP's workflow screenshot, we have Badge: Nickname turned on, which is a ComfyUI Manager feature, to ensure we know where a custom node came from. wdkxwxvgzeepaksdzgwm