10.15 XY Plot
10.15 XY Plot
10.15 XY Plot
An XY plot in ComfyUI is a grid of generated images that lets you compare how changing two settings affects the results.
The assignment includes the following:
1) Import any of the above images into ComfyUI to get the workflow. Test it with different parameters, different prompts and different sampler settings and checkpoints. Become familiar with the interface. When testing, aim for innovation in results.
2) Shaw has prepared a number of workflows. They are located in the left menu in "Templates". Select XY Plot comparisons. Test them with your own text prompts, image prompts and paramaters.
3) If you feel up to it, ask Chatgpt to write a diffrent XYplot that compares something else like the scheduler or chckpoints or sampler name, or denoise, or ....Send me the workflow in case it works, and ask Shaw in case it does not work how to make it work. Also let me know which settings you will want to compare so that we can have a range of different comparisons in the class.
Post and describe your results.
--------------
Today (Oct 12, 2026) I added three more examples:
In this version, you can choose any 3 random seed as you wish. I used 5, 9345, and 20. Doing XY plot is like a "throwing a wide net", a fishing metaphor. You dont know what you are going to get but once you get something of interest you can then go back and use related values.
In this series I am comparing denoise 0.7 to 0.9. 0.7 is stays quite close to the original image, in 0.9 the text description dominates, so I will also try denoise 0.8. The processing takes a very lng time for this workflow (300 sec) and it produces very large files which I cannot import into the student forum so I did some screen shots (They dont have the workflow in them !!)
denoise 0.8:
An XY plot in ComfyUI is a grid of generated images that lets you compare how changing two settings affects the results.
The assignment includes the following:
1) Import any of the above images into ComfyUI to get the workflow. Test it with different parameters, different prompts and different sampler settings and checkpoints. Become familiar with the interface. When testing, aim for innovation in results.
2) Shaw has prepared a number of workflows. They are located in the left menu in "Templates". Select XY Plot comparisons. Test them with your own text prompts, image prompts and paramaters.
3) If you feel up to it, ask Chatgpt to write a diffrent XYplot that compares something else like the scheduler or chckpoints or sampler name, or denoise, or ....Send me the workflow in case it works, and ask Shaw in case it does not work how to make it work. Also let me know which settings you will want to compare so that we can have a range of different comparisons in the class.
Post and describe your results.
--------------
Today (Oct 12, 2026) I added three more examples:
In this version, you can choose any 3 random seed as you wish. I used 5, 9345, and 20. Doing XY plot is like a "throwing a wide net", a fishing metaphor. You dont know what you are going to get but once you get something of interest you can then go back and use related values.
In this series I am comparing denoise 0.7 to 0.9. 0.7 is stays quite close to the original image, in 0.9 the text description dominates, so I will also try denoise 0.8. The processing takes a very lng time for this workflow (300 sec) and it produces very large files which I cannot import into the student forum so I did some screen shots (They dont have the workflow in them !!)
denoise 0.8:
George Legrady
legrady@mat.ucsb.edu
legrady@mat.ucsb.edu
Re: 10.15 XY Plot
For this assignment I kept going with my question from last week, whether a machine can make a mistake on purpose. Last time I mostly changed the prompt, but the XY plot let me change one setting at a time and compare the results side by side. That made it easier to see exactly where the "mistakes" come from: the prompt, the settings, or the input image.
Seed × CFG grid
Prompt: interestingness shape rock, celestial
Settings: sd_xl_base_1.0, seeds 42–45, CFG 3/6/9, steps 20, euler, normal
I started with the classes' seed × CFG plot to get used to how it works. The seed decided everything about the image. Each column kept the same rock and the same camera angle at every CFG value, so seed 42 was always a flat stone sitting in a rock bed, seed 43 was always a tall balanced rock in a desert, and seed 45 was always a single boulder floating over a gray floor. CFG mostly changed how dramatic it looked and how literally it took the word "celestial." At 3 the lighting was flat, the backgrounds were plain, and "celestial" barely showed up. By 6 and 9 the contrast went up, the shadows got darker, and "celestial" turned into the more obvious celestial rock with starry skies and the Milky Way behind every rock.
Seed × CFG grid
Prompt: interestingness geometric shape, celestial shape, photograph scene with picture frame look
Settings: sd_xl_base_1.0, consecutive seeds 761575561803253–56, CFG 3/6/9
Next I changed the prompt to see if the same pattern held, and it did. Each seed was its own design: a folded paper star, a paper mountain range inside an arch, a triangle inside a circle, and a framed poster on a shelf. At CFG 3 the designs were looser and more experimental, especially the star in the first column. By CFG 9 the same designs had become cleaner and more symmetrical, and "celestial" showed up the same way as with the rocks, as starry night skies and planets inside the frames. I also used consecutive seed numbers on purpose, and they still gave completely different images, so seeds that are "close" as numbers aren't close visually at all.
Steps × Sampler grid
Prompt: a pencil drawing of a house with mistakes, shaky lines, crooked walls, a wall scribbled out and redrawn, eraser smudges, drawn quickly by hand
Negative: blur, text, watermark, polished, digital art
Settings: sd_xl_base_1.0, seed 42, CFG 4.5, scheduler normal, steps 4/16/28/40, samplers euler/dpmpp_2m/heun
For my own plot I had Claude write one comparing steps against sampler, with the seed fixed so only those two things change. I used the house prompt from last week, since it asks for mistakes. At 4 steps the samplers looked nothing alike: euler gave a soft, smudged sketch, dpmpp_2m gave the same house covered in colored noise, and heun broke down into green and yellow speckles that barely look like a house. From 16 steps on, all three settled on almost the same detailed drawing. By 40 steps dpmpp_2m and heun are almost identical.
Even though I asked for shaky lines and scribbles, none of them showed up once the image was finished. Every extra step made the drawing more careful, not less. The only "mistakes" in the grid are the 4-step images, and those come from the machine running out of steps, not from my prompt.
Steps × Sampler grid
Prompt: interestingness rock, celestial shape
Settings: same as the house grid
I ran the same steps × sampler plot with a rock prompt to check that the house wasn't a one-off. It showed the same thing. At 4 steps euler was a blur, dpmpp_2m was grainy, and heun was random color. By 16 steps they all agreed on the same flat stone surrounded by rocks. It's almost the same composition as seed 42 in the first grid, even though the prompt is worded a little differently, which shows how much the seed decides the layout. There was one small difference: dpmpp_2m and heun carved ripple rings into the middle of the rock that euler never did.
After that I wanted to see what happens when the model starts from an image instead of from noise, so I tried img2img with a seed × scheduler plot on three different input images.
Input 1 (orange circuit image)
The first input was this orange abstract image of glowing circuit-like rings, with one bright flare on the left.
Seed × Scheduler grid from Input 1
The model kept the warm color and the bright spot, but everything else changed. The rings turned into deep red shapes, and in the first and third columns they became eye sockets and part of a face. There was no face in the original, so the model found one in an abstract pattern because a face is something familiar. The three scheduler rows look almost exactly the same.
Input 2 (magenta lens image)
The second input was the magenta lens image from my first assignment, which already looked strange and hard to read.
Seed × Scheduler grid from Input 2 (magenta)
The magenta color and the dark background were kept, but the lens became smooth blobs. In the third column eyes showed up again, this time in a face made of a fur-like texture. Again, the scheduler rows are almost identical, and only the seed changed what came out.
Input 3 (landscape painting)
The third input was a muted landscape painting of gray cliffs, orange trees and a small waterfall.
Seed × Scheduler grid from Input 3
This one changed the most. The painting came back as three bright postcard landscapes: a blue lake with clouds, a forest, and a sunny meadow with a stream and flowers. Almost nothing of the original was kept except that they are all landscapes. The only place the scheduler made a visible difference was the exponential row in the first column, where the lake and its islands changed shape a little.
Reflection
Overall, the seed did a lot to decide what the image was, and most other settings only decide how polished it looks. Schedulers barely mattered in any of my tests, and samplers only mattered when the image was cut short at a low step count. Higher CFG didn't make the image more accurate, just more similar to things that are known, and it turned words like "celestial" into their most standard version like a starry sky.
The most interesting images in the set were the unfinished 4-step ones, where every sampler took its own approach. That fits the interestingness prompt. They have some structure you can tell but can't fully figure out, while the 40-step versions are so resolved there's nothing left to discover. The img2img results were interesting for a different reason, because they show what the model expects to see. Abstract shapes turned into faces, and the painting turned into a postcard.
For my research question, few of the settings got the model to make the human mistakes I asked for. The house got cleaner with every step, and img2img turned anything unusual into something more familiar. The only imperfections came from the model itself, not from the prompt. Given enough steps, the model was able to fix these smaller errors.
Seed × CFG grid
Prompt: interestingness shape rock, celestial
Settings: sd_xl_base_1.0, seeds 42–45, CFG 3/6/9, steps 20, euler, normal
I started with the classes' seed × CFG plot to get used to how it works. The seed decided everything about the image. Each column kept the same rock and the same camera angle at every CFG value, so seed 42 was always a flat stone sitting in a rock bed, seed 43 was always a tall balanced rock in a desert, and seed 45 was always a single boulder floating over a gray floor. CFG mostly changed how dramatic it looked and how literally it took the word "celestial." At 3 the lighting was flat, the backgrounds were plain, and "celestial" barely showed up. By 6 and 9 the contrast went up, the shadows got darker, and "celestial" turned into the more obvious celestial rock with starry skies and the Milky Way behind every rock.
Seed × CFG grid
Prompt: interestingness geometric shape, celestial shape, photograph scene with picture frame look
Settings: sd_xl_base_1.0, consecutive seeds 761575561803253–56, CFG 3/6/9
Next I changed the prompt to see if the same pattern held, and it did. Each seed was its own design: a folded paper star, a paper mountain range inside an arch, a triangle inside a circle, and a framed poster on a shelf. At CFG 3 the designs were looser and more experimental, especially the star in the first column. By CFG 9 the same designs had become cleaner and more symmetrical, and "celestial" showed up the same way as with the rocks, as starry night skies and planets inside the frames. I also used consecutive seed numbers on purpose, and they still gave completely different images, so seeds that are "close" as numbers aren't close visually at all.
Steps × Sampler grid
Prompt: a pencil drawing of a house with mistakes, shaky lines, crooked walls, a wall scribbled out and redrawn, eraser smudges, drawn quickly by hand
Negative: blur, text, watermark, polished, digital art
Settings: sd_xl_base_1.0, seed 42, CFG 4.5, scheduler normal, steps 4/16/28/40, samplers euler/dpmpp_2m/heun
For my own plot I had Claude write one comparing steps against sampler, with the seed fixed so only those two things change. I used the house prompt from last week, since it asks for mistakes. At 4 steps the samplers looked nothing alike: euler gave a soft, smudged sketch, dpmpp_2m gave the same house covered in colored noise, and heun broke down into green and yellow speckles that barely look like a house. From 16 steps on, all three settled on almost the same detailed drawing. By 40 steps dpmpp_2m and heun are almost identical.
Even though I asked for shaky lines and scribbles, none of them showed up once the image was finished. Every extra step made the drawing more careful, not less. The only "mistakes" in the grid are the 4-step images, and those come from the machine running out of steps, not from my prompt.
Steps × Sampler grid
Prompt: interestingness rock, celestial shape
Settings: same as the house grid
I ran the same steps × sampler plot with a rock prompt to check that the house wasn't a one-off. It showed the same thing. At 4 steps euler was a blur, dpmpp_2m was grainy, and heun was random color. By 16 steps they all agreed on the same flat stone surrounded by rocks. It's almost the same composition as seed 42 in the first grid, even though the prompt is worded a little differently, which shows how much the seed decides the layout. There was one small difference: dpmpp_2m and heun carved ripple rings into the middle of the rock that euler never did.
After that I wanted to see what happens when the model starts from an image instead of from noise, so I tried img2img with a seed × scheduler plot on three different input images.
Input 1 (orange circuit image)
The first input was this orange abstract image of glowing circuit-like rings, with one bright flare on the left.
Seed × Scheduler grid from Input 1
The model kept the warm color and the bright spot, but everything else changed. The rings turned into deep red shapes, and in the first and third columns they became eye sockets and part of a face. There was no face in the original, so the model found one in an abstract pattern because a face is something familiar. The three scheduler rows look almost exactly the same.
Input 2 (magenta lens image)
The second input was the magenta lens image from my first assignment, which already looked strange and hard to read.
Seed × Scheduler grid from Input 2 (magenta)
The magenta color and the dark background were kept, but the lens became smooth blobs. In the third column eyes showed up again, this time in a face made of a fur-like texture. Again, the scheduler rows are almost identical, and only the seed changed what came out.
Input 3 (landscape painting)
The third input was a muted landscape painting of gray cliffs, orange trees and a small waterfall.
Seed × Scheduler grid from Input 3
This one changed the most. The painting came back as three bright postcard landscapes: a blue lake with clouds, a forest, and a sunny meadow with a stream and flowers. Almost nothing of the original was kept except that they are all landscapes. The only place the scheduler made a visible difference was the exponential row in the first column, where the lake and its islands changed shape a little.
Reflection
Overall, the seed did a lot to decide what the image was, and most other settings only decide how polished it looks. Schedulers barely mattered in any of my tests, and samplers only mattered when the image was cut short at a low step count. Higher CFG didn't make the image more accurate, just more similar to things that are known, and it turned words like "celestial" into their most standard version like a starry sky.
The most interesting images in the set were the unfinished 4-step ones, where every sampler took its own approach. That fits the interestingness prompt. They have some structure you can tell but can't fully figure out, while the 40-step versions are so resolved there's nothing left to discover. The img2img results were interesting for a different reason, because they show what the model expects to see. Abstract shapes turned into faces, and the painting turned into a postcard.
For my research question, few of the settings got the model to make the human mistakes I asked for. The house got cleaner with every step, and img2img turned anything unusual into something more familiar. The only imperfections came from the model itself, not from the prompt. Given enough steps, the model was able to fix these smaller errors.
Re: 10.15 XY Plot
1. Seed × CFG
Prompt: a jellyfish made of glass floating through a library, soft light
CFG 3, 5, 7, 9 / 3 seeds / euler, normal Each seed gave a different library and jellyfish. CFG didn’t change the layout, just how strong everything looked. At 3 it’s hazy and the shelves are soft, at 9 the colors are much heavier and the tentacles get thicker. The “glass” part changed too. In row 2 the jellyfish is almost a clear glass dome at low CFG and turns pink at high CFG. In row 3 a glass shell shows up around it at CFG 9.
2. Seed × CFG
Prompt: a whale swimming above a desert at sunset, surreal, cinematic
Same settings Row 2 was the surprise. The model read “swimming” literally and put the whale inside the dunes, not above them. At CFG 3 the whale is faded and looks more like a dolphin. Higher CFG adds more stuff to the scene: cacti, bushes, and in row 1 the sun only appears at CFG 9. For both prompts CFG 5 to 7 looked best to me.
3. Sampler × Scheduler (my own)
Same jellyfish prompt, seed fixed at 944650762137903, CFG 7
Samplers: euler, dpmpp_2m, ddim / Schedulers: normal, karras With the seed fixed the composition stays the same, so only details change. Karras makes the bell flatter and the tentacles more spread out. dpmpp_2m has the brightest glow in the center. Euler and ddim look almost identical. These changes are much smaller than seed or CFG, so I’d use them for fine-tuning after picking a seed I like.
Prompt: a jellyfish made of glass floating through a library, soft light
CFG 3, 5, 7, 9 / 3 seeds / euler, normal Each seed gave a different library and jellyfish. CFG didn’t change the layout, just how strong everything looked. At 3 it’s hazy and the shelves are soft, at 9 the colors are much heavier and the tentacles get thicker. The “glass” part changed too. In row 2 the jellyfish is almost a clear glass dome at low CFG and turns pink at high CFG. In row 3 a glass shell shows up around it at CFG 9.
2. Seed × CFG
Prompt: a whale swimming above a desert at sunset, surreal, cinematic
Same settings Row 2 was the surprise. The model read “swimming” literally and put the whale inside the dunes, not above them. At CFG 3 the whale is faded and looks more like a dolphin. Higher CFG adds more stuff to the scene: cacti, bushes, and in row 1 the sun only appears at CFG 9. For both prompts CFG 5 to 7 looked best to me.
3. Sampler × Scheduler (my own)
Same jellyfish prompt, seed fixed at 944650762137903, CFG 7
Samplers: euler, dpmpp_2m, ddim / Schedulers: normal, karras With the seed fixed the composition stays the same, so only details change. Karras makes the bell flatter and the tentacles more spread out. dpmpp_2m has the brightest glow in the center. Euler and ddim look almost identical. These changes are much smaller than seed or CFG, so I’d use them for fine-tuning after picking a seed I like.
Re: 10.15 XY Plot
My starting images were a photograph of my own refrigerator and an AI generated, photographic style close up of a halved orange. I chose these images because their recognizable structures could also suggest other forms: refrigerator shelves could become occupied floors, while orange segments could become mechanical chambers.
In response to last week’s feedback, I focused on transformations that retained traces of the original objects while introducing unfamiliar spatial or material relationships. I used XY Plot comparisons to investigate denoise strength, CFG, sampling methods, and checkpoints.
Experiment 1: Transforming a Refrigerator into an Architectural Space
Original Image
Research question: How do denoise strength and CFG affect the transformation of a familiar household scene into an imagined architectural space?
My starting image was a photograph of my own refrigerator. I chose it because its shelves, containers, and enclosed interior provided recognizable structures that could be reinterpreted as floors, rooms, and circulation spaces.
I conducted three attempts, moving from a broad denoise range to a narrower comparison. Each generation started from the original photograph. I kept the model, seed, sampler, scheduler, and steps setting unchanged. After the first attempt, I revised the positive prompt and used that revised version for Attempts 2 and 3.
The basic workflow was:
Load Image + Load Checkpoint + two CLIP Text Encode (Prompt) nodes → VAE Encode and KSampler (Efficient), controlled by XY Input: Denoise + XY Input: CFG Scale → XY Plot → saved through KSampler’s IMAGE output → Save Image.
Data Information:
Model: sd_xl_base_1.0.safetensors
Seed: 12345
Control after Generate: fixed
Steps setting: 20
Sampler: dpm_adaptive
Scheduler: normal
Input image size: 1264 × 1670
X-axis: Denoise
The CFG and denoise values were supplied by the XY input nodes, overriding the values displayed directly in KSampler.
Attempt 1: Broad Exploration
Denoise: 0.35 / 0.60 / 0.85
CFG: 3.0 / 5.0 / 7.0
Y-axis: CFG
VAE decode: true
XY Plot output: Plot
Positive prompt:
“Photograph of a towering inhabited atrium. Three stacked floors connected by narrow staircases, walkways with railings, doorways opening into deep rooms. Two small people stand on separate levels. Walls made of translucent ribbed plastic, crumpled silver foil partitions, pale ceramic surfaces, cold overhead lighting. Frontal view, realistic materials, strong spatial depth.”
Negative prompt:
“blur,text,cartoon,watercolor”
Observations
0.35 and 0.60 — The refrigerator remains recognizable.
The results stayed close to the source photograph. Changes mainly affected packaging, containers, and local surface details.
0.85 — Reorganized storage.
The arrangement became more compartmentalized, with additional containers and divisions. However, the image still read as refrigerator storage rather than an inhabited architectural space.
The initial prompt did not produce the intended change of scale. I revised it to describe an atrium, staircases, and people more directly.
Attempt 2: Narrowing the Range
Denoise: 0.45 / 0.55 / 0.65
CFG: 3.0 / 5.0 / 7.0
Positive prompt:
“Photograph of a towering inhabited atrium. Three stacked floors connected by narrow staircases, walkways with railings, doorways opening into deep rooms. Two small people stand on separate levels. Walls made of translucent ribbed plastic, crumpled silver foil partitions, pale ceramic surfaces, cold overhead lighting. Frontal view, realistic materials, strong spatial depth.”
Negative prompt:
“blur,text,cartoon,watercolor”
Observations
0.45 — Household scale.
Food packages and containers remained identifiable, and the scene still appeared primarily as a refrigerator.
0.55 — Coexisting spatial interpretations.
Figures, staircases, and occupied floors appeared within the original framework. The refrigerator border and traces of packaging remained, producing an ambiguous relationship between a small storage space and a large interior.
0.65 — More developed architecture.
The architectural organization became clearer, while individual food objects became less recognizable. The original shelves continued to influence the arrangement of floors.
Since both the prompt and the denoise range changed after Attempt 1, I treated this as a new exploratory stage rather than attributing the difference to denoise alone.
Attempt 3: Examining the Transition
Denoise: 0.48 / 0.51 / 0.54
CFG: 3.0 / 5.0 / 7.0
Positive prompt:
“Photograph of a towering inhabited atrium. Three stacked floors connected by narrow staircases, walkways with railings, doorways opening into deep rooms. Two small people stand on separate levels. Walls made of translucent ribbed plastic, crumpled silver foil partitions, pale ceramic surfaces, cold overhead lighting. Frontal view, realistic materials, strong spatial depth.”
Negative prompt:
“blur,text,cartoon,watercolor”
Observations
0.48 — CFG influences the transition.
At CFG 3, the image remained close to a refrigerator. At CFG 5 and 7, architectural features appeared. This comparison showed that the transition depended on the combination of denoise and CFG.
0.51 — A container becomes a staircase.
The round food container developed into a circular structure with stairs. Its shape still recalled the original object, while the steps and small figures suggested an occupiable space.
0.54 — Continued architectural interpretation.
The results remained close to those at 0.51, with changes in figures, surfaces, and local structural details. Increasing denoise within this interval did not produce an entirely new composition.
Reflection
The most interesting result was the transformation of a food container into a circular staircase at denoise 0.51 and CFG 5. It preserved a visible relationship to the source photograph while changing the object’s apparent scale and function.
The three attempts helped me move from general variation toward a specific visual question: when does a familiar object begin to support a different interpretation? Denoise and CFG jointly affected this transition, while the prompt revision changed the direction of the experiment.
These findings are limited to this input photograph, model, workflow, and fixed seed. I did not test whether the same transitions would persist across other seeds.
Experiment 2: Comparing Samplers and Sampling Steps
Research question: How do different samplers and step settings affect image clarity and the preservation of the refrigerator’s transformation into an architectural space?
I used the same original refrigerator photograph and the revised atrium prompt from Experiment 1. I chose denoise 0.51 and CFG 5 because this combination produced a circular staircase that still resembled the original food container.
I compared three samplers at three step settings in a single nine-image XY Plot. The input image, positive and negative prompts, model, seed, scheduler, denoise, and CFG remained constant.
The basic workflow was:
Load Image + Load Checkpoint + two CLIP Text Encode (Prompt) nodes → VAE Encode and KSampler (Efficient), with XY Input: Sampler/Scheduler + XY Input: Steps → XY Plot feeding the sampler’s script input → KSampler’s IMAGE output → Save Image.
Data Information
Model: sd_xl_base_1.0.safetensors
Seed: 12345
Control after Generate: fixed
CFG: 5.0
Denoise: 0.51
Scheduler: normal
Input image size: 1264 × 1670
X-axis: Sampler — euler / dpmpp_2m / dpmpp_2m_sde
Y-axis: Steps — 20 / 30 / 40
VAE decode: true
XY Plot output: Plot
The sampler and steps values were supplied by the XY input nodes, overriding the corresponding settings displayed directly in KSampler.
Positive prompt
“Photograph of a towering inhabited atrium. Three stacked floors connected by narrow staircases, walkways with railings, doorways opening into deep rooms. Two small people stand on separate levels. Walls made of translucent ribbed plastic, crumpled silver foil partitions, pale ceramic surfaces, cold overhead lighting. Frontal view, realistic materials, strong spatial depth.”
Negative prompt
“blur,text,cartoon,watercolor”
Observations
Euler — Stable composition across step settings.
At 20, 30, and 40 steps, the overall arrangement remained similar. The circular staircase retained the outline of the original food container, and the refrigerator shelves continued to function as architectural floors. Increasing steps produced relatively subtle changes and did not noticeably eliminate the soft appearance of the interior.
DPM++ 2M — Similar structure and material continuity.
The results were visually close to those produced by Euler. The circular structure, upper-level figures, and lower passage remained in similar positions. Differences between 20, 30, and 40 steps were limited, and the grid did not show a clear, consistent improvement in sharpness as the step count increased.
DPM++ 2M SDE — More noticeable local reinterpretation.
This sampler produced more visible changes in the distribution of people, the right-hand wall, and the circular structure. At 20 steps, surfaces appeared mottled and fragmented. At 30 and 40 steps, they appeared more even, although some figures and railings still lacked complete, clearly defined forms.
The circular structure also appeared more like a manufactured architectural cylinder, retaining less of the food container’s original material character.
Reflection
Increasing steps from 20 to 40 did not consistently improve clarity in this experiment. Additional texture sometimes made the image more visually complicated without making its structures easier to understand.
The sampler comparison also revealed a trade-off between local reinterpretation and continuity with the source photograph. Euler and DPM++ 2M preserved more of the container-like appearance of the circular staircase, while DPM++ 2M SDE introduced more changes to the surrounding space.
For my purposes, a successful result needed both readable details and an interesting relationship to the original object. I therefore did not select a sampler solely on the basis of apparent sharpness. These observations are limited to the tested image, prompt, settings, and seed; they do not establish a general ranking of the three samplers.
Experiment 3: Comparing Models through an Organic-to Mechanical Transformation
Original Image
Research question: How do different checkpoints reinterpret the same organic structure when prompted to generate a mechanical object?
My starting image was an AI generated, photographic style close up of a halved orange. I chose it because its radial segments, white fibers, central core, and outer rind could suggest mechanical chambers, connections, a shaft, and a housing.
I compared two checkpoints at three denoise values. I conducted two attempts with different positive prompts, producing a six-image XY Plot for each attempt. Each generation started from the original orange image. The seed, sampler, steps, scheduler, CFG, and negative prompt remained unchanged.
The basic workflow was:
Load Image → VAE Encode → KSampler (Efficient), supplied by Efficient Loader and controlled by XY Input: Checkpoint + XY Input: Denoise → XY Plot → KSampler’s IMAGE output → Save Image.
Efficient Loader supplied the model, positive and negative conditioning, VAE, and XY Plot dependencies. I entered both prompts directly into Efficient Loader. Its empty LATENT output was not used; the sampler received the encoded orange image from VAE Encode.
Data Information
Checkpoints:
v1-5-pruned-emaonly.safetensors
realisticVisionV60B1_v51VAE.safetensors
Seed: 12345
Control after Generate: fixed
Steps: 30
CFG: 5.0
Sampler: dpmpp_2m
Scheduler: normal
VAE setting: Baked VAE
Clip skip: -1
LoRA: None
Input image size: 1254 × 1254
X-axis: Checkpoint
Y-axis: Denoise — 0.45 / 0.65 / 0.85
VAE decode: true
XY Plot output: Plot
The checkpoint and denoise values were supplied by the XY input nodes.
Attempt 1: Combining Organic Tissue and Mechanical Components
Positive prompt:
“Close-up photograph of a cut-open biomechanical device. Radial chambers of translucent amber tissue contain small pistons and interlocking mechanisms. White fibrous membranes connect the chambers to a central hub. A porous orange outer shell encloses the device. Organic tissue and mechanical parts form one continuous structure. Resting on a gray tabletop, side lighting, realistic material textures.”
Negative prompt:
“text, watermark, cartoon, illustration, blurry”
Observations
0.45 — The original fruit remains recognizable.
Both models preserved the orange’s overall appearance. Differences mainly involved the arrangement of white fibers and the texture of the fruit’s surface.
0.65 — Different interpretations of organic texture.
SD 1.5 produced a finer, irregular network across the cut surface. Realistic Vision emphasized branching white fibers and more distinct radial divisions. Neither result contained clearly developed mechanical components.
0.85 — Material changes without a clear mechanical transformation.
SD 1.5 produced a granular, gel-like surface with a less distinct segment structure. Realistic Vision retained a clearer radial organization, with a web-like center and a more regular outer edge.
This first attempt mainly transformed the orange’s texture. I revised the prompt to describe a specific mechanical object and recognizable components more directly.
Attempt 2: Describing a Cutaway Mechanical Pump
Denoise: 0.45 / 0.65 / 0.85
Checkpoints and other settings: unchanged from Attempt 1.
Positive prompt:
“Macro photograph of a cutaway mechanical pump on a gray tabletop. A circular housing encloses six radial piston cylinders, interlocking steel gears, small bolts, copper tubes and a central metal shaft. Translucent orange membranes stretch between the metal components, with moist fibers attached to the joints. Precise machined edges, realistic metal reflections, side lighting, three-quarter view.”
Negative prompt:
“text, watermark, cartoon, illustration, blurry”
Observations
0.45 — Organic identity retained.
Both checkpoints still produced recognizable orange halves. SD 1.5 remained close to the original fruit, while Realistic Vision introduced more visible changes to the white fibers and outer rind.
0.65 — Different degrees of structural transformation.
SD 1.5 placed a small metallic component at the center while leaving most of the surrounding fruit recognizable.
Realistic Vision generated a more developed central assembly. The fruit’s radial divisions became transparent compartments, and the rind began to resemble a manufactured circular housing.
0.85 — Two distinct material outcomes.
SD 1.5 produced an intricate combination of translucent orange material and mechanical parts. The result retained a moist, irregular quality that could suggest fruit, resin, or a machine’s internal structure.
Realistic Vision produced a more clearly defined metallic housing, with a central opening, radial supports, and small mechanical components. The orange color and circular composition remained, but much of the fruit’s material identity disappeared.
Reflection
The revised prompt produced a clearer mechanical transformation and made the differences between the checkpoints more visible. At denoise 0.65, Realistic Vision generated a developed mechanical assembly, while SD 1.5 mainly introduced a central metal component. At 0.85, SD 1.5 retained more ambiguous organic material, while Realistic Vision produced a more recognizable manufactured object.
My two most interesting results were Realistic Vision at 0.65 and SD 1.5 at 0.85. They represented different kinds of coexistence between organic and mechanical forms. The first offered a more readable structure, while the second was harder to classify. When evaluating model differences, however, I compared results at matching denoise values within each grid.
This experiment suggested that a more complete mechanical transformation is not necessarily the most experimental result. The uncertain boundary between fruit, translucent material, and machinery was particularly relevant to my response to last week’s feedback.
These observations apply to the tested input, prompts, resolution, seed, and loaded checkpoint configurations, including their associated VAE behavior. They do not isolate training differences or establish that one model is generally better.
In response to last week’s feedback, I focused on transformations that retained traces of the original objects while introducing unfamiliar spatial or material relationships. I used XY Plot comparisons to investigate denoise strength, CFG, sampling methods, and checkpoints.
Experiment 1: Transforming a Refrigerator into an Architectural Space
Original Image
Research question: How do denoise strength and CFG affect the transformation of a familiar household scene into an imagined architectural space?
My starting image was a photograph of my own refrigerator. I chose it because its shelves, containers, and enclosed interior provided recognizable structures that could be reinterpreted as floors, rooms, and circulation spaces.
I conducted three attempts, moving from a broad denoise range to a narrower comparison. Each generation started from the original photograph. I kept the model, seed, sampler, scheduler, and steps setting unchanged. After the first attempt, I revised the positive prompt and used that revised version for Attempts 2 and 3.
The basic workflow was:
Load Image + Load Checkpoint + two CLIP Text Encode (Prompt) nodes → VAE Encode and KSampler (Efficient), controlled by XY Input: Denoise + XY Input: CFG Scale → XY Plot → saved through KSampler’s IMAGE output → Save Image.
Data Information:
Model: sd_xl_base_1.0.safetensors
Seed: 12345
Control after Generate: fixed
Steps setting: 20
Sampler: dpm_adaptive
Scheduler: normal
Input image size: 1264 × 1670
X-axis: Denoise
The CFG and denoise values were supplied by the XY input nodes, overriding the values displayed directly in KSampler.
Attempt 1: Broad Exploration
Denoise: 0.35 / 0.60 / 0.85
CFG: 3.0 / 5.0 / 7.0
Y-axis: CFG
VAE decode: true
XY Plot output: Plot
Positive prompt:
“Photograph of a towering inhabited atrium. Three stacked floors connected by narrow staircases, walkways with railings, doorways opening into deep rooms. Two small people stand on separate levels. Walls made of translucent ribbed plastic, crumpled silver foil partitions, pale ceramic surfaces, cold overhead lighting. Frontal view, realistic materials, strong spatial depth.”
Negative prompt:
“blur,text,cartoon,watercolor”
Observations
0.35 and 0.60 — The refrigerator remains recognizable.
The results stayed close to the source photograph. Changes mainly affected packaging, containers, and local surface details.
0.85 — Reorganized storage.
The arrangement became more compartmentalized, with additional containers and divisions. However, the image still read as refrigerator storage rather than an inhabited architectural space.
The initial prompt did not produce the intended change of scale. I revised it to describe an atrium, staircases, and people more directly.
Attempt 2: Narrowing the Range
Denoise: 0.45 / 0.55 / 0.65
CFG: 3.0 / 5.0 / 7.0
Positive prompt:
“Photograph of a towering inhabited atrium. Three stacked floors connected by narrow staircases, walkways with railings, doorways opening into deep rooms. Two small people stand on separate levels. Walls made of translucent ribbed plastic, crumpled silver foil partitions, pale ceramic surfaces, cold overhead lighting. Frontal view, realistic materials, strong spatial depth.”
Negative prompt:
“blur,text,cartoon,watercolor”
Observations
0.45 — Household scale.
Food packages and containers remained identifiable, and the scene still appeared primarily as a refrigerator.
0.55 — Coexisting spatial interpretations.
Figures, staircases, and occupied floors appeared within the original framework. The refrigerator border and traces of packaging remained, producing an ambiguous relationship between a small storage space and a large interior.
0.65 — More developed architecture.
The architectural organization became clearer, while individual food objects became less recognizable. The original shelves continued to influence the arrangement of floors.
Since both the prompt and the denoise range changed after Attempt 1, I treated this as a new exploratory stage rather than attributing the difference to denoise alone.
Attempt 3: Examining the Transition
Denoise: 0.48 / 0.51 / 0.54
CFG: 3.0 / 5.0 / 7.0
Positive prompt:
“Photograph of a towering inhabited atrium. Three stacked floors connected by narrow staircases, walkways with railings, doorways opening into deep rooms. Two small people stand on separate levels. Walls made of translucent ribbed plastic, crumpled silver foil partitions, pale ceramic surfaces, cold overhead lighting. Frontal view, realistic materials, strong spatial depth.”
Negative prompt:
“blur,text,cartoon,watercolor”
Observations
0.48 — CFG influences the transition.
At CFG 3, the image remained close to a refrigerator. At CFG 5 and 7, architectural features appeared. This comparison showed that the transition depended on the combination of denoise and CFG.
0.51 — A container becomes a staircase.
The round food container developed into a circular structure with stairs. Its shape still recalled the original object, while the steps and small figures suggested an occupiable space.
0.54 — Continued architectural interpretation.
The results remained close to those at 0.51, with changes in figures, surfaces, and local structural details. Increasing denoise within this interval did not produce an entirely new composition.
Reflection
The most interesting result was the transformation of a food container into a circular staircase at denoise 0.51 and CFG 5. It preserved a visible relationship to the source photograph while changing the object’s apparent scale and function.
The three attempts helped me move from general variation toward a specific visual question: when does a familiar object begin to support a different interpretation? Denoise and CFG jointly affected this transition, while the prompt revision changed the direction of the experiment.
These findings are limited to this input photograph, model, workflow, and fixed seed. I did not test whether the same transitions would persist across other seeds.
Experiment 2: Comparing Samplers and Sampling Steps
Research question: How do different samplers and step settings affect image clarity and the preservation of the refrigerator’s transformation into an architectural space?
I used the same original refrigerator photograph and the revised atrium prompt from Experiment 1. I chose denoise 0.51 and CFG 5 because this combination produced a circular staircase that still resembled the original food container.
I compared three samplers at three step settings in a single nine-image XY Plot. The input image, positive and negative prompts, model, seed, scheduler, denoise, and CFG remained constant.
The basic workflow was:
Load Image + Load Checkpoint + two CLIP Text Encode (Prompt) nodes → VAE Encode and KSampler (Efficient), with XY Input: Sampler/Scheduler + XY Input: Steps → XY Plot feeding the sampler’s script input → KSampler’s IMAGE output → Save Image.
Data Information
Model: sd_xl_base_1.0.safetensors
Seed: 12345
Control after Generate: fixed
CFG: 5.0
Denoise: 0.51
Scheduler: normal
Input image size: 1264 × 1670
X-axis: Sampler — euler / dpmpp_2m / dpmpp_2m_sde
Y-axis: Steps — 20 / 30 / 40
VAE decode: true
XY Plot output: Plot
The sampler and steps values were supplied by the XY input nodes, overriding the corresponding settings displayed directly in KSampler.
Positive prompt
“Photograph of a towering inhabited atrium. Three stacked floors connected by narrow staircases, walkways with railings, doorways opening into deep rooms. Two small people stand on separate levels. Walls made of translucent ribbed plastic, crumpled silver foil partitions, pale ceramic surfaces, cold overhead lighting. Frontal view, realistic materials, strong spatial depth.”
Negative prompt
“blur,text,cartoon,watercolor”
Observations
Euler — Stable composition across step settings.
At 20, 30, and 40 steps, the overall arrangement remained similar. The circular staircase retained the outline of the original food container, and the refrigerator shelves continued to function as architectural floors. Increasing steps produced relatively subtle changes and did not noticeably eliminate the soft appearance of the interior.
DPM++ 2M — Similar structure and material continuity.
The results were visually close to those produced by Euler. The circular structure, upper-level figures, and lower passage remained in similar positions. Differences between 20, 30, and 40 steps were limited, and the grid did not show a clear, consistent improvement in sharpness as the step count increased.
DPM++ 2M SDE — More noticeable local reinterpretation.
This sampler produced more visible changes in the distribution of people, the right-hand wall, and the circular structure. At 20 steps, surfaces appeared mottled and fragmented. At 30 and 40 steps, they appeared more even, although some figures and railings still lacked complete, clearly defined forms.
The circular structure also appeared more like a manufactured architectural cylinder, retaining less of the food container’s original material character.
Reflection
Increasing steps from 20 to 40 did not consistently improve clarity in this experiment. Additional texture sometimes made the image more visually complicated without making its structures easier to understand.
The sampler comparison also revealed a trade-off between local reinterpretation and continuity with the source photograph. Euler and DPM++ 2M preserved more of the container-like appearance of the circular staircase, while DPM++ 2M SDE introduced more changes to the surrounding space.
For my purposes, a successful result needed both readable details and an interesting relationship to the original object. I therefore did not select a sampler solely on the basis of apparent sharpness. These observations are limited to the tested image, prompt, settings, and seed; they do not establish a general ranking of the three samplers.
Experiment 3: Comparing Models through an Organic-to Mechanical Transformation
Original Image
Research question: How do different checkpoints reinterpret the same organic structure when prompted to generate a mechanical object?
My starting image was an AI generated, photographic style close up of a halved orange. I chose it because its radial segments, white fibers, central core, and outer rind could suggest mechanical chambers, connections, a shaft, and a housing.
I compared two checkpoints at three denoise values. I conducted two attempts with different positive prompts, producing a six-image XY Plot for each attempt. Each generation started from the original orange image. The seed, sampler, steps, scheduler, CFG, and negative prompt remained unchanged.
The basic workflow was:
Load Image → VAE Encode → KSampler (Efficient), supplied by Efficient Loader and controlled by XY Input: Checkpoint + XY Input: Denoise → XY Plot → KSampler’s IMAGE output → Save Image.
Efficient Loader supplied the model, positive and negative conditioning, VAE, and XY Plot dependencies. I entered both prompts directly into Efficient Loader. Its empty LATENT output was not used; the sampler received the encoded orange image from VAE Encode.
Data Information
Checkpoints:
v1-5-pruned-emaonly.safetensors
realisticVisionV60B1_v51VAE.safetensors
Seed: 12345
Control after Generate: fixed
Steps: 30
CFG: 5.0
Sampler: dpmpp_2m
Scheduler: normal
VAE setting: Baked VAE
Clip skip: -1
LoRA: None
Input image size: 1254 × 1254
X-axis: Checkpoint
Y-axis: Denoise — 0.45 / 0.65 / 0.85
VAE decode: true
XY Plot output: Plot
The checkpoint and denoise values were supplied by the XY input nodes.
Attempt 1: Combining Organic Tissue and Mechanical Components
Positive prompt:
“Close-up photograph of a cut-open biomechanical device. Radial chambers of translucent amber tissue contain small pistons and interlocking mechanisms. White fibrous membranes connect the chambers to a central hub. A porous orange outer shell encloses the device. Organic tissue and mechanical parts form one continuous structure. Resting on a gray tabletop, side lighting, realistic material textures.”
Negative prompt:
“text, watermark, cartoon, illustration, blurry”
Observations
0.45 — The original fruit remains recognizable.
Both models preserved the orange’s overall appearance. Differences mainly involved the arrangement of white fibers and the texture of the fruit’s surface.
0.65 — Different interpretations of organic texture.
SD 1.5 produced a finer, irregular network across the cut surface. Realistic Vision emphasized branching white fibers and more distinct radial divisions. Neither result contained clearly developed mechanical components.
0.85 — Material changes without a clear mechanical transformation.
SD 1.5 produced a granular, gel-like surface with a less distinct segment structure. Realistic Vision retained a clearer radial organization, with a web-like center and a more regular outer edge.
This first attempt mainly transformed the orange’s texture. I revised the prompt to describe a specific mechanical object and recognizable components more directly.
Attempt 2: Describing a Cutaway Mechanical Pump
Denoise: 0.45 / 0.65 / 0.85
Checkpoints and other settings: unchanged from Attempt 1.
Positive prompt:
“Macro photograph of a cutaway mechanical pump on a gray tabletop. A circular housing encloses six radial piston cylinders, interlocking steel gears, small bolts, copper tubes and a central metal shaft. Translucent orange membranes stretch between the metal components, with moist fibers attached to the joints. Precise machined edges, realistic metal reflections, side lighting, three-quarter view.”
Negative prompt:
“text, watermark, cartoon, illustration, blurry”
Observations
0.45 — Organic identity retained.
Both checkpoints still produced recognizable orange halves. SD 1.5 remained close to the original fruit, while Realistic Vision introduced more visible changes to the white fibers and outer rind.
0.65 — Different degrees of structural transformation.
SD 1.5 placed a small metallic component at the center while leaving most of the surrounding fruit recognizable.
Realistic Vision generated a more developed central assembly. The fruit’s radial divisions became transparent compartments, and the rind began to resemble a manufactured circular housing.
0.85 — Two distinct material outcomes.
SD 1.5 produced an intricate combination of translucent orange material and mechanical parts. The result retained a moist, irregular quality that could suggest fruit, resin, or a machine’s internal structure.
Realistic Vision produced a more clearly defined metallic housing, with a central opening, radial supports, and small mechanical components. The orange color and circular composition remained, but much of the fruit’s material identity disappeared.
Reflection
The revised prompt produced a clearer mechanical transformation and made the differences between the checkpoints more visible. At denoise 0.65, Realistic Vision generated a developed mechanical assembly, while SD 1.5 mainly introduced a central metal component. At 0.85, SD 1.5 retained more ambiguous organic material, while Realistic Vision produced a more recognizable manufactured object.
My two most interesting results were Realistic Vision at 0.65 and SD 1.5 at 0.85. They represented different kinds of coexistence between organic and mechanical forms. The first offered a more readable structure, while the second was harder to classify. When evaluating model differences, however, I compared results at matching denoise values within each grid.
This experiment suggested that a more complete mechanical transformation is not necessarily the most experimental result. The uncertain boundary between fruit, translucent material, and machinery was particularly relevant to my response to last week’s feedback.
These observations apply to the tested input, prompts, resolution, seed, and loaded checkpoint configurations, including their associated VAE behavior. They do not isolate training differences or establish that one model is generally better.
Re: 10.15 XY Plot
Assignment objective:
I have been working on a collage project inspired by a word association game that I used to play to keep myself occupied as a child. The game begins with choosing a random word, and then connecting it to another word based on the first association that comes to mind. This process continues until the chain of associations eventually leads back to the original word. The idea behind this series of collages is to show how visual elements can be connected in the same way that words can, demonstrating that even seemingly unrelated things can share a sense of cohesion and unity. For this assignment I wanted to see how Comfy UI is able to visually relate two distinct entities together.
1st attempt
Prompt: Associate two unrelated objects
Negative Prompt: blur, text, cartoon 2nd attempt
Prompt: Merge two unrelated objects
Negative Prompt: blur, text, cartoon 5th attempt
Prompt: Find a way to visually relate a teapot to a waterfall
Negative Prompt: blur, text, cartoon 7th attempt
Prompt: Find a way to visually relate a teapot to a waterfall. Make it so the waterfall appears to be emerging as water falling from the spout on the teapot.
Negative Prompt: blur, text, cartoon 9th attempt
Prompt: A flower turning into a fairy
Negative Prompt: blur, text, cartoon 12th attempt
Prompt: A flower transforming into a fairy. Shared elements exist between both entities. Petals as wings. A visible fairy face, petal dress or skirt.
Negative Prompt: blur, text, cartoon 14th attempt
Prompt: A flower transforming into a fairy. Shared elements exist between both entities. Petals as wings. A visible fairy face, petal dress or skirt. Show the original flower and fairy in part, and their becoming of one another towards the middle of the image.
Negative Prompt: blur, text, cartoon 15th attempt
Prompt: A flower transforming into a fairy. Shared elements exist between both entities. Petals as wings. A visible fairy face, petal dress or skirt. Show the original flower and fairy in part, and their becoming of one another towards the middle of the image. Make the image feel natural, and less polished
Negative Prompt: blur, text, cartoon
Conclusion:
Comfy UI is capable of including multiple components in an image, but it seems to have difficulty incorporating them cohesively in a functional or even creative manner. The system struggles to recognize points of unity between elements.
I have been working on a collage project inspired by a word association game that I used to play to keep myself occupied as a child. The game begins with choosing a random word, and then connecting it to another word based on the first association that comes to mind. This process continues until the chain of associations eventually leads back to the original word. The idea behind this series of collages is to show how visual elements can be connected in the same way that words can, demonstrating that even seemingly unrelated things can share a sense of cohesion and unity. For this assignment I wanted to see how Comfy UI is able to visually relate two distinct entities together.
1st attempt
Prompt: Associate two unrelated objects
Negative Prompt: blur, text, cartoon 2nd attempt
Prompt: Merge two unrelated objects
Negative Prompt: blur, text, cartoon 5th attempt
Prompt: Find a way to visually relate a teapot to a waterfall
Negative Prompt: blur, text, cartoon 7th attempt
Prompt: Find a way to visually relate a teapot to a waterfall. Make it so the waterfall appears to be emerging as water falling from the spout on the teapot.
Negative Prompt: blur, text, cartoon 9th attempt
Prompt: A flower turning into a fairy
Negative Prompt: blur, text, cartoon 12th attempt
Prompt: A flower transforming into a fairy. Shared elements exist between both entities. Petals as wings. A visible fairy face, petal dress or skirt.
Negative Prompt: blur, text, cartoon 14th attempt
Prompt: A flower transforming into a fairy. Shared elements exist between both entities. Petals as wings. A visible fairy face, petal dress or skirt. Show the original flower and fairy in part, and their becoming of one another towards the middle of the image.
Negative Prompt: blur, text, cartoon 15th attempt
Prompt: A flower transforming into a fairy. Shared elements exist between both entities. Petals as wings. A visible fairy face, petal dress or skirt. Show the original flower and fairy in part, and their becoming of one another towards the middle of the image. Make the image feel natural, and less polished
Negative Prompt: blur, text, cartoon
Conclusion:
Comfy UI is capable of including multiple components in an image, but it seems to have difficulty incorporating them cohesively in a functional or even creative manner. The system struggles to recognize points of unity between elements.
-
jintongyang
- Posts: 15
- Joined: Wed Oct 01, 2025 2:38 pm
Re: 10.15 XY Plot
After last week’s feedback, I’ve been reading more about the history of collage. What I noticed is that early Dada collages mix a lot of different materials, like photos, magazine pages, tickets and text. You can still tell where each piece came from, and the edges are visible. When the Surrealists took up collage, it moved from political propaganda to exploring the subconscious, and from fragmented narratives to uncanny, dreamlike images, so the images started to feel less ordered. In the 1980s, appropriation artists like Peter Nagy photocopied and layered logos and ads from different sources until they became abstract, and later turned them into large black and white paintings.
Diffusion models seem closer to the photocopy approach. Every input passes through the same latent space and comes back as one consistent image. So this week I continued my question of how a machine makes a collage, focusing on materials: can AI keep collage’s mix of different media, or does it unify everything into a single medium?
Stage 1:
I used two of my own collages as inputs and used XY plots to see at what point the materials stop looking different. Image 1 has no text and is mostly architectural structures, made from photos, paper strips, cardboard and paint. Image 2 has text and is mostly figures and typography.
Fixed settings: seed-666 / steps-20 / CFG-7.0 / sampler-euler / scheduler-normal
Image 1
1. Positive prompt × denoise
Positive prompt: collage / photograph / mixed media collage / photomontage
Denoise: 0.4 / 0.6 / 0.8 / 1.0
Negative prompt: watermark, blur, low quality
2. Negative prompt × denoise
Negative prompt: watermark, blur, low quality / seamless, smooth, blended, unified lighting / photograph, realistic / collage, cut paper, mixed media
Denoise: 0.4 / 0.6 / 0.8 / 1.0
Positive prompt: mixed media collage
The negative prompts added a lot of noise, and the noise increased with denoise. At 1.0 the image no longer looked like a collage at all, more like a nebula.
3. CFG × checkpoint
CFG: 2 / 5 / 7 / 9
Checkpoint: sd_xl_base_1.0 / sd_xl_refiner_1.0 / v1-5-pruned-emaonly / realisticVisionV60B1
Positive prompt: mixed media collage
Negative prompt: watermark, blur, low quality
CFG made very little difference. In image-to-image, the input image seems to matter much more than how strongly the prompt is followed. Whether the materials get unified depends mostly on the model and the denoise strength, not on CFG.
4. Checkpoint × denoise
Checkpoint: same four as above
Denoise: 0.4 / 0.6 / 0.8 / 1.0
SDXL base kept the strongest collage feel. The SDXL refiner became more and more like an illustration as denoise went up. SD 1.5 looked fragmented and messy. Realistic Vision held up reasonably well but gradually lost the original composition.
Across all four models, the generated collages leaned toward two materials: photographs and paper. The cardboard, paint and fluorescent paper strips in my original did not survive as distinct materials.
Image 2
1. Positive prompt × denoise
“Mixed media collage” kept the most material variety.
2. Negative prompt × denoise
Unlike Image 1, “seamless, smooth, blended, unified lighting” and “photograph, realistic” both helped keep the material differences. Telling the model what not to do worked better here than on Image 1.
3. Checkpoint × denoise
The SDXL refiner and Realistic Vision moved toward illustration and printmaking. SD 1.5 kept a paper texture but no other materials. SDXL base again had the best collage and material feel, and it even added something like dried flowers.
Summary of Stage 1:
SDXL base with “mixed media collage” kept the most material variety. But even at its best, the model’s idea of collage seems to be mostly photos and paper. Materials that are less common in collages got absorbed into these two. At the same time, it added materials that weren’t in my originals, like dried flowers, leaves, fabric and beads, which it seems to associate with “mixed media.”
Diffusion models seem closer to the photocopy approach. Every input passes through the same latent space and comes back as one consistent image. So this week I continued my question of how a machine makes a collage, focusing on materials: can AI keep collage’s mix of different media, or does it unify everything into a single medium?
Stage 1:
I used two of my own collages as inputs and used XY plots to see at what point the materials stop looking different. Image 1 has no text and is mostly architectural structures, made from photos, paper strips, cardboard and paint. Image 2 has text and is mostly figures and typography.
Fixed settings: seed-666 / steps-20 / CFG-7.0 / sampler-euler / scheduler-normal
Image 1
1. Positive prompt × denoise
Positive prompt: collage / photograph / mixed media collage / photomontage
Denoise: 0.4 / 0.6 / 0.8 / 1.0
Negative prompt: watermark, blur, low quality
2. Negative prompt × denoise
Negative prompt: watermark, blur, low quality / seamless, smooth, blended, unified lighting / photograph, realistic / collage, cut paper, mixed media
Denoise: 0.4 / 0.6 / 0.8 / 1.0
Positive prompt: mixed media collage
The negative prompts added a lot of noise, and the noise increased with denoise. At 1.0 the image no longer looked like a collage at all, more like a nebula.
3. CFG × checkpoint
CFG: 2 / 5 / 7 / 9
Checkpoint: sd_xl_base_1.0 / sd_xl_refiner_1.0 / v1-5-pruned-emaonly / realisticVisionV60B1
Positive prompt: mixed media collage
Negative prompt: watermark, blur, low quality
CFG made very little difference. In image-to-image, the input image seems to matter much more than how strongly the prompt is followed. Whether the materials get unified depends mostly on the model and the denoise strength, not on CFG.
4. Checkpoint × denoise
Checkpoint: same four as above
Denoise: 0.4 / 0.6 / 0.8 / 1.0
SDXL base kept the strongest collage feel. The SDXL refiner became more and more like an illustration as denoise went up. SD 1.5 looked fragmented and messy. Realistic Vision held up reasonably well but gradually lost the original composition.
Across all four models, the generated collages leaned toward two materials: photographs and paper. The cardboard, paint and fluorescent paper strips in my original did not survive as distinct materials.
Image 2
1. Positive prompt × denoise
“Mixed media collage” kept the most material variety.
2. Negative prompt × denoise
Unlike Image 1, “seamless, smooth, blended, unified lighting” and “photograph, realistic” both helped keep the material differences. Telling the model what not to do worked better here than on Image 1.
3. Checkpoint × denoise
The SDXL refiner and Realistic Vision moved toward illustration and printmaking. SD 1.5 kept a paper texture but no other materials. SDXL base again had the best collage and material feel, and it even added something like dried flowers.
Summary of Stage 1:
SDXL base with “mixed media collage” kept the most material variety. But even at its best, the model’s idea of collage seems to be mostly photos and paper. Materials that are less common in collages got absorbed into these two. At the same time, it added materials that weren’t in my originals, like dried flowers, leaves, fabric and beads, which it seems to associate with “mixed media.”
Last edited by jintongyang on Thu Oct 15, 2026 7:35 pm, edited 3 times in total.
-
jintongyang
- Posts: 15
- Joined: Wed Oct 01, 2025 2:38 pm
Re: 10.15 XY Plot
Stage 2:
Based on Stage 1, I fixed the setup that kept the most material variety and tested whether the results hold across seeds and step counts. I also added two collages by Kurt Schwitters to see if the model treats a well-known historical collage differently from mine.
Checkpoint: sd_xl_base_1.0
Positive prompt: mixed media collage
Negative prompt: seamless, smooth, blended, unified lighting, photograph, realistic
1. Denoise × seed
Denoise: 0.4 / 0.6 / 0.8 / 1.0
Seed: 42 / 62 / 82 / 102
Image 1: my collage
Image 2: Kurt Schwitters, Merz Picture 32 A. The Cherry Picture (Merzbild 32 A. Das Kirschbild) (1921)
Image 3: Kurt Schwitters, Merz Picture 25A The Star Picture (1920)
In large abstract structures, the model tended to see faces. Meanwhile, small figures that were actually in the image were gradually ignored as denoise went up. So the model seems to read the overall shapes first and invent familiar things in them.
2. Denoise × steps
Denoise: 0.4 / 0.6 / 0.8 / 1.0
Step: 15 / 20 / 25 / 30
Image 1: my collage
Image 2: Kurt Schwitters, Merz Picture 32 A. The Cherry Picture (Merzbild 32 A. Das Kirschbild) (1921)
Image 3: Kurt Schwitters, Merz Picture 25A The Star Picture (1920)
The more steps, the brighter the colors became, moving further away from the original palette. More steps didn’t bring the image closer to the input. It pulled it toward the model’s own idea of a finished image.
Summary of Stage 2:
Across different seeds, the model kept doing the same two things. It found faces in large abstract shapes that had none, and it slowly erased the small figures that were actually there. More steps didn’t help either. The colors got brighter and drifted away from the original palette, as if the model was finishing the image by its own standards rather than following mine.
Together with Stage 1, this suggests the model is not really reading the collage piece by piece. It looks for something familiar, like a face, a photo, or the materials it expects in a “mixed media collage,” and reshapes the image around that.
Based on Stage 1, I fixed the setup that kept the most material variety and tested whether the results hold across seeds and step counts. I also added two collages by Kurt Schwitters to see if the model treats a well-known historical collage differently from mine.
Checkpoint: sd_xl_base_1.0
Positive prompt: mixed media collage
Negative prompt: seamless, smooth, blended, unified lighting, photograph, realistic
1. Denoise × seed
Denoise: 0.4 / 0.6 / 0.8 / 1.0
Seed: 42 / 62 / 82 / 102
Image 1: my collage
Image 2: Kurt Schwitters, Merz Picture 32 A. The Cherry Picture (Merzbild 32 A. Das Kirschbild) (1921)
Image 3: Kurt Schwitters, Merz Picture 25A The Star Picture (1920)
In large abstract structures, the model tended to see faces. Meanwhile, small figures that were actually in the image were gradually ignored as denoise went up. So the model seems to read the overall shapes first and invent familiar things in them.
2. Denoise × steps
Denoise: 0.4 / 0.6 / 0.8 / 1.0
Step: 15 / 20 / 25 / 30
Image 1: my collage
Image 2: Kurt Schwitters, Merz Picture 32 A. The Cherry Picture (Merzbild 32 A. Das Kirschbild) (1921)
Image 3: Kurt Schwitters, Merz Picture 25A The Star Picture (1920)
The more steps, the brighter the colors became, moving further away from the original palette. More steps didn’t bring the image closer to the input. It pulled it toward the model’s own idea of a finished image.
Summary of Stage 2:
Across different seeds, the model kept doing the same two things. It found faces in large abstract shapes that had none, and it slowly erased the small figures that were actually there. More steps didn’t help either. The colors got brighter and drifted away from the original palette, as if the model was finishing the image by its own standards rather than following mine.
Together with Stage 1, this suggests the model is not really reading the collage piece by piece. It looks for something familiar, like a face, a photo, or the materials it expects in a “mixed media collage,” and reshapes the image around that.
Re: 10.15 XY Plot
I am interested in using ComfyUI to generate artwork featuring 3D particles, similar to what TouchDesigner can create. I want to try two testing methods. The first way is giving ComfyUI a text prompt to see if it can understand and produce 3D particle art. The second way is to feed in a 3D particle image produced by TouchDesigner, ask the same prompt, and then compare the results.
Positive: generate particles-based images, they should have layers, oriented by light, be creative
(pic)
Positive: generate particles
(pic)
Generate sparkling 3D particles
(pic)
I gave this image to Gemini, and asking it to generate a prompt to comfy UI to produce this image.
(pic)
(masterpiece, top quality:1.2), high contrast, glowing particle explosion, central bright light core, cyan and white luminescent particles, flowing silk-like particle tendrils, intricate vector flow field, dynamic energy burst, volumetric lighting, dark void background, abstract CGI 3D render, Octane render, 8k resolution
(pics)
I was testing the variation between different denoise values
denoise 0.94, 1, 0.6
(pics)
I did some minor adjusting of the prompt, I changed it to small particle explosion, and I took away the 8K resolution.
Positive: (masterpiece, top quality:1.2), high contrast, glowing small particle explosion, central bright light core, cyan and white luminescent particles, flowing silk-like particle tendrils, intricate vector flow field, dynamic energy burst, volumetric lighting, dark void background, abstract CGI 3D render, Octane render
(Pics)
I was also testing different seeds.
(pics)
2nd way: feeding in an image to ComfyUI, and I was testing different seeds and different modes.
Modes: Euler, Euler_cfg_pp model, Dpmpp_2m_cfg_pp
seeds: 32-33, 40-42, 60-62; 30-34, 10-12, 60-62
(pics)
Conclusion: I think with text, I would need to give a very detail on what I want the picture to look like since it’s abstract. If I give words like light, sparking, particles, it doesn’t understand what I meant, it needs detailed descriptions to understand what I meant. When given a picture as a reference, it learns better, different modes produce different results, but I think like the Euler better.
Positive: generate particles-based images, they should have layers, oriented by light, be creative
(pic)
Positive: generate particles
(pic)
Generate sparkling 3D particles
(pic)
I gave this image to Gemini, and asking it to generate a prompt to comfy UI to produce this image.
(pic)
(masterpiece, top quality:1.2), high contrast, glowing particle explosion, central bright light core, cyan and white luminescent particles, flowing silk-like particle tendrils, intricate vector flow field, dynamic energy burst, volumetric lighting, dark void background, abstract CGI 3D render, Octane render, 8k resolution
(pics)
I was testing the variation between different denoise values
denoise 0.94, 1, 0.6
(pics)
I did some minor adjusting of the prompt, I changed it to small particle explosion, and I took away the 8K resolution.
Positive: (masterpiece, top quality:1.2), high contrast, glowing small particle explosion, central bright light core, cyan and white luminescent particles, flowing silk-like particle tendrils, intricate vector flow field, dynamic energy burst, volumetric lighting, dark void background, abstract CGI 3D render, Octane render
(Pics)
I was also testing different seeds.
(pics)
2nd way: feeding in an image to ComfyUI, and I was testing different seeds and different modes.
Modes: Euler, Euler_cfg_pp model, Dpmpp_2m_cfg_pp
seeds: 32-33, 40-42, 60-62; 30-34, 10-12, 60-62
(pics)
Conclusion: I think with text, I would need to give a very detail on what I want the picture to look like since it’s abstract. If I give words like light, sparking, particles, it doesn’t understand what I meant, it needs detailed descriptions to understand what I meant. When given a picture as a reference, it learns better, different modes produce different results, but I think like the Euler better.