Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Showing content from https://github.com/lllyasviel/ControlNet-v1-1-nightly/issues/50 below:

Is it possible to enhance the straight-line conditioning? · Issue #50 · lllyasviel/ControlNet-v1-1-nightly · GitHub

Original Title: Is it possible to enhance the straight-line conditioning?

Hello, thank you for the great work. CN + SD really changed the design field a lot.

I'm from both architecture and computer science background, and am currently investigating how far we can go in this direction for conceptual design phase.

There's one issue that we've tried to improve for a while, but cannot get through:

SD w/o CN

SD with CN

If you look at the image above, the mullions and window frames are not straight, the lines are wobbly.
We used a screenshot of a 3D model for the conditioning, but regardless of the preprocessor used, the generated images always have more or less issues like this.

What we thought about the cause might be:

1. The preprocessed image has only 512 resolution, which makes the processed lines already wobbly (some lines are very light after processing)
2. this is a short-comming of the SD itself.

We also tried to use volume screenshot without the mullions, but the results are similar:

SD with CN

At this point, we'd like to seek advice from the developers how this issue can be improved:

1. Should we train a Diffusion model (dreambooth, or LoRA approach) with more architecture related model (we've tried a few from Civitai, but the improvements are limited)
2. Should we train our own CN (for instance, a series of "non-perfect canny-style" images + perfect architecture rendering to have a CN understand those facade need to have straight mullions)?
3. Or what should we do at this point?

RetroSearch is an open source project built by @garambo | Open a GitHub Issue

Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo

HTML: 3.2 | Encoding: UTF-8 | Version: 0.7.4