When using multiple LoRAs to change styles, previous studies have mentioned issues such as the degradation of styles due to overlapping weights. This time, we will apply multiple LoRAs to see the benchmarks and the images produced.
We use these LoRAs
[LoRa] Shoal / 錦鱗 Concept (With multires noise version)
https://civitai.com/models/79737/lora-shoal-concept-with-multires-noise-version
[LoRa] Swatches Neon / 色塊ネオン Concept (With multires noise version)
https://civitai.com/models/83847/lora-swatches-neon-concept-with-multires-noise-version
In img2txt, selecting multiple LoRAs will result in a prompt with multiple LoRA specifications mentioned. The following prompt was used.
fish, neon lora:underwater3:1 lora:cbpk:1
Finally, two LoRAs are introduced within < >.
First, I will run the model with both LoRAs removed and with a specified fixed seed. The base model used was Goofball mix.
https://civitai.com/models/53761?modelVersionId=285757
without LoRA / RTX4090 / 512x512 / 1.7s
with neon LoRA / RTX4090 / 512x512 / 3.3s
with underwater LoRA / RTX4090 / 512x512 / 3.5s
with neon & underwater LoRA / RTX4090 / 512x512 / 5.1s
How about that? Even with a fixed seed, quite different styles emerged.
Each individual LoRA seems to work well, capturing the intended atmosphere. Mixing LoRAs produces another distinct style, but blending completely different styles like underwater and neon can result in a confusing, yet artistic look.
It seems interesting to combine LoRAs according to one's purpose. The computation time increased when multiple LoRAs were applied.