Stable Diffusion

4310 readers

6 users here now

Discuss matters related to our favourite AI Art generation technology

Also see

Other communities

founded 1 year ago

MODERATORS

db0@lemmy.dbzer0.com

Anyone here made their own Lora and can share some experiences? (lem.ainyataovi.net)

submitted 1 year ago by Shiimiish@lem.ainyataovi.net to c/stable_diffusion@lemmy.dbzer0.com

11 comments fedilink hide all child comments

Hi there, I'm trying to get (more or less) historically accurate images from the early and high middle ages, but none of the models seems to have a grasp of what "maille armor" or "bucket helmets" are and I either get complete garbage or fantasy armor that mostly resembles the early modern period (the stereotypical shining knight armor).

I assume a Lora, trained on images of the armor and weapons I'd like to include, could fix this problem. I found some neat tutorials for making Lora's and think I'll give it a shot.

Do any of you have experience in making these kinds of style Lora's? What should I take care of? I will be manually downloading images that fit my aestethic and manually tag them - how many images should I use? Any input here is highly appreciated.

you are viewing a single comment's thread
view the rest of the comments

[–] FactorSD@lemmy.dbzer0.com 1 points 1 year ago* (last edited 1 year ago)

It would definitely be unwieldy to make LORAs that were so obsessively granular, but it comes down to how specific you want the output to be. It's probably pretty easy to make a Porsche LORA that will spit out credible Porsche silhouettes, but if you want accurate and detailed 911 Turbo S models you have to train it just on those. More accurate means less flexible; you have to pick your poison.

If you want an omni-functional thing then you really want to make your own checkpoint... But LORA are still a potentially good way to approach that because you can merge LORAs into a model, and you can merge LORAs into each other. I have no idea how you do that, but the functionality is there.

My plan is (eventually) to do exactly that with my own niche area of interest, build a model but do it in discrete chunks. So start out with one specific LORA for one specific garment that I have a particular interest in, get that to work well, then make others, then when I have enough that it's tiresome to sort through start merging them together.

That said... I am not an expert, not even slightly.