lora-training / mari /README.md
khanon's picture
adds retrained Mari LoRA
a294452
|
raw
history blame
3.46 kB

Iochi Mari (Blue Archive)

伊落マリー (ブルーアーカイブ) / 이오치 마리 (블루 아카이브)

Download here.

Table of Contents

Preview

Mari portrait Mari nun Mari gym Mari dress

Usage

Use any or all of the following tags to summon Mari: mari, halo, 1girl, blue eyes, orange hair

  • Hair and eyes are optional.
  • It is recommended to add cat ears or animal ear headwear, otherwise her ears may not appear consistently. This is likely because Mari's veil prevents the AI from strongly associating her ears the word mari.
  • If Mari's ears are appearing through her veil, try adding animal ear fluff to the negative prompt.

For her normal outfit: single braid, animal ear headwear, nun, habit, blue neckerchief, white sailor collar, puffy long sleeves

For her sportswear alt: low ponytail, sportswear, track jacket, shorts, gym shirt, ponytail, white headband, id card, bottle

  • Use track jacket for a full jacket, or open jacket when the jacket should be open.
  • Use wet, wet clothes for transparent/wet clothing
  • Use gym shirt to discourage the full jacket from appearing, as it was only tagged when the jacket was unzipped.

For her swimsuit: black one-piece swimsuit, frilled swimsuit, frills, paw print

  • You will likely need to add competitions wimsuit to the negative prompt.

Training

Exact parameters are provided in the accompanying JSON files.

  • Trained on a set of 253 images
    • Datset included a mixture of SFW/NSFW.
    • 3 repeats
    • 3 batch size, 7 epochs
    • (253*3) / 3 * 7 = 1771 steps
    • Increased steps for stronger fit due to larger, more varied dataset.
  • 768x768 training resolution
  • constant_with_warmup scheduler
  • Initially tagged with WD1.4 Convnext model, then heavily edited.
    • Pruned redundant tags and simplified outfit tags such that Mari's outfit was always described with the same words
    • Ensured unique traits such as halo were consistent with actual visibility
    • Added many tags for facial expressions, camera angles, and image composition
  • Used network_dimension 128 (same as usual) / network alpha 128 (default)
  • Trained without VAE.
  • Training dataset available here.

Revisions

  • v5b (2023-02-08)
    • Completely re-trained to correct issue where caption files were not being loaded correctly. New version should have more flexibility but requires additional outfit prompting.
  • v4 (2023-01-20)
    • Initial release.
    • Issue: caption files were completely ignored during training. As a result, prompting "sora" grants a very strong effect, but the LoRA is highly overfit.

Alternate Version - v4

v4 is also available. This version was improperly configured and ignored caption files, so it was trained only on the word mari. It looks quite good, however it is very overfit and it is difficult to adjust Mari's outfit. In the example image below, the prompt includes yellow dress but the model ignores the color and instead uses a dress that resembles Mari's usual outfit.

Download v4.

v4 Preview