job: extension
config:
  name: prokudin_gorskiy_hst_lora
  process:
  - type: sd_trainer
    training_folder: /content/output
    device: cuda:0
    network:
      type: lora
      linear: 16
      linear_alpha: 16
    save:
      dtype: float16
      save_every: 1000
      max_step_saves_to_keep: 3
    datasets:
    - folder_path: /content/dataset
      caption_ext: txt
      caption_dropout_rate: 0.05
      shuffle_tokens: false
      cache_latents_to_disk: true
      resolution:
      - 512
      - 768
      - 1024
    train:
      batch_size: 1
      steps: 4000
      gradient_accumulation_steps: 1
      train_unet: true
      train_text_encoder: false
      gradient_checkpointing: true
      noise_scheduler: flowmatch
      optimizer: adamw8bit
      lr: 0.0001
      skip_first_sample: true
      linear_timesteps: true
      ema_config:
        use_ema: true
        ema_decay: 0.99
      dtype: bf16
    model:
      name_or_path: black-forest-labs/FLUX.1-schnell
      assistant_lora_path: ostris/FLUX.1-schnell-training-adapter
      is_flux: true
      quantize: true
    sample:
      sampler: flowmatch
      sample_every: 1000
      width: 1024
      height: 1024
      prompts:
      - HST style photo of Lenin in 1924 surrounded by two other individuals on either
        side of him. Film photograph, three-quarter length, from front. Lenin in the
        center, wearing a white outfit sits in a wicker wheelchair, wearing a white
        shirt and flat cap. His eyes look intense and slightly demented. He seems
        convalescent and ill following a stroke. A woman in a white dress with a black
        belt stands to the left, leaning forward with her hands on the back of the
        wheelchair.
      - HST style Arthur Rimbaud. He is dressed in a dark suit with a white shirt
        and a maroon tie with small white polka dots. He is looking to his right with
        an inquisitive expression.
      - HST nightclub in 1921 USSR,, fish eye lens, smoke machine, lazer lights, Trotsky
        holding a martini
      - HST style Andrey Beliy showing off his cool new poetry books at the beach
        in 1921 USSR, a shark is jumping out of the water to eat the books, Beliy
        screams in surprise
      - HST style Alexey Khvostenko and Anri Volokhonskiy and a bear collaborate building
        a log cabin in the snow covered mountains
      - HST style Viktor Tsoy soulfully playing the guitar, on stage in 1921 USSR,
        singing a song, laser lights, punk rocker
      - HST style Lawrence from Felt
      - HST style Medium-frame photo of Robert Duncan the poet sitting in his office,
        wearing a dark suit and tie. Bust view, facing forward. Sitting with hands
        resting, neutral facial expression. Bookshelves filled with books in the background.
        Wooden furniture in the surrounding space.
      - HST style Lenin in cap and Bolshevik suit holding a sign with text, 'World
        workers, all our eyes!'
      - HST style Egor Letov in a leather jacket, in a desert, on a motorcycle
      neg: ''
      seed: 42
      walk_seed: true
      guidance_scale: 1
      sample_steps: 4
meta:
  name: prokudin_gorskiy_hst_lora
  version: '1.0'