Hugging Face's logo

growwithdaisy
/
dsycam_20241119_210408

Text-to-Image
Diffusers
flux
flux-diffusers
simpletuner
Not-For-All-Audiences
lora
template:sd-lora
lycoris
Model card Files Community
Edit model card

growwithdaisy/dsycam_20241119_210408

This is a LyCORIS adapter derived from FLUX.1-dev.

The main validation prompt used during training was:

a photo of a daisy

Validation settings

  • CFG: 3.5
  • CFG Rescale: 0.0
  • Steps: 20
  • Sampler: FlowMatchEulerDiscreteScheduler
  • Seed: 69
  • Resolution: 1024x1024
  • Skip-layer guidance:

Note: The validation settings are not necessarily the same as the training settings.

You can find some example images in the following gallery:

Prompt
unconditional (blank prompt)
Negative Prompt
blurry, cropped, ugly
Prompt
dts photography style, dsycam, A pregnant woman with braided hair, wearing a black blazer, sits against a plain white background, smiling gently.
Negative Prompt
blurry, cropped, ugly
Prompt
dts photography style, dsycam, A woman with curly hair, wearing a denim jacket and a choker necklace, gazes upwards against a plain background.
Negative Prompt
blurry, cropped, ugly
Prompt
dts photography style, dsycam, Two women, one in a blue dress and the other in a peach dress, sit outdoors against a backdrop of trees and a white cloth. The woman in blue is seated upright, gazing forward, while the woman in peach lies beside her, resting her head on her lap.
Negative Prompt
blurry, cropped, ugly
Prompt
dts photography style, dsycam, A young man with long hair, wearing a plaid shirt and blue jeans, is skateboarding at a park. The sky is blue with a few clouds, and there are trees in the background.
Negative Prompt
blurry, cropped, ugly
Prompt
jmmymrbl cutup photography style, dsycam, The image is an aerial view of a person's hands holding a large red paper cutout in the shape of a flower. The paper cutouts are arranged in a way that they form a heart shape with a blue background. The person is sitting on a blue surface with their legs crossed and their hands resting on the edges of the paper. They are wearing
Negative Prompt
blurry, cropped, ugly
Prompt
jmmymrbl cutup photography style, dsycam, The image is a portrait of a young woman with blonde hair and red lipstick. She is wearing a red dress with a high neckline and a tulle skirt. The dress is made of a shiny, flowing fabric and has a ruffled hemline. The woman is holding a large, red paper cutout in the shape of a heart, with
Negative Prompt
blurry, cropped, ugly
Prompt
jmmymrbl cutup photography style, dsycam, The image is a portrait of a young woman with blonde hair. She is standing in front of a blue and yellow background with a large yellow question mark in the shape of a speech bubble. The woman is wearing a white dress with a yellow ruffled neckline and is holding a yellow card in her hand. She has a serious expression on her face
Negative Prompt
blurry, cropped, ugly
Prompt
jmmymrbl cutup photography style, dsycam, The image is a portrait of a young African-American woman with an afro hairstyle. She is wearing a bright yellow top with a high neckline and long sleeves. The top is made of a shiny, shiny fabric and has a high collar. The woman is sitting with her hand on her chin, resting her chin on her hand, as if
Negative Prompt
blurry, cropped, ugly
Prompt
jmmymrbl earthly delights photography style, dsycam, The image is a close-up portrait of a woman's face. The woman's lips are slightly parted, as if she is about to kiss someone. The background is blurred, but it appears to be a clear blue sky with a hint of orange and yellow. On the right side of the image, there is a pink and purple flower-like object
Negative Prompt
blurry, cropped, ugly
Prompt
jmmymrbl earthly delights photography style, dsycam, The image is a portrait of a young woman standing in a field of tall grass and wildflowers. She is wearing a long, light pink dress with a white lace top and a tulle skirt. The dress has a high neckline and long sleeves with sheer sleeves. The woman has blonde hair styled in loose waves and is wearing red lipstick. She
Negative Prompt
blurry, cropped, ugly
Prompt
jmmymrbl earthly delights photography style, dsycam, The image is a close-up portrait of a young woman with shoulder-length blonde hair and red lipstick. She is looking up at the camera with a serious expression on her face. The background is blurred, but it appears to be an outdoor setting with a blue sky and some greenery. The woman is wearing a white dress with a sheer overlay,
Negative Prompt
blurry, cropped, ugly
Prompt
jmmymrbl earthly delights photography style, dsycam, The image shows a young woman sitting on a bed of tall grass and pampas grass. She is wearing a long, flowing yellow dress with a flowy skirt and a flower crown on her head. The dress is made of a light-colored fabric and has a high neckline and long sleeves. The woman is holding a bouquet of white flowers
Negative Prompt
blurry, cropped, ugly
Prompt
jmmymrbl dunes photography style, dsycam, The image is a portrait of a young woman with blonde hair, wearing a bright orange coat with a fur collar. She is standing in a desert-like landscape with a clear blue sky in the background. The woman is holding a large blue hula hoop in front of her face, which she is holding with both hands and appears to be in the process
Negative Prompt
blurry, cropped, ugly
Prompt
jmmymrbl dunes photography style, dsycam, The image shows a person lying on their back on a sand dune. The person is wearing a bright yellow dress and appears to be in a relaxed position, with their arms stretched out to the sides and their legs stretched out in front of them. The sand dunes are vast and vast, with no other people or objects in sight. The sky is
Negative Prompt
blurry, cropped, ugly
Prompt
jmmymrbl dunes photography style, dsycam, The image shows a young woman standing on a beach with her arms stretched out to the sides. She is wearing a bright orange dress with a ruffled neckline and long sleeves. Her blonde hair is blowing in the wind and her eyes are closed, as if she is in a peaceful state. The background is a clear blue sky and the sand d
Negative Prompt
blurry, cropped, ugly
Prompt
jmmymrbl dunes photography style, dsycam, The image shows a person sitting on a sand dune in the middle of a vast desert. The person is wearing an orange outfit and is sitting on the sand with their legs crossed. The sand dunes are vast and vast, with no other people or objects in sight. The sky is overcast and the overall mood of the image is somber and
Negative Prompt
blurry, cropped, ugly
Prompt
lcvntr photography style, dsycam, The image shows a young man standing in a blue background. He is wearing a black tracksuit with white stripes on the sides and black shoes. He has a black bag slung over his shoulder and is holding a black phone in his left hand. The man is standing with his right hand in his pocket and his left leg slightly bent at the knee.
Negative Prompt
blurry, cropped, ugly
Prompt
lcvntr photography style, dsycam, The image is a portrait of a young man sitting on the ground with his legs crossed. He is wearing a white t-shirt and blue jeans. His hair is styled in a short, and the overall mood, as if he is deep in thought. The background is a solid orange color, spiky cut with a side part and his eyes are closed
Negative Prompt
blurry, cropped, ugly
Prompt
lcvntr photography style, dsycam, The image shows a close-up of a person's foot wearing a pair of black socks and a brown paper bag attached to the sole of a black hiking boot. The bag appears to be made of brown paper and has a yellow strap around the ankle. The person is wearing black socks with a gray and black patterned design. The boot has a black
Negative Prompt
blurry, cropped, ugly
Prompt
lcvntr photography style, dsycam, The image shows a young woman standing in front of a chain-link fence. She is wearing a black top with a blue and white striped skirt and blue and orange striped pants. She has long braided hair and is wearing white sneakers. The background shows a cityscape with tall buildings and a green lawn. The sky is blue and the weather appears to
Negative Prompt
blurry, cropped, ugly
Prompt
mrtnprr photography style, dsycam, The image is a black and white photograph of a group of people gathered around a long table in a large room with large windows. The table is covered with a long white tablecloth and is set with plates of food and bowls of food. There are several people standing around the table, some of them are holding plates and serving themselves, while others are looking
Negative Prompt
blurry, cropped, ugly
Prompt
mrtnprr photography style, dsycam, The image shows an elderly woman standing on a beach with the ocean in the background. She is wearing a yellow bikini and a straw hat with green sunglasses. The woman is holding a small brown dog in her arms and is looking directly at the camera with a serious expression on her face. The dog appears to be a Pomeranian or a similar breed.
Negative Prompt
blurry, cropped, ugly
Prompt
mrtnprr photography style, dsycam, The image shows two men working on a construction site near a harbor. They are both wearing black shorts and blue shorts and are bending over a pile of blue and black fishing nets. The nets are stacked on top of each other and appear to be made of plastic. In the background, there are several boats docked in the harbor and a few buildings and
Negative Prompt
blurry, cropped, ugly
Prompt
mrtnprr photography style, dsycam, The image is a black and white photograph of three women working in a sewing studio. The studio appears to be old and dilapidated, and there are several other sewing machines and sewing supplies scattered around the room. The woman, with peeling paint and peeling walls. The women are sitting at a sewing machine with multiple spools of thread on it
Negative Prompt
blurry, cropped, ugly
Prompt
jmmymrbl general photography style, dsycam, The image is a portrait of a young woman standing in a field of tall grass and wildflowers. She is wearing a long, light pink dress with a white lace top and a tulle skirt. The dress has a high neckline and long sleeves with sheer sleeves. The woman has blonde hair styled in loose waves and is wearing red lipstick. She
Negative Prompt
blurry, cropped, ugly
Prompt
jmmymrbl general photography style, dsycam, The image shows a young woman sitting on the ground in front of a wall covered in pink and red flowers. She is wearing a green dress with a floral pattern and a blue headband. She has a pair of sunglasses on and is resting her head on her hands. The woman is sitting on a rock with her legs crossed and her arms resting on her
Negative Prompt
blurry, cropped, ugly
Prompt
jmmymrbl general photography style, dsycam, The image shows a young woman sitting on a bed with a blue floral wallpaper in the background. She is holding a telephone receiver to her ear and appears to be talking on it. The woman has short dark hair styled in a messy bun with bangs and is wearing a colorful floral blouse. She has a serious expression on her face and is looking directly
Negative Prompt
blurry, cropped, ugly
Prompt
jmmymrbl general photography style, dsycam, The image shows a young woman lying on a striped blanket. She is wearing a colorful striped dress with a high neckline and long sleeves. The dress is made up of different patterns and colors, including stripes in shades of pink, purple, and yellow. The woman has long brown hair and is resting her head on the blanket, with her eyes closed and
Negative Prompt
blurry, cropped, ugly
Prompt
lrltnsky photography style, dsycam, The image shows a white table with a white background. On the table, a small bowl, and a plastic container with a clear plastic cover. There is also a small piece of paper with a picture of, there are two small plastic bags, there is a white cutting board with a knife and a small orange fruit on it. Next to the cutting board
Negative Prompt
blurry, cropped, ugly
Prompt
lrltnsky photography style, dsycam, The image shows a wooden workbench with various art supplies scattered on it. On the left side of the workbench, a glass of orange juice, a jar of paint, a paintbrush, a pair of scissors, and a paint palette. Next to the jar, there are two pears, there is a cardboard box with a black marker and a
Negative Prompt
blurry, cropped, ugly
Prompt
lrltnsky photography style, dsycam, The image shows a kitchen countertop with a white bowl and a wooden spoon in it. On the countertop, a bottle of olive oil, a bunch of apples, a glass jar, a knife, a lemon, and a few other fruits. There is also a roll of toilet paper on the, there are various kitchen items such as a blue cloth
Negative Prompt
blurry, cropped, ugly
Prompt
lrltnsky photography style, dsycam, The image shows a wooden cutting board on a kitchen countertop with a white cutting board in the center. On the cutting board, there are several sliced apples that have been cut in half and are scattered around the board. A knife is resting on the right side of the board and a fork is on the left side. There is also a small white pitcher
Negative Prompt
blurry, cropped, ugly
Prompt
wlfgngtllmns photography style, dsycam, The image is a portrait of a young African-American woman sitting on a blue couch. She is wearing a black tank top and glasses, and her hair is styled in a short, but it, curly bob. She has a serious expression on her face and is resting her head on her hand, with one hand on her chin. The background is blurred
Negative Prompt
blurry, cropped, ugly
Prompt
wlfgngtllmns photography style, dsycam, The image is a portrait of a middle-aged woman standing in front of a tree. She is wearing a blue sweater and a white collared shirt with a pearl necklace. She has short, but it appears to be a garden or park with trees and bushes, dark hair and is looking directly at the camera with a serious expression. The background is blurred
Negative Prompt
blurry, cropped, ugly
Prompt
wlfgngtllmns photography style, dsycam, The image shows a young woman standing in a room with a wooden floor and a large window on the right side. She is wearing a long black coat with a high collar and long sleeves, and black boots with a pointed toe. Her hair is styled in a messy bun and she is looking directly at the camera with a serious expression. On the left side
Negative Prompt
blurry, cropped, ugly
Prompt
wlfgngtllmns photography style, dsycam, The image shows a man lying on a bed with his head resting on a blue blanket. He is shirtless and appears to be sleeping, with his arms stretched out to the sides and his head tilted back. The bed is covered with a blue and white patterned blanket and there is a white brick wall in the background. The man's face is not
Negative Prompt
blurry, cropped, ugly
Prompt
wmnmrrrd photography style, dsycam, The image shows a young woman lying on the ground in front of a large concrete wall with a puddle of water in the foreground. She is wearing a black bikini and her long dark hair is flowing in the wind. The wall appears to be old and dilapidated, with cracks and peeling paint visible on the surface. The sky is cloudy and
Negative Prompt
blurry, cropped, ugly
Prompt
wmnmrrrd photography style, dsycam, The image shows a young woman lying on her back on a blue background. She is wearing a white tank top and a blue mini skirt with a ruffled hem. Her long blonde hair is flowing in the wind and she is looking directly at the camera with a serious expression. Her legs are stretched out in front of her and her arms are stretched above
Negative Prompt
blurry, cropped, ugly
Prompt
wmnmrrrd photography style, dsycam, The image is a portrait of a young woman lying on a blue couch. She is wearing a white sweater and black shorts, and her blonde hair is styled in loose waves. Her arms are resting on her knees and her head is resting on the armrests of the couch. The woman is looking directly at the camera with a serious expression on her face
Negative Prompt
blurry, cropped, ugly
Prompt
wmnmrrrd photography style, dsycam, The image shows a young woman lying on her back on the ground in front of a large concrete wall. She is wearing a black bikini and her body is stretched out in a relaxed position with her arms stretched out to the sides. Her head is resting on her hands and her eyes are closed. The wall behind her is old and weathered, with cracks
Negative Prompt
blurry, cropped, ugly
Prompt
ktyshyn photography style, dsycam, The image shows a young woman drinking water from a faucet in a kitchen sink. She is lying on her side with her eyes closed and her mouth open as if she is about to take a sip from the tap. The tap is silver and has a long flowing stream of water coming out of it. The woman is wearing a gold necklace
Negative Prompt
blurry, cropped, ugly
Prompt
ktyshyn photography style, dsycam, The image shows a young woman standing on a balcony with her arms stretched upwards towards the sky. She is wearing a white top with blue and green ruffles on the sleeves and a pair of blue jeans. Her hair is styled in loose waves and she has a serious expression on her face. The background is a clear blue sky with a few clouds.
Negative Prompt
blurry, cropped, ugly
Prompt
ktyshyn photography style, dsycam, The image is a portrait of a young woman leaning against a window with her head resting on her hand. She is wearing a blue and green ruffled top and ripped jeans. Her hair is styled in loose waves and she is looking off to the side with a serious expression on her face. The background is blurred but it appears to be an outdoor
Negative Prompt
blurry, cropped, ugly
Prompt
ktyshyn photography style, dsycam, The image shows a young woman standing in front of a brick wall. She is wearing a black crop top and shorts with a black bra and high-waisted shorts. She has long dark hair styled in a messy updo and is holding a red handbag in her right hand. The woman is posing with one hand on her hip and the other
Negative Prompt
blurry, cropped, ugly
Prompt
a photo of a daisy
Negative Prompt
blurry, cropped, ugly

The text encoder was not trained. You may reuse the base model text encoder for inference.

Training settings

  • Training epochs: 11
  • Training steps: 2000
  • Learning rate: 0.0001
    • Learning rate schedule: constant
    • Warmup steps: 0
  • Max grad norm: 2.0
  • Effective batch size: 8
    • Micro-batch size: 2
    • Gradient accumulation steps: 1
    • Number of GPUs: 4
  • Gradient checkpointing: True
  • Prediction type: flow-matching (extra parameters=['shift=3', 'flux_guidance_mode=constant', 'flux_guidance_value=1.0', 'flow_matching_loss=compatible'])
  • Optimizer: optimi-stableadamwweight_decay=1e-3
  • Trainable parameter precision: Pure BF16
  • Caption dropout probability: 5.0%

LyCORIS Config: 

{
    "algo": "lokr",
    "multiplier": 1,
    "linear_dim": 1000000,
    "linear_alpha": 1,
    "factor": 12,
    "init_lokr_norm": 0.001,
    "apply_preset": {
        "target_module": [
            "FluxTransformerBlock",
            "FluxSingleTransformerBlock"
        ],
        "module_algo_map": {
            "Attention": {
                "factor": 12
            },
            "FeedForward": {
                "factor": 6
            }
        }
    }
}

Datasets

dsycam-512

  • Repeats: 0
  • Total number of images: ~468
  • Total number of aspect buckets: 3
  • Resolution: 0.262144 megapixels
  • Cropped: False
  • Crop style: None
  • Crop aspect: None
  • Used for regularisation data: No

dsycam-768

  • Repeats: 0
  • Total number of images: ~452
  • Total number of aspect buckets: 1
  • Resolution: 0.589824 megapixels
  • Cropped: False
  • Crop style: None
  • Crop aspect: None
  • Used for regularisation data: No

dsycam-1024

  • Repeats: 0
  • Total number of images: ~376
  • Total number of aspect buckets: 3
  • Resolution: 1.048576 megapixels
  • Cropped: False
  • Crop style: None
  • Crop aspect: None
  • Used for regularisation data: No

Inference 

import torch
from diffusers import DiffusionPipeline
from lycoris import create_lycoris_from_weights


def download_adapter(repo_id: str):
    import os
    from huggingface_hub import hf_hub_download
    adapter_filename = "pytorch_lora_weights.safetensors"
    cache_dir = os.environ.get('HF_PATH', os.path.expanduser('~/.cache/huggingface/hub/models'))
    cleaned_adapter_path = repo_id.replace("/", "_").replace("\\", "_").replace(":", "_")
    path_to_adapter = os.path.join(cache_dir, cleaned_adapter_path)
    path_to_adapter_file = os.path.join(path_to_adapter, adapter_filename)
    os.makedirs(path_to_adapter, exist_ok=True)
    hf_hub_download(
        repo_id=repo_id, filename=adapter_filename, local_dir=path_to_adapter
    )

    return path_to_adapter_file
    
model_id = 'FLUX.1-dev'
adapter_repo_id = 'playerzer0x/growwithdaisy/dsycam_20241119_210408'
adapter_filename = 'pytorch_lora_weights.safetensors'
adapter_file_path = download_adapter(repo_id=adapter_repo_id)
pipeline = DiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.bfloat16) # loading directly in bf16
lora_scale = 1.0
wrapper, _ = create_lycoris_from_weights(lora_scale, adapter_file_path, pipeline.transformer)
wrapper.merge_to()

prompt = "a photo of a daisy"


## Optional: quantise the model to save on vram.
## Note: The model was not quantised during training, so it is not necessary to quantise it during inference time.
#from optimum.quanto import quantize, freeze, qint8
#quantize(pipeline.transformer, weights=qint8)
#freeze(pipeline.transformer)
    
pipeline.to('cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu') # the pipeline is already in its target precision level
image = pipeline(
    prompt=prompt,
    num_inference_steps=20,
    generator=torch.Generator(device='cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu').manual_seed(69),
    width=1024,
    height=1024,
    guidance_scale=3.5,
).images[0]
image.save("output.png", format="PNG")
Downloads last month
33
Inference Examples
Text-to-Image
Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.