Flux-Lego-Ref-LoRA

Prompt
lego --fref --89890, a Lego Star Wars figure stands in a pile of snow. The figure is adorned with a white snow-covered hat, a white coat, and a black and white striped jacket. The face of the figure is yellow, and the eyes are blue. The background is a grayish-gray color, and there are small white dots dotting the top of the image.
Prompt
lego --fref --89890, a toy robot is soaring through the air. The robot is dressed in a red jumpsuit, adorned with a black helmet and goggles. The toy is holding a small camera in its right hand. The camera has a black lens, and a yellow handle. The sky is a deep blue, dotted with white clouds, adding a pop of color to the scene.
Prompt
lego --fref --89890, a lego robot is soaring through the air on a dirt bike. The robot is wearing a white helmet, a white shirt, and a brown and orange vest. The bike is soaring over a pile of brown rocks, with a body of water in the background. The sky is filled with clouds, and the sun is peeking through the clouds, adding a warm glow to the scene.
Prompt
lego --fref --89890, a lego astronaut is standing on a rocky surface, holding a flag with a white pole. The astronaut is wearing a white helmet, a white and red uniform, and black gloves. The background is blurred, creating a stark contrast with the astronaut and the flag. The flag is adorned with an orange and white striped flag, adding a pop of color to the scene.

The model is still in the training phase. This is not the final version and may contain artifacts and perform poorly in some cases.

Model description

prithivMLmods/Flux-Lego-Ref-LoRA

Image Processing Parameters

Parameter Value Parameter Value
LR Scheduler constant Noise Offset 0.03
Optimizer AdamW Multires Noise Discount 0.1
Network Dim 64 Multires Noise Iterations 10
Network Alpha 32 Repeat & Steps 17 & 2350
Epoch 10 Save Every N Epochs 1
Labeling: florence2-en(natural language & English)

Total Images Used for Training : 15

Best Dimensions & Inference

Dimensions Aspect Ratio Recommendation
1280 x 832 3:2 Best
1024 x 1024 1:1 Default

Inference Range

  • Recommended Inference Steps: 30–35

Setting Up

import torch
from pipelines import DiffusionPipeline

base_model = "black-forest-labs/FLUX.1-dev"
pipe = DiffusionPipeline.from_pretrained(base_model, torch_dtype=torch.bfloat16)

lora_repo = "prithivMLmods/Flux-Lego-Ref-LoRA"
trigger_word = "lego --fref --89890"  
pipe.load_lora_weights(lora_repo)

device = torch.device("cuda")
pipe.to(device)

Trigger words

You should use lego --fref --89890 to trigger the image generation.

Download model

Weights for this model are available in Safetensors format.

Download them in the Files & versions tab.

Downloads last month
122
Inference API
Examples

Model tree for prithivMLmods/Flux-Lego-Ref-LoRA

Adapter
(10096)
this model

Spaces using prithivMLmods/Flux-Lego-Ref-LoRA 3

Collection including prithivMLmods/Flux-Lego-Ref-LoRA