lichorosario's picture
Add generated example (#3)
af71217 verified
|
raw
history blame
14.6 kB
metadata
license: other
license_name: flux-1-dev-non-commercial-license
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
language:
  - en
tags:
  - flux
  - diffusers
  - lora
base_model: black-forest-labs/FLUX.1-schnell
pipeline_tag: text-to-image
instance_prompt: DOTTRMSTR
library_name: diffusers
inference:
  parameters:
    width: 1024
    height: 1024
widget:
  - text: >-
      DOTTRMSTR illustration. Scene: A charming wooden house sits on a lonely
      street, surrounded by nature on a bright and sunny day. The structure
      exudes a rustic, inviting vibe, with a thatched roof that adds a
      traditional and adventurous touch. The walls are made of thick, uneven
      logs in various shades of brown, giving the house an authentic, sturdy
      appearance. Entrance details: At the entrance, there'''s a wooden sign
      carved in the shape of a whale, hanging by thick ropes, adding a nautical
      feel to the scene. Next to the sign, a pair of wooden oars lean against
      the wall, hinting at the outdoor adventures that await here. The front
      entrance is simple yet welcoming, with a weathered wooden door and a small
      porch made of uneven planks. Atmosphere: The street is quiet, lined with
      tall trees whose branches filter the sunlight, casting playful shadows on
      the ground. The sky is a vibrant blue, with not a cloud in sight, and the
      air is filled with the freshness of the outdoors. Wild plants grow around
      the house, reinforcing the connection to nature. Additional touches:
      Adding some extra details, like an old bicycle leaning against the side of
      the house or a small extinguished campfire nearby, can evoke the outdoor
      lifestyle and adventurous spirit this place promises. The visual style in
      these images can be characterized as highly exaggerated and cartoonish,
      with a playful use of perspective and distortion.
    example_title: Wooden cabin
    output:
      url: samples/sample_1.png
  - text: >-
      DOTTRMSTR illustration. textured paper collage The paper texture is very
      visible. There are different textures. The papers are handmade painted
      with watercolor and crayons. An empty stylized game background scene using
      muted colors, mainly blue, yellow, orange, black and violet. A winding
      path crosses the screen, curving from the top left to the bottom right.
      Below the path, whimsical trees with irregular, bulbous shapes and
      playful, swirling bushes fill the scene. To the right stands a cozy,
      old-fashioned restaurant with large glass windows, through which warm,
      soft light spills onto the empty street. Inside, simple wooden tables and
      chairs are arranged neatly, but the restaurant is vacant, giving it a
      peaceful, quiet vibe. The restaurant's exterior features a large, aged
      wooden sign, slightly crooked, with an oversized fork carved into it and
      the text "Crespín Restorán" in quirky, uneven letters. Outside, a few
      tufts of grass poke through the cracks of the weathered sidewalk tiles,
      adding to the rustic charm. The night sky above is dark, with a crescent
      moon shining softly, casting gentle shadows. The street is empty and
      lonely, illuminated by a few antique-style street lamps that emit a dim,
      warm light, contrasting with the cold, bluish light of the street itself.
      The lamps are bent and irregular, with wavy lines, and their light creates
      playful, wavy reflections on the pavement. The visual style in these
      images can be characterized as highly exaggerated and car.
    example_title: Restaurant outdoor
    output:
      url: samples/sample_2.png
  - text: >-
      DOTTRMSTR illustration. The camera is positioned at the entrance of the
      café, offering a clear view of the charming and playful exterior: Café
      Entrance: The entrance to the café features a bright, welcoming façade
      with white wooden siding and a red-tiled roof. The back door is adorned
      with simple, colorful flower pots on either side. The door itself is
      framed with a cheerful design, including a decorative awning that provides
      shade and adds a touch of whimsy. Outdoor Seating Area: Directly in front
      of the entrance, there’s a cozy outdoor seating area. The tables and
      chairs are designed with playful elements, such as tables shaped like
      oversized pastries and chairs with coffee mug backrests. The design is
      simplified to avoid clutter but maintains the café’s cheerful theme.
      Decorative Elements: The walls around the entrance are adorned with
      minimal yet vibrant murals depicting coffee cups, cakes, and other
      café-themed items. There are also a few hanging lanterns or string lights
      to add a warm and inviting glow. Pathway: The pathway leading to the café
      entrance is made of colorful cobblestones, but the design is
      straightforward and not overly intricate. The path is lined with a few
      decorative plants and shrubs with bright, cartoonish features, but kept
      simple. Adjacent Features: To the sides of the entrance, you can see parts
      of the nearby areas, such as the adventure tourism shop and the retro
      appliance store
    example_title: Café outdoor
    output:
      url: samples/sample_3.png
  - text: >-
      DOTTRMSTR style game background. The interior of the very large hair salon
      is a vibrant and eccentric space with muted pink walls that radiate
      playful energy. The two-point perspective, with a slight fisheye
      distortion, adds a whimsical twist, making the space feel both expansive
      and intimate, with curved lines that soften the room’s edges. On the side
      walls, large mirrors framed by round, yellow bulbs evoke a vintage
      dressing room style, casting a warm, welcoming glow throughout the scene. 
      Mounted on the walls are several white Styrofoam mannequin heads, each
      showcasing brightly colored, extravagant wigs: giant curls, impossible
      buns, and towering beehive hairstyles. The heads are arranged irregularly,
      adding a surreal and quirky vibe to the space.  Below each mirror are
      tables cluttered with hairdressing tools, ranging from old-fashioned hair
      dryers and multi-colored brushes to retro-styled bottles of glitter and
      styling products, all with packaging that feels like a throwback to
      another era. Hanging from the ceiling are ornate, baroque chandeliers
      adorned with colorful crystals, adding an exaggerated touch of luxury and
      casting a soft sparkle that contrasts with the mirrors' bright lights.  At
      the back, a large window opens up to a breathtaking view of a quaint
      street with pastel-colored buildings. Beyond the street, the landscape
      dramatically shifts, with a cliff that drops off sharply into the ocean,
      whose blue waters shimmer under the sunlight. The view of the sea adds a
      surreal, almost dreamlike contrast to the colorful and over-the-top
      interior of the salon.  The overall atmosphere is one of unbridled fun,
      where every detail seems designed to surprise and delight, blending retro
      and extravagant elements into a cartoonish and exaggerated scene
    example_title: Hair Saloon indoor
    output:
      url: samples/sample_4.png
  - text: >-
      DOTTRMSTR style game background. The street is a charming, picturesque
      scene, with pastel-colored buildings lining the sidewalk, each one unique
      and quirky in its design. The cobblestone road adds a nostalgic, almost
      storybook quality to the environment. In the center of this lively street
      stands the hair salon, its exterior as bold and kitschy as its interior.
      The front of the salon is painted a vibrant pink, with exaggerated,
      rounded shapes framing the large, curved window that offers a glimpse into
      the colorful world inside. The building itself is slightly bulbous, with
      soft, irregular lines that make it feel almost like it's from a cartoon. 
      Above the entrance, a large, swirling sign reads ‘Fabulous Hair Salon’ in
      exaggerated, retro-style lettering, with neon lights blinking in different
      colors, giving the front an extra splash of character. The door is framed
      by playful, oversized decorations resembling hairstyling tools – a giant
      comb on one side and a pair of curling irons on the other – adding to the
      salon's eccentric flair.  Through the enormous window, you can see the
      bright pink interior, with glowing mirrors, mannequin heads adorned with
      colorful wigs, and chandeliers hanging from the ceiling, all inviting you
      into this whimsical space. The lighting from inside spills out onto the
      sidewalk, casting a warm, colorful glow that contrasts with the soft
      natural light of the street.  Beyond the street, there’s an unexpected
      shift in scenery – the street abruptly ends in a cliff, where the land
      drops off sharply into the vast, shimmering ocean below. The deep blue sea
      stretches out toward the horizon, providing a stunning, almost surreal
      backdrop to the lively and eccentric street. The contrast between the
      cozy, whimsical hair salon and the dramatic cliffside view creates a
      striking and dreamlike atmosphere, making the whole scene feel like it
      belongs in a vibrant, animated world.
    example_title: Hair Saloon outdoor
    output:
      url: samples/hair_saloon_outdoor.png
  - text: >-
      DOTTRMSTR style portrait of A man with extremely messy brown hair and
      thick sideburns stands in front of a bizarre machine. His hair is wild,
      sticking out in different directions, and his sideburns run down the sides
      of his face, blending into a scruffy, unkempt beard. His eyes have a
      crazed, almost unhinged look, with dark bags under them as if he hasn't
      slept in days. His expression is intense, with a crooked grin that adds to
      his unsettling appearance.  He is dressed in disheveled clothing that
      looks like it hasn't been washed in weeks. His shirt is wrinkled and
      half-tucked, with stains and tears throughout. His pants are mismatched,
      with one leg shorter than the other, and they are covered in patches of
      dirt. The outfit seems thrown together haphazardly, as if he grabbed
      whatever was closest. Despite this, he wears extremely tall platform
      shoes, giving the impression that he's trying to appear taller than he
      actually is, perhaps to compensate for his short stature. The shoes are so
      high that they force him to walk awkwardly, with an unnatural gait.  In
      his arms, he holds the lifeless body of a massive English Mastiff, its fur
      matted and its eyes closed. The dog is heavy, and the man struggles to
      carry it, but he seems determined. He approaches a strange machine, which
      looks like a large, old-fashioned contraption with pipes, levers, and
      glowing lights. The machine is making mechanical noises, and as he feeds
      the body of the Mastiff into it, small clones of the dog begin to emerge
      from the other side. These clones are tiny, barely the size of a small
      toy, and they are exact replicas of the original dog, down to the droopy
      jowls and sad eyes. The man watches the process with a mix of satisfaction
      and insanity, his crazed eyes fixated on the clones as they pile up on the
      floor around the machine.  The room around him is dimly lit, with a grimy
      floor and peeling wallpaper. The entire scene feels chaotic and surreal,
      with a sense of dark humor mixed with horror.
    example_title: The dog cloner
    output:
      url: samples/dog_cloner.png
  - text: >-
      Wacky 2d game illustration DOTTRMSTR style portrait of A man with
      extremely messy brown hair and thick sideburns stands in front of a
      bizarre machine. His hair is wild, sticking out in different directions,
      and his sideburns run down the sides of his face, blending into a scruffy,
      unkempt beard. His eyes have a crazed, almost unhinged look, with dark
      bags under them as if he hasn't slept in days. His expression is intense,
      with a crooked grin that adds to his unsettling appearance.  He is dressed
      in disheveled clothing that looks like it hasn't been washed in weeks. His
      shirt is wrinkled and half-tucked, with stains and tears throughout. His
      pants are mismatched, with one leg shorter than the other, and they are
      covered in patches of dirt. The outfit seems thrown together haphazardly,
      as if he grabbed whatever was closest. Despite this, he wears extremely
      tall platform shoes, giving the impression that he's trying to appear
      taller than he actually is, perhaps to compensate for his short stature.
      The shoes are so high that they force him to walk awkwardly, with an
      unnatural gait.  In his arms, he holds the lifeless body of a massive
      English Mastiff, its fur matted and its eyes closed. The dog is heavy, and
      the man struggles to carry it, but he seems determined. He approaches a
      strange machine, which looks like a large, old-fashioned contraption with
      pipes, levers, and glowing lights. The machine is making mechanical
      noises, and as he feeds the body of the Mastiff into it, small clones of
      the dog begin to emerge from the other side. These clones are tiny, barely
      the size of a small toy, and they are exact replicas of the original dog,
      down to the droopy jowls and sad eyes. The man watches the process with a
      mix of satisfaction and insanity, his crazed eyes fixated on the clones as
      they pile up on the floor around the machine.  The room around him is
      dimly lit, with a grimy floor and peeling wallpaper. The entire scene
      feels chaotic and surreal, with a sense of dark humor mixed with horror.
    output:
      url: images/example_cdzt7mncp.png

Flux Dott Remastered

Trained on Replicate using:

https://replicate.com/ostris/flux-dev-lora-trainer/train

Trigger words

You should use DOTTRMSTR to trigger the image generation.

Use it with the 🧨 diffusers library

from diffusers import AutoPipelineForText2Image
import torch

pipeline = AutoPipelineForText2Image.from_pretrained('black-forest-labs/FLUX.1-dev', torch_dtype=torch.float16).to('cuda')
pipeline.load_lora_weights('lichorosario/flux-dott-remastered', weight_name='lora.safetensors')
image = pipeline('your prompt').images[0]
Prompt
DOTTRMSTR illustration. Scene: A charming wooden house sits on a lonely street, surrounded by nature on a bright and sunny day. The structure exudes a rustic, inviting vibe, with a thatched roof that adds a traditional and adventurous touch. The walls are made of thick, uneven logs in various shades of brown, giving the house an authentic, sturdy appearance. Entrance details: At the entrance, there'''s a wooden sign carved in the shape of a whale, hanging by thick ropes, adding a nautical feel to the scene. Next to the sign, a pair of wooden oars lean against the wall, hinting at the outdoor adventures that await here. The front entrance is simple yet welcoming, with a weathered wooden door and a small porch made of uneven planks. Atmosphere: The street is quiet, lined with tall trees whose branches filter the sunlight, casting playful shadows on the ground. The sky is a vibrant blue, with not a cloud in sight, and the air is filled with the freshness of the outdoors. Wild plants grow around the house, reinforcing the connection to nature. Additional touches: Adding some extra details, like an old bicycle leaning against the side of the house or a small extinguished campfire nearby, can evoke the outdoor lifestyle and adventurous spirit this place promises. The visual style in these images can be characterized as highly exaggerated and cartoonish, with a playful use of perspective and distortion.
Prompt
DOTTRMSTR illustration. textured paper collage The paper texture is very visible. There are different textures. The papers are handmade painted with watercolor and crayons. An empty stylized game background scene using muted colors, mainly blue, yellow, orange, black and violet. A winding path crosses the screen, curving from the top left to the bottom right. Below the path, whimsical trees with irregular, bulbous shapes and playful, swirling bushes fill the scene. To the right stands a cozy, old-fashioned restaurant with large glass windows, through which warm, soft light spills onto the empty street. Inside, simple wooden tables and chairs are arranged neatly, but the restaurant is vacant, giving it a peaceful, quiet vibe. The restaurant's exterior features a large, aged wooden sign, slightly crooked, with an oversized fork carved into it and the text "Crespín Restorán" in quirky, uneven letters. Outside, a few tufts of grass poke through the cracks of the weathered sidewalk tiles, adding to the rustic charm. The night sky above is dark, with a crescent moon shining softly, casting gentle shadows. The street is empty and lonely, illuminated by a few antique-style street lamps that emit a dim, warm light, contrasting with the cold, bluish light of the street itself. The lamps are bent and irregular, with wavy lines, and their light creates playful, wavy reflections on the pavement. The visual style in these images can be characterized as highly exaggerated and car.
Prompt
DOTTRMSTR illustration. The camera is positioned at the entrance of the café, offering a clear view of the charming and playful exterior: Café Entrance: The entrance to the café features a bright, welcoming façade with white wooden siding and a red-tiled roof. The back door is adorned with simple, colorful flower pots on either side. The door itself is framed with a cheerful design, including a decorative awning that provides shade and adds a touch of whimsy. Outdoor Seating Area: Directly in front of the entrance, there’s a cozy outdoor seating area. The tables and chairs are designed with playful elements, such as tables shaped like oversized pastries and chairs with coffee mug backrests. The design is simplified to avoid clutter but maintains the café’s cheerful theme. Decorative Elements: The walls around the entrance are adorned with minimal yet vibrant murals depicting coffee cups, cakes, and other café-themed items. There are also a few hanging lanterns or string lights to add a warm and inviting glow. Pathway: The pathway leading to the café entrance is made of colorful cobblestones, but the design is straightforward and not overly intricate. The path is lined with a few decorative plants and shrubs with bright, cartoonish features, but kept simple. Adjacent Features: To the sides of the entrance, you can see parts of the nearby areas, such as the adventure tourism shop and the retro appliance store
Prompt
DOTTRMSTR style game background. The interior of the very large hair salon is a vibrant and eccentric space with muted pink walls that radiate playful energy. The two-point perspective, with a slight fisheye distortion, adds a whimsical twist, making the space feel both expansive and intimate, with curved lines that soften the room’s edges. On the side walls, large mirrors framed by round, yellow bulbs evoke a vintage dressing room style, casting a warm, welcoming glow throughout the scene. Mounted on the walls are several white Styrofoam mannequin heads, each showcasing brightly colored, extravagant wigs: giant curls, impossible buns, and towering beehive hairstyles. The heads are arranged irregularly, adding a surreal and quirky vibe to the space. Below each mirror are tables cluttered with hairdressing tools, ranging from old-fashioned hair dryers and multi-colored brushes to retro-styled bottles of glitter and styling products, all with packaging that feels like a throwback to another era. Hanging from the ceiling are ornate, baroque chandeliers adorned with colorful crystals, adding an exaggerated touch of luxury and casting a soft sparkle that contrasts with the mirrors' bright lights. At the back, a large window opens up to a breathtaking view of a quaint street with pastel-colored buildings. Beyond the street, the landscape dramatically shifts, with a cliff that drops off sharply into the ocean, whose blue waters shimmer under the sunlight. The view of the sea adds a surreal, almost dreamlike contrast to the colorful and over-the-top interior of the salon. The overall atmosphere is one of unbridled fun, where every detail seems designed to surprise and delight, blending retro and extravagant elements into a cartoonish and exaggerated scene
Prompt
DOTTRMSTR style game background. The street is a charming, picturesque scene, with pastel-colored buildings lining the sidewalk, each one unique and quirky in its design. The cobblestone road adds a nostalgic, almost storybook quality to the environment. In the center of this lively street stands the hair salon, its exterior as bold and kitschy as its interior. The front of the salon is painted a vibrant pink, with exaggerated, rounded shapes framing the large, curved window that offers a glimpse into the colorful world inside. The building itself is slightly bulbous, with soft, irregular lines that make it feel almost like it's from a cartoon. Above the entrance, a large, swirling sign reads ‘Fabulous Hair Salon’ in exaggerated, retro-style lettering, with neon lights blinking in different colors, giving the front an extra splash of character. The door is framed by playful, oversized decorations resembling hairstyling tools – a giant comb on one side and a pair of curling irons on the other – adding to the salon's eccentric flair. Through the enormous window, you can see the bright pink interior, with glowing mirrors, mannequin heads adorned with colorful wigs, and chandeliers hanging from the ceiling, all inviting you into this whimsical space. The lighting from inside spills out onto the sidewalk, casting a warm, colorful glow that contrasts with the soft natural light of the street. Beyond the street, there’s an unexpected shift in scenery – the street abruptly ends in a cliff, where the land drops off sharply into the vast, shimmering ocean below. The deep blue sea stretches out toward the horizon, providing a stunning, almost surreal backdrop to the lively and eccentric street. The contrast between the cozy, whimsical hair salon and the dramatic cliffside view creates a striking and dreamlike atmosphere, making the whole scene feel like it belongs in a vibrant, animated world.
Prompt
DOTTRMSTR style portrait of A man with extremely messy brown hair and thick sideburns stands in front of a bizarre machine. His hair is wild, sticking out in different directions, and his sideburns run down the sides of his face, blending into a scruffy, unkempt beard. His eyes have a crazed, almost unhinged look, with dark bags under them as if he hasn't slept in days. His expression is intense, with a crooked grin that adds to his unsettling appearance. He is dressed in disheveled clothing that looks like it hasn't been washed in weeks. His shirt is wrinkled and half-tucked, with stains and tears throughout. His pants are mismatched, with one leg shorter than the other, and they are covered in patches of dirt. The outfit seems thrown together haphazardly, as if he grabbed whatever was closest. Despite this, he wears extremely tall platform shoes, giving the impression that he's trying to appear taller than he actually is, perhaps to compensate for his short stature. The shoes are so high that they force him to walk awkwardly, with an unnatural gait. In his arms, he holds the lifeless body of a massive English Mastiff, its fur matted and its eyes closed. The dog is heavy, and the man struggles to carry it, but he seems determined. He approaches a strange machine, which looks like a large, old-fashioned contraption with pipes, levers, and glowing lights. The machine is making mechanical noises, and as he feeds the body of the Mastiff into it, small clones of the dog begin to emerge from the other side. These clones are tiny, barely the size of a small toy, and they are exact replicas of the original dog, down to the droopy jowls and sad eyes. The man watches the process with a mix of satisfaction and insanity, his crazed eyes fixated on the clones as they pile up on the floor around the machine. The room around him is dimly lit, with a grimy floor and peeling wallpaper. The entire scene feels chaotic and surreal, with a sense of dark humor mixed with horror.
Prompt
Wacky 2d game illustration DOTTRMSTR style portrait of A man with extremely messy brown hair and thick sideburns stands in front of a bizarre machine. His hair is wild, sticking out in different directions, and his sideburns run down the sides of his face, blending into a scruffy, unkempt beard. His eyes have a crazed, almost unhinged look, with dark bags under them as if he hasn't slept in days. His expression is intense, with a crooked grin that adds to his unsettling appearance. He is dressed in disheveled clothing that looks like it hasn't been washed in weeks. His shirt is wrinkled and half-tucked, with stains and tears throughout. His pants are mismatched, with one leg shorter than the other, and they are covered in patches of dirt. The outfit seems thrown together haphazardly, as if he grabbed whatever was closest. Despite this, he wears extremely tall platform shoes, giving the impression that he's trying to appear taller than he actually is, perhaps to compensate for his short stature. The shoes are so high that they force him to walk awkwardly, with an unnatural gait. In his arms, he holds the lifeless body of a massive English Mastiff, its fur matted and its eyes closed. The dog is heavy, and the man struggles to carry it, but he seems determined. He approaches a strange machine, which looks like a large, old-fashioned contraption with pipes, levers, and glowing lights. The machine is making mechanical noises, and as he feeds the body of the Mastiff into it, small clones of the dog begin to emerge from the other side. These clones are tiny, barely the size of a small toy, and they are exact replicas of the original dog, down to the droopy jowls and sad eyes. The man watches the process with a mix of satisfaction and insanity, his crazed eyes fixated on the clones as they pile up on the floor around the machine. The room around him is dimly lit, with a grimy floor and peeling wallpaper. The entire scene feels chaotic and surreal, with a sense of dark humor mixed with horror.
Prompt
wacky 2d game illustration distorted lens DOTTRMSTR illustration. The camera is positioned at the entrance of the café, offering a clear view of the charming and playful exterior: Café Entrance: The entrance to the café features a bright, welcoming façade with white wooden siding and a red-tiled roof. The back door is adorned with simple, colorful flower pots on either side. The door itself is framed with a cheerful design, including a decorative awning that provides shade and adds a touch of whimsy. Outdoor Seating Area: Directly in front of the entrance, there’s a cozy outdoor seating area. The tables and chairs are designed with playful elements, such as tables shaped like oversized pastries and chairs with coffee mug backrests. The design is simplified to avoid clutter but maintains the café’s cheerful theme. Decorative Elements: The walls around the entrance are adorned with minimal yet vibrant murals depicting coffee cups, cakes, and other café-themed items. There are also a few hanging lanterns or string lights to add a warm and inviting glow. Pathway: The pathway leading to the café entrance is made of colorful cobblestones, but the design is straightforward and not overly intricate. The path is lined with a few decorative plants and shrubs with bright, cartoonish features, but kept simple. Adjacent Features: To the sides of the entrance, you can see parts of the nearby areas, such as the adventure tourism shop and the retro appliance store
Prompt
DOTTRMSTR wacky 2d game illustration. the entrance of a winding path over a grassy hill leading to a casino at the top
Prompt
DOTTRMSTR style wacky 2d game illustration using bending shapes. the entrance of a winding path over a grassy hill leading to a white luxurious casino at the top. There is a big sign at the entrance in the shape of poker cards
Prompt
DOTTRMSTR style wacky 2d game illustration using bending shapes. the entrance of a winding path over a grassy hill leading to a white luxurious casino at the top. There is a big sign at the entrance in the shape of poker cards
Prompt
DOTTRMSTR style wacky 2d game illustration using bending shapes. the entrance of a winding path over a grassy hill leading to a white luxurious casino at the top. There is a big sign at the base hill path entrance in the shape of poker cards
Prompt
DOTTRMSTR style wacky 2d game illustration using bending shapes. the entrance of a winding path over a grassy hill leading to a white luxurious casino at the top. There is a big sign at the base hill path entrance in the shape of poker cards
Prompt
DOTTRMSTR style wacky 2d game illustration using bending shapes. the entrance of a winding path over a grassy hill leading to a white luxurious casino at the top. There is a big sign at the base hill path entrance in the shape of poker cards. At the hill base another path crosses the screen horizontally

For more details, including weighting, merging and fusing LoRAs, check the documentation on loading LoRAs in diffusers