strangerzonehf/Flux-Sketch-Smudge-LoRA

Instalación y uso con Diffusers:

pip install -U diffusers transformers accelerate

import torch
from diffusers import DiffusionPipeline

# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained(
    "black-forest-labs/FLUX.1-dev",
    dtype=torch.bfloat16,
    device_map="cuda"
)
pipe.load_lora_weights("strangerzonehf/Flux-Sketch-Smudge-LoRA")

prompt = "Sketch Smudge, A gray and white drawing of a womans head is depicted on a white canvas background. The womans face is facing the left side of the frame, her eyes are open and her lips are slightly parted. Her hair is long and cascades over her shoulders. She is wearing a gray knitted cap, and a white scarf around her neck. The background is a vibrant red, and the womans neck is adorned with a white design."
image = pipe(prompt).images[0]

Configuración alternativa indicada en la tarjeta del modelo:

import torch
from pipelines import DiffusionPipeline

base_model = "black-forest-labs/FLUX.1-dev"
pipe = DiffusionPipeline.from_pretrained(base_model, torch_dtype=torch.bfloat16)

lora_repo = "strangerzonehf/Flux-Sketch-Smudge-LoRA"
trigger_word = "Sketch Smudge"
pipe.load_lora_weights(lora_repo)

device = torch.device("cuda")
pipe.to(device)

Para obtener el estilo del modelo, el prompt debe incluir "Sketch Smudge" al inicio o dentro de la descripción.