Wan2.1-T2V-1.3B-3dgs-v0

Instalación y carga directa con Diffusers:

pip install -U diffusers transformers accelerate

import torch
from diffusers import DiffusionPipeline

# Cambia a "mps" para dispositivos Apple
pipe = DiffusionPipeline.from_pretrained(
    "finetrainers/Wan2.1-T2V-1.3B-3dgs-v0",
    torch_dtype=torch.bfloat16,
    device_map="cuda"
)

prompt = "3DGS_DISSOLVE A lone sailor grips the helm as towering waves crash against the boat. Lightning splits the sky, illuminating the chaotic sea. The storm intensifies, but then, as if merging with the elements, the sailor's figure slowly transforms into a cascade of red sparks, scattering into the wind."
image = pipe(prompt).images[0]

Uso como adaptador LoRA sobre el modelo base Wan2.1:

import torch
from diffusers import WanPipeline
from diffusers.utils import export_to_video

pipe = WanPipeline.from_pretrained(
    "Wan-AI/Wan2.1-T2V-1.3B-Diffusers",
    torch_dtype=torch.bfloat16
).to("cuda")

pipe.load_lora_weights(
    "finetrainers/Wan2.1-T2V-1.3B-3dgs-v0",
    adapter_name="wan-lora"
)
pipe.set_adapters(["wan-lora"], [0.5])

video = pipe("").frames[0]
export_to_video(video, "output.mp4", fps=24)

Para provocar el efecto aprendido, el prompt debe comenzar con 3DGS_DISSOLVE. El peso del adaptador, mostrado como 0.5, puede ajustarse para controlar su influencia.