SkyReels-V2-T2V-14B-540P-Diffusers

Instala las dependencias y carga el modelo con Diffusers. El siguiente ejemplo genera un video de 97 fotogramas y lo guarda como video.mp4:

pip install -U diffusers transformers accelerate ftfy

import torch
from diffusers import AutoModel, SkyReelsV2Pipeline, UniPCMultistepScheduler
from diffusers.utils import export_to_video

model_id = "Skywork/SkyReels-V2-T2V-14B-540P-Diffusers"

vae = AutoModel.from_pretrained(
    model_id,
    subfolder="vae",
    torch_dtype=torch.float32,
)

pipeline = SkyReelsV2Pipeline.from_pretrained(
    model_id,
    vae=vae,
    torch_dtype=torch.bfloat16,
)

pipeline.scheduler = UniPCMultistepScheduler.from_config(
    pipeline.scheduler.config,
    flow_shift=8.0,
)
pipeline = pipeline.to("cuda")

prompt = (
    "A cat and a dog baking a cake together in a kitchen. "
    "The cat is carefully measuring flour, while the dog is "
    "stirring the batter with a wooden spoon."
)

frames = pipeline(
    prompt=prompt,
    num_inference_steps=50,
    height=544,
    width=960,
    num_frames=97,
).frames[0]

export_to_video(frames, "video.mp4", fps=24, quality=8)