Image-to-Video
Diffusers
Safetensors
LTX.io
lora
ltx-2
ltx-2-3
ltx-2.3
ltx-video
lightricks
audio-to-video
text-to-video
image-text-to-audio-video
audio-reactive
audio-reactive-video
music-visualizer
beat-sync
geometric-animation
music-video
video-generation
template:diffusion-lora
Instructions to use fal/ltx2.3-audio-reactive-lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use fal/ltx2.3-audio-reactive-lora with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Lightricks/LTX-2.3", torch_dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("fal/ltx2.3-audio-reactive-lora") prompt = "A man with short gray hair plays a red electric guitar." input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png") image = pipe(image=input_image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - LTX.io
How to use fal/ltx2.3-audio-reactive-lora with LTX.io:
# Install the LTX-2 pipelines git clone https://github.com/Lightricks/LTX-2.git cd LTX-2 uv sync --frozen
# Download the weights from this repo, plus the Gemma text encoder hf download fal/ltx2.3-audio-reactive-lora --local-dir models/ltx2.3-audio-reactive-lora hf download google/gemma-3-12b-it-qat-q4_0-unquantized --local-dir models/gemma-3-12b
# Text/image-to-video with the LoRA on the HQ two-stage base pipeline uv run python -m ltx_pipelines.ti2vid_two_stages_hq \ --checkpoint-path path/to/checkpoint.safetensors \ --distilled-lora path/to/distilled_lora.safetensors 0.8 \ --spatial-upsampler-path path/to/spatial_upsampler.safetensors \ --gemma-root models/gemma-3-12b \ --lora models/ltx2.3-audio-reactive-lora/<weights>.safetensors 1.0 \ --prompt "your prompt here" \ --output-path output.mp4 # For image-to-video, add: --image path/to/image.jpg 0 0.8 - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
Looks really fun but casual users like me can't use it without a workflow
#1
by positiveelevation - opened
Dot.
Just a quick test run...
Any custom audio input workflow will do. Where you can upload an an audio, and select the Fal lora.
Can try some here if you want https://huggingface.co/RuneXX/LTX-2.3-Workflows/tree/main/Custom-Audio
(or any other custom audio workflow around.. )
another test run