← ImageLoRA · All LoRA guides

FLUX.3 Image Klein LoRA training with ai-toolkit: setup guide

Setting up ai-toolkit to train a FLUX.3 Image Klein LoRA: support status, the settings known to work, and links to the docs. Status in ai-toolkit: supported (day-0, PR #1078 merged Oct 15; fixes Oct 15).

About ai-toolkit

Ostris' trainer with a web UI and YAML configs; widest day-0 support for new image models, and the easiest option for Flux/Krea. Sources: github.com/ostris/ai-toolkit, www.reddit.com/r/StableDiffusion/comments/1vrkd5x/which_platform_shoul

ai-toolkit-specific notes for FLUX.3 Image Klein

• ai-toolkit edit training with several control images used only one until a fix on Oct 17; update before training edit LoRAs

VRAM

SimpleTuner recipes: Base from 24 GB (512px, batch 3) up to 144 GB; distilled klein at 24 GB (768px, batch 1) or 80 GB (1024px, batch 4)

Settings that work for FLUX.3 Image Klein (any trainer)

• Open weights, gated on Hugging Face: click 'Agree and access' on the model page or downloads fail with 403
• Mixed early reception; watch for anatomy issues
• Base model sampling: ~50 steps, CFG 3.5
• LoRA strength ~1.3 at inference
• Character LoRAs come out weak at the default rank 16/32; go higher
• SimpleTuner recipes: rank-32 LoRA, LR 1e-4, REPA; distilled klein auto-loads a published training-assistant LoRA (strength 1.0 in training, 0.0 at validation; disable_assistant_lora to turn off)
• ai-toolkit edit training with several control images used only one until a fix on Oct 17; update before training edit LoRAs
• A FLUX.2 dataset and recipe carried over unchanged doesn't work well; long upsampled prompts with JSON bounding boxes at ~2 MP sample better
• diffusers v0.42.0 (Oct 23) supports FLUX.3 Image Klein Base and distilled through ModularPipeline only (ModularPipeline.from_pretrained, then load_components), with the prompt upsampler and BFL FP8 and NVFP4 checkpoints. Needs Python 3.11+
• Train and generate at 1.5k resolution or higher rather than 1k; the VAE holds it back at 1k
• Fast previews of a klein base LoRA: the FLUX.3 klein turbo PDD LoRA runs base at 8 or 4 steps with CFG distilled in (text to image; image to image loses quality)

General tips

• Gated Hugging Face models: click 'Agree and access' on each model page, or you'll get 403 errors
• Steps scale with dataset size (steps = epochs x images at batch 1)
• A safe start: LoKr with auto rank (~64), batch/grad accumulation 4
• Leave out of your captions whatever you want burned into the LoRA; caption what should stay changeable
• ai-toolkit dataset folder weights let you train the same images with long, medium and short captions in separate folders
• ai-toolkit supports validation loss, which shows when a run stops improving
• In ai-toolkit, Cache text embeddings works for basically every model and frees the text encoder from VRAM and RAM
• Prefer int8 convrot over qfloat8 quantization in ai-toolkit: better quality at the same memory
• Gradient accumulation and batch size don't scale the learning rate in ai-toolkit; a bigger batch needs about 1.5-2.5x the steps

Compare with other trainers

• ai-toolkit vs SimpleTuner for FLUX.3 Image Klein
• FLUX.3 Image Klein LoRA with SimpleTuner
• FLUX.3 Image Klein (overview)

Where to rent a 16 GB+ GPU

Cheapest 16 GB+ cards (2026-10-20 08:06 UTC) from RunPod and Vast.ai. Prices move constantly; see the live price table.

Sources

• huggingface.co/black-forest-labs/flux-3-image-klein-base
• github.com/ostris/ai-toolkit/pull/1078
• github.com/ostris/ai-toolkit/commit/438595b
• github.com/ostris/ai-toolkit/commit/0947356
• github.com/bghira/SimpleTuner/blob/main/documentation/quickstart/FLUX3
• github.com/bghira/SimpleTuner/commit/1cc48ca
• huggingface.co/SimpleTuner/flux-3-klein-image-training-assistant
• github.com/ostris/ai-toolkit/commit/9d408eb
• github.com/huggingface/diffusers/releases/tag/v0.42.0
• huggingface.co/NoiseToNova/Flux-3-Klein-turbo-pdd-4_8-steps
• github.com/ostris/ai-toolkit
• www.reddit.com/r/StableDiffusion/comments/1vrkd5x/which_platform_shoul

FAQ

Does ai-toolkit support FLUX.3 Image Klein?

Yes: supported (day-0, PR #1078 merged Oct 15; fixes Oct 15) (see sources below).

How much VRAM do I need for a FLUX.3 Image Klein LoRA?

SimpleTuner recipes: Base from 24 GB (512px, batch 3) up to 144 GB; distilled klein at 24 GB (768px, batch 1) or 80 GB (1024px, batch 4)

Data updated 2026-10-20. Disclosure: RunPod and Vast.ai links are referral links; ImageLoRA may earn a commission at no cost to you. unknown = no data yet. · Raw data (JSON) · llms.txt