Qwen3-4B · AWQ W4A16
v0.1.0A pinned AWQ W4A16 recipe targeting compressed-tensors export and vLLM inference. Dataset selection remains an explicit planning blocker.
Explore compression recipes for open models.
Find the right method. Inspect every detail. Make it yours.
A pinned AWQ W4A16 recipe targeting compressed-tensors export and vLLM inference. Dataset selection remains an explicit planning blocker.
A pinned AWQ smoke recipe with explicit calibration and evaluation data, assistant-continuation loss v2, and a declared 16 GiB CUDA target. Execution acceptance remains blocked.
The details you need, before you run.
Explore models, compression methods, and declared hardware targets.
Review compatibility, planning blockers, and available evidence.
Download the exact YAML and validate it locally with lazybrick.