lazybrickhub

Explore recipes

Find a starting point for your next smaller model.

All recipes 2

2 recipe versions

Qwen3-4B · AWQ W4A16

v0.1.0

A pinned AWQ W4A16 recipe targeting compressed-tensors export and vLLM inference. Dataset selection remains an explicit planning blocker.

  • Qwen3
  • AWQ
  • W4A16
  • vLLM
  • compressed-tensors
PlannedPlanning blockedNot measured
NVIDIA CUDA · 40 GiB target

Qwen3-0.6B · AWQ W4A16

v0.1.0

A pinned AWQ smoke recipe with explicit calibration and evaluation data, assistant-continuation loss v2, and a declared 16 GiB CUDA target. Execution acceptance remains blocked.

  • Qwen3
  • AWQ
  • W4A16
  • vLLM
  • compressed-tensors
PlannedPlanning blockedNot measured
NVIDIA CUDA · 16 GiB target