awq-quantization

Activation-aware weight quantization for 4-bit LLM compression with 3x speedup and minimal accuracy loss. Use when deploying large models (7B-70B) on limited…

npx skills add https://github.com/firecrawl/ai-research-skills --skill awq-quantization

More skills from firecrawl