FAQ
What is Qwen2.5-1.5B-quantized.w8a8 used for?
See the Use cases section above.
Is Qwen2.5-1.5B-quantized.w8a8 free to use?
Qwen2.5-1.5B-quantized.w8a8 is an open-source model published on HuggingFace. License terms vary by model — check the model card for the specific license.
How do I run Qwen2.5-1.5B-quantized.w8a8 locally?
Most HuggingFace models can be loaded with transformers or the appropriate framework library. See the model card for framework-specific instructions and hardware requirements.
Tags
safetensorsqwen2chatneuralmagicllmcompressortext-generationconversationalenbase_model:Qwen/Qwen2.5-1.5Bbase_model:quantized:Qwen/Qwen2.5-1.5Blicense:apache-2.08-bitcompressed-tensorsregion:us