FAQ
What is Llama-3.2-1B-Instruct-FP8 used for?
See the Use cases section above.
Is Llama-3.2-1B-Instruct-FP8 free to use?
Llama-3.2-1B-Instruct-FP8 is an open-source model published on HuggingFace. License terms vary by model — check the model card for the specific license.
How do I run Llama-3.2-1B-Instruct-FP8 locally?
Most HuggingFace models can be loaded with transformers or the appropriate framework library. See the model card for framework-specific instructions and hardware requirements.
Tags
safetensorsllamallama-3neuralmagicllmcompressortext-generationconversationalendefritpthiesthbase_model:meta-llama/Llama-3.2-1B-Instructbase_model:quantized:meta-llama/Llama-3.2-1B-Instructlicense:llama3.2compressed-tensorsregion:us