FAQ
What is Llama-3.1-8B-Instruct-FP8 used for?
See the Use cases section above.
Is Llama-3.1-8B-Instruct-FP8 free to use?
Llama-3.1-8B-Instruct-FP8 is an open-source model published on HuggingFace. License terms vary by model — check the model card for the specific license.
How do I run Llama-3.1-8B-Instruct-FP8 locally?
Most HuggingFace models can be loaded with transformers or the appropriate framework library. See the model card for framework-specific instructions and hardware requirements.
Tags
transformerssafetensorsllamatext-generationconversationalbase_model:meta-llama/Llama-3.1-8B-Instructbase_model:finetune:meta-llama/Llama-3.1-8B-Instructlicense:llama3.1text-generation-inferenceendpoints_compatibleregion:us