FAQ
What is TinyLlama-1.1B-Chat-v0.3-GPTQ used for?
See the Use cases section above.
Is TinyLlama-1.1B-Chat-v0.3-GPTQ free to use?
TinyLlama-1.1B-Chat-v0.3-GPTQ is an open-source model published on HuggingFace. License terms vary by model — check the model card for the specific license.
How do I run TinyLlama-1.1B-Chat-v0.3-GPTQ locally?
Most HuggingFace models can be loaded with transformers or the appropriate framework library. See the model card for framework-specific instructions and hardware requirements.
Tags
transformerssafetensorsllamatext-generationendataset:cerebras/SlimPajama-627Bdataset:bigcode/starcoderdatadataset:OpenAssistant/oasst_top1_2023-08-25base_model:TinyLlama/TinyLlama-1.1B-Chat-v0.3base_model:quantized:TinyLlama/TinyLlama-1.1B-Chat-v0.3license:apache-2.0text-generation-inference4-bitgptqdeploy:azureregion:us