FAQ
What is Qwen2.5-Coder-7B-Instruct-GPTQ-Int4 used for?
See the Use cases section above.
Is Qwen2.5-Coder-7B-Instruct-GPTQ-Int4 free to use?
Qwen2.5-Coder-7B-Instruct-GPTQ-Int4 is an open-source model published on HuggingFace. License terms vary by model — check the model card for the specific license.
How do I run Qwen2.5-Coder-7B-Instruct-GPTQ-Int4 locally?
Most HuggingFace models can be loaded with transformers or the appropriate framework library. See the model card for framework-specific instructions and hardware requirements.
Tags
transformerssafetensorsqwen2text-generationcodecodeqwenchatqwenqwen-coderconversationalenarxiv:2409.12186arxiv:2309.00071arxiv:2407.10671base_model:Qwen/Qwen2.5-Coder-7B-Instructbase_model:quantized:Qwen/Qwen2.5-Coder-7B-Instructlicense:apache-2.0text-generation-inferenceendpoints_compatible4-bit