LLM
TinyLlama-1-1B-Chat-v1-0-Q4_K_M-GGUF-4Bit
None|1100000000 parameters
High-quality 4-bit Q4_K_M GGUF quantized TinyLlama 1.1B chat model offering the best balance of performance, memory efficiency, and response quality in the TinyLlama family.
VARIANTS
0
formats available
SMALLEST
0 MB
best compressed
BEST ACCURACY
0%
top variant
DOWNLOADS
0
total
DOWNLOAD VARIANT
TinyLlama-1-1B-Chat-v1-0-Q4_K_M-GGUF-4Bit
SELECT FORMAT
BENCHMARKS
USAGE
HARDWARE GUIDE
MODEL CARD
VARIANT COMPARISON
Accuracy vs. Size Tradeoff
Every variant is benchmarked against the FP16 baseline. Choose the right balance of accuracy and footprint for your workflow.
Benchmarks are performed on representative hardware. Accuracy is relative to model FP16 baseline.
| VARIANT | FORMAT | SIZE | PERPLEXITY | ACCURACY | LATENCY | BEST FOR | DOWNLOAD |
|---|---|---|---|---|---|---|---|
| FP16 (baseline) | — | 770.00 MB | -- | 100% | — | Reference only | — |
ACCURACY RETENTION BY VARIANT (%)
FILE SIZE BY VARIANT (MB)
FP16 base770.00 MB