THE LLAMA FAMILY OF LARGE LANGUAGE MODELS
| Model Name | Parameters | Quantization | Input Type | Output Type |
|---|---|---|---|---|
| Llama 3.1 | 8B | -- | Text | Text |
| Llama 3.1 Instruct | 8B | -- | Text | Text |
| Llama 3.1 | 70B | -- | Text | Text |
| Llama 3.1 Instruct | 70B | -- | Text | Text |
| Llama 3.1 | 405B | FP8 | Text | Text |
| Llama 3.1 Instruct | 405B | FP8 | Text | Text |
| Llama 3.1 | 405B | -- | Text | Text |
| Llama 3.1 Instruct | 405B | -- | Text | Text |
| Llama 3.2 | 1B | -- | Text | Text |
| Llama 3.2 Instruct | 1B | -- | Text | Text |
| Llama 3.2 Instruct | 1B | SpinQuant_INT4_EO8 | Text | Text |
| Llama 3.2 Instruct | 1B | QLORA_INT4 | Text | Text |
| Llama 3.2 | 3B | -- | Text | Text |
| Llama 3.2 Instruct | 3B | -- | Text | Text |
| Llama 3.2 Instruct | 3B | SpinQuant_INT4_EO8 | Text | Text |
| Llama 3.2 Instruct | 3B | QLORA_INT4 | Text | Text |
| Llama 3.2 Vision | 11B | -- | Text/Image | Text |
| Llama 3.2 Vision Instruct | 11B | -- | Text/Image | Text |
| Llama 3.2 Vision | 90B | -- | Text/Image | Text |
| Llama 3.2 Vision Instruct | 90B | -- | Text/Image | Text |
| Llama 3.3 Instruct | 70B | -- | Text | Text |