| Qwen2.5 0.5B Instruct | 494M | Fits | Fits | Fits | 32K |
| TinyLlama 1.1B Chat v1.0 | 1.1B | Fits | Fits | Fits | 2K |
| Llama 3.2 1B Instruct | 1.2B | Fits | Fits | Fits | 128K |
| Qwen2.5 1.5B Instruct | 1.5B | Fits | Fits | Fits | 32K |
| Qwen2.5-Coder 1.5B Instruct | 1.5B | Fits | Fits | Fits | 32K |
| SmolLM2 1.7B Instruct | 1.7B | Fits | Fits | Fits | 8K |
| Gemma 2 2B Instruct | 2.6B | Fits | Fits | Fits | 8K |
| Qwen2.5 3B Instruct | 3.1B | Fits | Fits | Fits | 32K |
| Llama 3.2 3B Instruct | 3.2B | Fits | Fits | Fits | 64K |
| Phi-3.5 Mini Instruct | 3.8B | Fits | Fits | Fits | 16K |
| Phi-3 Mini 128K Instruct | 3.8B | Fits | Fits | Fits | 16K |
| Phi-3 Mini 4K Instruct | 3.8B | Fits | Fits | Fits | 4K |
| Phi-4 Mini Instruct | 3.8B | Fits | Fits | Fits | 64K |
| Code Llama 7B Instruct | 6.7B | Fits | Fits | Offload | 8K |
| Vicuna 7B v1.5 | 6.7B | Fits | Fits | Offload | 4K |
| DeepSeek LLM 7B Chat | 6.9B | Fits | Fits | Offload | 4K |
| StarCoder2 7B | 7.2B | Fits | Fits | Offload | 16K |
| Falcon 7B Instruct | 7.2B | Fits | Fits | Offload | 8K |
| OpenChat 3.5 7B | 7.2B | Fits | Fits | Offload | 8K |
| Mistral 7B Instruct v0.3 | 7.3B | Fits | Fits | Offload | 32K |
| OLMo 2 7B Instruct | 7.3B | Fits | Fits | Offload | 4K |
| Falcon 3 7B Instruct | 7.5B | Fits | Fits | Offload | 32K |
| DeepSeek R1 Distill Qwen 7B | 7.6B | Fits | Fits | Offload | 64K |
| Qwen2.5 7B Instruct | 7.6B | Fits | Fits | Offload | 32K |
| Qwen2.5-Coder 7B Instruct | 7.6B | Fits | Fits | Offload | 32K |
| Qwen2.5-Math 7B Instruct | 7.6B | Fits | Fits | Offload | 4K |
| Qwen2 7B Instruct | 7.6B | Fits | Fits | Offload | 32K |
| DeepSeek R1 Distill Llama 8B | 8.0B | Fits | Fits | Offload | 32K |
| Hermes 3 Llama 3.1 8B | 8.0B | Fits | Fits | Offload | 32K |
| Llama 3.1 8B Instruct | 8.0B | Fits | Fits | Offload | 32K |
| Llama 3 8B Instruct | 8.0B | Fits | Fits | Offload | 8K |
| Qwen3 8B | 8.2B | Fits | Fits | Offload | 40K |
| Yi 1.5 9B Chat | 8.8B | Fits | Offload | Offload | 4K |
| Gemma 2 9B Instruct | 9.2B | Fits | Offload | Offload | 8K |
| GLM-4-9B-0414 | 9.4B | Fits | Offload | Offload | 32K |
| GLM-4 9B Chat | 9.4B | Fits | Offload | Offload | 8K |
| Falcon 3 10B Instruct | 10B | Fits | Offload | Offload | 16K |
| SOLAR 10.7B Instruct | 11B | Fits | Offload | Offload | 4K |
| Mistral Nemo 12B Instruct | 12B | Fits | Offload | Offload | 16K |
| Code Llama 13B Instruct | 13B | Fits | Offload | Offload | 4K |
| Vicuna 13B v1.5 | 13B | Fits | Offload | Offload | 4K |
| OLMo 2 13B Instruct | 14B | Offload | Offload | Offload | 2K |
| Phi-3 Medium 128K Instruct | 14B | Fits | Offload | Offload | 8K |
| Phi-3 Medium 4K Instruct | 14B | Fits | Offload | Offload | 4K |
| DeepSeek R1 Distill Qwen 14B | 15B | Fits | Offload | No | 8K |
| Phi-4 | 15B | Fits | Offload | No | 8K |
| Qwen2.5 14B Instruct | 15B | Fits | Offload | No | 8K |
| Qwen3 14B | 15B | Fits | Offload | No | 16K |
| StarCoder2 15B | 16B | Offload | Offload | No | 16K |
| GPT-OSS 20B | 22B | Offload | Offload | No | — |
| Mistral Small 24B Instruct | 24B | Offload | Offload | No | — |
| Gemma 2 27B Instruct | 27B | Offload | No | No | — |
| DeepSeek R1 Distill Qwen 32B | 33B | Offload | No | No | — |
| Qwen2.5 32B Instruct | 33B | Offload | No | No | — |
| Qwen2.5-Coder 32B Instruct | 33B | Offload | No | No | — |
| QwQ 32B | 33B | Offload | No | No | — |
| Qwen3 32B | 33B | Offload | No | No | — |
| Code Llama 34B Instruct | 34B | Offload | No | No | — |
| Yi 1.5 34B Chat | 34B | Offload | No | No | — |
| Mixtral 8x7B Instruct | 47B | No | No | No | — |
| DeepSeek R1 Distill Llama 70B | 71B | No | No | No | — |
| Hermes 3 Llama 3.1 70B | 71B | No | No | No | — |
| Llama 3.1 70B Instruct | 71B | No | No | No | — |
| Llama 3.3 70B Instruct | 71B | No | No | No | — |
| Qwen2.5 72B Instruct | 73B | No | No | No | — |
| GPT-OSS 120B | 117B | No | No | No | — |
| Mixtral 8x22B Instruct | 141B | No | No | No | — |
