[Xeon][doc]add Xeon recipes into table (#53226)
Signed-off-by: louie-tsai <louie.tsai@intel.com>
Louie Tsai committed
Aug 23, 2026 at 23:42 UTC
cc40c3673b47a58d1326d1e7a2798f1f67a94a8f
1 file changed
+24
-23
docs/models/hardware_supported_models/cpu.md
+24
-23
@@ -30,38 +30,39 @@ vllm serve --config config.yaml
30
31
| Model | Architecture | Supported | Recipe |
32
| ------------------------------------ | ---------------------------------------- | --------- | ------ |
33
-| unsloth/gpt-oss-20b | GptOssForCausalLM | ✅ | — |
33
| openai/gpt-oss-20b | GptOssForCausalLM | ✅ | — |
34
+| meta-llama/Llama-3.1-8B | LlamaForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/meta-llama/Llama-3.1-8B?hardware=xeon6) |
35
| meta-llama/Llama-3.1-8B-Instruct | LlamaForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/meta-llama/Llama-3.1-8B-Instruct?hardware=xeon6) |
36
-| meta-llama/Llama-3.2-1B | LlamaForCausalLM | ✅ | — |
37
-| meta-llama/Llama-3.2-3B-Instruct | LlamaForCausalLM | ✅ | — |
36
+| meta-llama/Llama-3.2-1B | LlamaForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/meta-llama/Llama-3.2-1B?hardware=xeon6) |
37
+| meta-llama/Llama-3.2-1B-Instruct | LlamaForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/meta-llama/Llama-3.2-1B-Instruct?hardware=xeon6) |
38
+| meta-llama/Llama-3.2-3B-Instruct | LlamaForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/meta-llama/Llama-3.2-3B-Instruct?hardware=xeon6) |
39
| meta-llama/Llama-3.3-70B-Instruct | LlamaForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/meta-llama/Llama-3.3-70B-Instruct?hardware=xeon6) |
39
-| RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8 | LlamaForCausalLM | ✅ | — |
40
-| RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 | LlamaForCausalLM | ✅ | — |
41
-| RedHatAI/Llama-3.2-1B-Instruct-quantized.w8a8 | LlamaForCausalLM | ✅ | — |
42
-| RedHatAI/Llama-3.2-3B-Instruct-quantized.w8a8 | LlamaForCausalLM | ✅ | — |
40
+| RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8 | LlamaForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/meta-llama/Llama-3.1-8B?hardware=xeon6&variant=w8a8_int8) |
41
+| RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 | LlamaForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/meta-llama/Llama-3.1-8B-Instruct?hardware=xeon6&variant=w8a8_int8) |
42
+| RedHatAI/Llama-3.2-1B-Instruct-quantized.w8a8 | LlamaForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/meta-llama/Llama-3.2-1B-Instruct?hardware=xeon6&variant=w8a8_int8) |
43
+| RedHatAI/Llama-3.2-3B-Instruct-quantized.w8a8 | LlamaForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/meta-llama/Llama-3.2-3B-Instruct?hardware=xeon6&variant=w8a8_int8) |
44
| RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8 | LlamaForCausalLM | ✅ | — |
44
-| hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 | LlamaForCausalLM | ✅ | — |
45
-| AMead10/Llama-3.2-1B-Instruct-AWQ | LlamaForCausalLM | ✅ | — |
46
-| AMead10/Llama-3.2-3B-Instruct-AWQ | LlamaForCausalLM | ✅ | — |
45
+| hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 | LlamaForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/meta-llama/Llama-3.1-8B-Instruct?hardware=xeon6&variant=awq_int4) |
46
+| AMead10/Llama-3.2-1B-Instruct-AWQ | LlamaForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/meta-llama/Llama-3.2-1B-Instruct?hardware=xeon6&variant=awq_int4) |
47
+| AMead10/Llama-3.2-3B-Instruct-AWQ | LlamaForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/meta-llama/Llama-3.2-3B-Instruct?hardware=xeon6&variant=awq_int4) |
48
| TheBloke/TinyLlama-1.1B-Chat-v1.0-AWQ | LlamaForCausalLM | ✅ | — |
49
| TheBloke/TinyLlama-1.1B-Chat-v1.0-GPTQ | LlamaForCausalLM | ✅ | — |
49
-| ibm-granite/granite-3.2-2b-instruct | GraniteForCausalLM | ✅ | — |
50
+| ibm-granite/granite-3.2-2b-instruct | GraniteForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/ibm-granite/granite-3.2-2b-instruct?hardware=xeon6) |
51
| Qwen/Qwen3-1.7B | Qwen3ForCausalLM | ✅ | — |
52
| Qwen/Qwen3-4B | Qwen3ForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/Qwen/Qwen3-4B?hardware=xeon6) |
53
| Qwen/Qwen3-8B | Qwen3ForCausalLM | ✅ | — |
53
-| Qwen/Qwen3-14B | Qwen3ForCausalLM | ✅ | — |
54
-| Qwen/Qwen3-14B-FP8 | Qwen3ForCausalLM | ✅ | — |
55
-| Qwen/Qwen3-14B-AWQ | Qwen3ForCausalLM | ✅ | — |
54
+| Qwen/Qwen3-14B | Qwen3ForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/Qwen/Qwen3-14B?hardware=xeon6) |
55
+| Qwen/Qwen3-14B-FP8 | Qwen3ForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/Qwen/Qwen3-14B?hardware=xeon6&variant=fp8) |
56
+| Qwen/Qwen3-14B-AWQ | Qwen3ForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/Qwen/Qwen3-14B?hardware=xeon6&variant=awq) |
57
| Qwen/Qwen3-30B-A3B | Qwen3MoeForCausalLM | ✅ | — |
58
| Qwen/Qwen3-30B-A3B-Instruct-2507-FP8 | Qwen3MoeForCausalLM | ✅ | — |
58
-| Qwen/QwQ-32B | Qwen2ForCausalLM | ✅ | — |
59
-| Qwen/QwQ-32B-AWQ | Qwen2ForCausalLM | ✅ | — |
59
+| Qwen/QwQ-32B | Qwen2ForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/Qwen/QwQ-32B?hardware=xeon6) |
60
+| Qwen/QwQ-32B-AWQ | Qwen2ForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/Qwen/QwQ-32B?hardware=xeon6&variant=awq) |
61
| Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int4 | Qwen2ForCausalLM | ✅ | — |
61
-| RedHatAI/QwQ-32B-quantized.w8a8 | Qwen2ForCausalLM | ✅ | — |
62
-| zai-org/glm-4-9b-hf | GLMForCausalLM | ✅ | — |
62
+| RedHatAI/QwQ-32B-quantized.w8a8 | Qwen2ForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/Qwen/QwQ-32B?hardware=xeon6&variant=w8a8_int8) |
63
+| zai-org/glm-4-9b-hf | GLMForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/zai-org/glm-4-9b-hf?hardware=xeon6) |
64
| google/gemma-7b | GemmaForCausalLM | ✅ | — |
64
-| microsoft/Phi-4-reasoning | Phi3ForCausalLM | ✅ | — |
65
+| microsoft/Phi-4-reasoning | Phi3ForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/microsoft/Phi-4-reasoning?hardware=xeon6) |
66
| mistralai/Mistral-7B-Instruct-v0.2 | MistralForCausalLM | ✅ | — |
67
| TheBloke/Mistral-7B-Instruct-v0.2-AWQ | MistralForCausalLM | ✅ | — |
68
@@ -75,9 +76,9 @@ vllm serve --config config.yaml
76
| google/gemma-4-E4B-it | Gemma4ForConditionalGeneration | ✅ | [Xeon 6](https://recipes.vllm.ai/Google/gemma-4-E4B-it?hardware=xeon6) |
77
| google/gemma-4-E2B-it | Gemma4ForConditionalGeneration | ✅ | [Xeon 6](https://recipes.vllm.ai/Google/gemma-4-E2B-it?hardware=xeon6) |
78
| google/gemma-4-26B-A4B-it | Gemma4ForConditionalGeneration | ✅ | [Xeon 6](https://recipes.vllm.ai/Google/gemma-4-26B-A4B-it?hardware=xeon6) |
78
-| microsoft/Phi-4-multimodal-instruct | Phi4MMForCausalLM | ✅ | — |
79
-| Qwen/Qwen2.5-VL-7B-Instruct | Qwen2VLForConditionalGeneration | ✅ | — |
80
-| Qwen/Qwen3-VL-30B-A3B-Instruct | Qwen3VLMoeForConditionalGeneration | ✅ | — |
81
-| openai/whisper-large-v3 | WhisperForConditionalGeneration | ✅ | — |
79
+| microsoft/Phi-4-multimodal-instruct | Phi4MMForCausalLM | ✅ | [Xeon 6](https://recipes.vllm.ai/microsoft/Phi-4-multimodal-instruct?hardware=xeon6) |
80
+| Qwen/Qwen2.5-VL-7B-Instruct | Qwen2VLForConditionalGeneration | ✅ | [Xeon 6](https://recipes.vllm.ai/Qwen/Qwen2.5-VL-7B-Instruct?hardware=xeon6) |
81
+| Qwen/Qwen3-VL-30B-A3B-Instruct | Qwen3VLMoeForConditionalGeneration | ✅ | [Xeon 6](https://recipes.vllm.ai/Qwen/Qwen3-VL-30B-A3B-Instruct?hardware=xeon6) |
82
+| openai/whisper-large-v3 | WhisperForConditionalGeneration | ✅ | [Xeon 6](https://recipes.vllm.ai/openai/whisper-large-v3?hardware=xeon6) |
83
84
✅ Runs and optimized.