17 recipes
Qwen-AgentWorld-35B-A3B
Qwen
35B/3Bbf16256K ctx2× Gaudi 2Text
35B hybrid MoE (Gated DeltaNet + attention, 3B active) agent model, BF16, native 256K context on two Gaudi 2 cards.
Qwen3-235B-A22B-Instruct-2507-FP8
Qwen
235B/22Bfp8128K ctx4× Gaudi 2Text
235B MoE (22B active) instruct model, FP8 block-quantized checkpoint, 128K context on four Gaudi 2 cards.
Qwen3-235B-A22B-Thinking-2507-FP8
Qwen
235B/22Bfp8128K ctx4× Gaudi 2Text
235B MoE (22B active) reasoning model, FP8 block-quantized checkpoint, 128K context on four Gaudi 2 cards.
Qwen3-30B-A3B-Instruct-2507
Qwen
30.5B/3.3Bbf16128K ctx1× Gaudi 2Text
30B MoE (3B active) instruct model, non-thinking, served at 128K context on one Gaudi 2 card in BF16.
Qwen3-30B-A3B-Thinking-2507
Qwen
30.5B/3.3Bbf16128K ctx1× Gaudi 2Text
30B MoE (3B active) reasoning model, always thinks, served at 128K context on one Gaudi 2 card in BF16.
Qwen3-Coder-30B-A3B-Instruct
Qwen
30.5B/3.3Bbf16128K ctx1× Gaudi 2Text
30B MoE (3B active) coding model with tool calling, served at 128K context on one Gaudi 2 card in BF16.
Qwen3-Coder-Next
Qwen
80B/3Bbf16256K ctx4× Gaudi 2Text
80B hybrid MoE (Gated DeltaNet + attention, 3B active) coding model with tool calling, BF16, native 256K context on four Gaudi 2 cards.
Qwen3-Embedding-4B
Qwen
4Bbf1632K ctx1× Gaudi 2Embedding
4B instruction-aware text embedding model (2560 dimensions, Matryoshka truncation) on one Gaudi 2 card in BF16.
Qwen3-Embedding-8B
Qwen
8Bbf1632K ctx1× Gaudi 2Embedding
8B instruction-aware text embedding model (4096 dimensions, Matryoshka truncation) on one Gaudi 2 card in BF16.
Qwen3-VL-32B-Instruct-FP8
Qwen
32Bfp8128K ctx2× Gaudi 2Multimodal
32B dense vision-language model (images and video) in FP8, 128K context on two Gaudi 2 cards.
Qwen3-VL-Embedding-8B
Qwen
8Bbf1632K ctx1× Gaudi 2EmbeddingMultimodal
8B multimodal embedding model (text, images, screenshots; 4096 dimensions, Matryoshka truncation) on one Gaudi 2 card in BF16.
Qwen3.5-122B-A10B-FP8
Qwen
122B/10Bfp8256K ctx4× Gaudi 2Text
122B hybrid MoE (Gated DeltaNet + attention, 10B active) reasoning model, FP8, native 256K context on four Gaudi 2 cards.
Qwen3.5-27B-FP8
Qwen
27Bfp8256K ctx1× Gaudi 2Multimodal
27B dense hybrid (Gated DeltaNet + attention) reasoning model with vision, FP8, native 256K context on one Gaudi 2 card.
Qwen3.5-397B-A17B-FP8
Qwen
397B/17Bfp8256K ctx8× Gaudi 2Text
397B MoE (17B active) hybrid (Gated DeltaNet + attention) reasoning model, FP8, native 256K context, text only, on one 8-card Gaudi 2 node.
Qwen3.6-27B-FP8
Qwen
27Bfp8256K ctx1× Gaudi 2Multimodal
27B dense hybrid (Gated DeltaNet + attention) reasoning model with vision, FP8, native 256K context on one Gaudi 2 card.
Qwen3.6-35B-A3B-FP8
Qwen
35B/3Bfp8256K ctx1× Gaudi 2Multimodal
35B MoE (3B active) hybrid (Gated DeltaNet + attention) reasoning model with vision, FP8, native 256K context on one Gaudi 2 card.
Qwen3.8-27B
Qwen
27Bbf16256K ctx1× Gaudi 2Multimodal
27B dense hybrid (Gated DeltaNet + attention) reasoning model with vision, BF16, native 256K context on one Gaudi 2 card, 4 sequences.