See AllTechProductvLLM vs TRT LLMIntel GaudiYetterOwLiteFits on ChipsBiz&InsightResearch
[Intel Gaudi] #6. GEMM, Attention, vLLM on Gaudi

[Intel Gaudi] #6. GEMM, Attention, vLLM on Gaudi

Explore how Intel’s new Gaudi-3 compares to Gaudi-2, NVIDIA A100, and H100. We analyze real-world GEMM efficiency, attention performance, and LLM serving results to uncover what truly matters for AI inference and training workloads.
Taesu Kim's avatar
Oct 28, 2025
Intel Gaudi
Bringing NPUs into Production: Our Journey with Intel Gaudi

Bringing NPUs into Production: Our Journey with Intel Gaudi

SqueezeBits has partnered with Intel to make Gaudi NPUs more usable in practice. We optimized LLMs and diffusion models for Gaudi-2 and created yetter, a generative AI API service.
Sangmin Kim's avatar
Jul 01, 2025
Intel GaudiBiz&Insight
[Intel Gaudi] #5. FLUX.1 on Gaudi-2

[Intel Gaudi] #5. FLUX.1 on Gaudi-2

This article discusses inference efficiency when running the FLUX.1 models on Intel Gaudi-2 hardware.
Taesu Kim's avatar
Apr 02, 2025
TechIntel Gaudi
[Intel Gaudi] #4. FP8 Quantization

[Intel Gaudi] #4. FP8 Quantization

In this blog series, we thoroughly evaluate Intel's AI accelerator, the Gaudi series, focusing on its performance, features, and usability.
Minkyu Kim's avatar
Jan 13, 2025
TechIntel Gaudi
[Intel Gaudi] #3. Performance Evaluation with SynapseAI v1.19

[Intel Gaudi] #3. Performance Evaluation with SynapseAI v1.19

In this blog series, we thoroughly evaluate Intel's AI accelerator, the Gaudi series, focusing on its performance, features, and usability.
Taesu Kim's avatar
Jan 06, 2025
TechIntel Gaudi

SqueezeBits

RSS·Powered by Inblog