Minkyu Kim - The official SqueezeBits Tech blog

Minkyu Kim

[Intel Gaudi] #4. FP8 Quantization

[Intel Gaudi] #4. FP8 Quantization

In this blog series, we thoroughly evaluate Intel's AI accelerator, the Gaudi series, focusing on its performance, features, and usability.

[vLLM vs TensorRT-LLM] #5. Dynamic Sequence Lengths

[vLLM vs TensorRT-LLM] #5. Dynamic Sequence Lengths

This article provides a comparative analysis of vLLM and TensorRT-LLM frameworks, focusing on performance with fixed and dynamic datasets.