Daehyun Ahn - SqueezeBits

Daehyun Ahn

How to Quantize YOLO models with OwLite

How to Quantize YOLO models with OwLite

This article describes the experimental results of quantized YOLO models with OwLite.

When Should I Use Fits on Chips?

When Should I Use Fits on Chips?

This article describes when to use Fits on Chips toolkit with specific use cases.

TechProductFits on Chips

[vLLM vs TensorRT-LLM] #12. Automatic Prefix Caching

[vLLM vs TensorRT-LLM] #12. Automatic Prefix Caching

This article provides a comparative analysis of automatic prefix caching.

TechvLLM vs TRT LLM

[vLLM vs TensorRT-LLM] #11. Speculative Decoding

[vLLM vs TensorRT-LLM] #11. Speculative Decoding

This article provides a comparative analysis of speculative decoding.

TechvLLM vs TRT LLM

[vLLM vs TensorRT-LLM] #3. Understanding Sampling Methods and Their Performance Impact

[vLLM vs TensorRT-LLM] #3. Understanding Sampling Methods and Their Performance Impact

This article provides a comparative analysis of vLLM and TensorRT-LLM frameworks with various sampling methods.

TechvLLM vs TRT LLM

SqueezeBits

RSS·Powered by Inblog