Eunik Park - The official SqueezeBits Tech blog
|
Blog
Yetter
OwLite
Fits on Chips
SqueezeBits
🌐
🌐
Subscribe
Open main menu
Search posts...
Unlock the Potential of AI
Deploy your AI with Maximal Efficiency
Subscribe
Eunik Park
Guided Decoding Performance on vLLM and SGLang
The guide to LLM guided decoding! This deep-dive benchmark compares XGrammar and LLGuidance on vLLM and SGLang to help you find the optimal setup for generating structured output based on your use case.
Sep 16, 2025
Tech Insight
OwLite Meets Qualcomm Neural Network: Unlocking On-Device AI Performance
At SqueezeBits we have been empowering developers to efficiently deploy complex AI models while minimizing performance trade-offs with OwLite toolkit. With OwLite v2.5, we're excited to announce official support for Qualcomm Neural Network (QNN) through seamless integration with Qualcomm AI Hub.
Jul 03, 2025
Product
[vLLM vs TensorRT-LLM] #7. Weight-Activation Quantization
This article provides a comparative analysis of the effects of weight-activation quantization on vLLM and TensorRT-LLM frameworks.
Nov 11, 2024
Tech Insight
![[vLLM vs TensorRT-LLM] #7. Weight-Activation Quantization](https://image.inblog.dev?url=https%3A%2F%2Fsource.inblog.dev%2Ffeatured_image%2F2024-11-11T14%3A39%3A43.503Z-0000c964-a3ea-43d6-8657-5c6c97b383dd&w=3840&q=75)