⬢github TechnologyAI first seen 1 h ago, last 6 min ago, peak #3
NVIDIA/Model-Optimizer
NVIDIA/Model-Optimizer is an open-source Python library on GitHub that collects state-of-the-art model optimization techniques, including quantization, distillation, pruning, neural architecture search and speculative decoding. It compresses deep learning models so they run efficiently in deployment frameworks such as TensorRT-LLM, TensorRT and vLLM, improving inference speed. It is trending on GitHub's rankings with modest engagement, and the posts shown only describe the project itself, so there is no evidence of a specific event driving attention.
Why now: unclear
NVIDIAModel-OptimizerTensorRT-LLMvLLMTensorRT
Rank over time, top of the chart is #1. 18 snapshots from 1 h ago to 6 min ago.
Evidence
- NVIDIA/Model-Optimizer · NVIDIA · 16
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize…