Pinned Loading

1. InternLM/lmdeploy InternLM/lmdeploy Public

   LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

   Python 7.2k 608

2. mmdetection-to-tensorrt mmdetection-to-tensorrt Public

   convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.

   Python 598 85

3. torch2trt_dynamic torch2trt_dynamic Public

   A pytorch to tensorrt convert with dynamic shape support

   Python 265 35

4. open-mmlab/mmdeploy open-mmlab/mmdeploy Public

   OpenMMLab Model Deployment Framework

   Python 3.1k 677