Neural Magic
Neural Magic (Acquired by Red Hat) empowers developers to optimize & deploy LLMs at scale. Our model compression & acceleration enable top performance with vLLM
Pinned Loading
Repositories
Showing 10 of 81 repositories
- arena-hard-auto Public Forked from lmarena/arena-hard-auto
Arena-Hard-Auto: An automatic LLM benchmark.
neuralmagic/arena-hard-auto’s past year of commit activity - model-validation-configs Public
neuralmagic/model-validation-configs’s past year of commit activity - pytorch Public Forked from pytorch/pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration
neuralmagic/pytorch’s past year of commit activity - lmms-eval Public Forked from EvolvingLMMs-Lab/lmms-eval
Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.
neuralmagic/lmms-eval’s past year of commit activity - lighteval Public Forked from huggingface/lighteval
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
neuralmagic/lighteval’s past year of commit activity - sglang Public Forked from sgl-project/sglang
SGLang is a fast serving framework for large language models and vision language models.
neuralmagic/sglang’s past year of commit activity
