V-lang api wrapper for llm-inference chatllm.cpp
chatbot inference bindings api-wrapper llama quantization gemma mistral v-lang vlang cpu-inference llm llms chatllm ggml llm-inference qwen phi3
- Updated
Nov 20, 2024 - C
#
cpu-inference
Here are 3 public repositories matching this topic...
Nim api-wrapper for llm-inference chatllm.cpp
nim chatbot inference bindings api-wrapper llama quantization nim-language gemma nim-lang mistral phi nimlang cpu-inference llm llms chatllm ggml llm-inference qwen
- Updated
Nov 20, 2024 - C
kotlin api wrapper for llm-inference chatllm.cpp
kotlin chatbot inference bindings api-wrapper llama quantization gemma mistral cpu-inference llm llms chatllm ggml llm-inference qwen
- Updated
Nov 26, 2024 - C
Improve this page
Add a description, image, and links to the cpu-inference topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the cpu-inference topic, visit your repo's landing page and select "manage topics."