File tree Expand file tree Collapse file tree 1 file changed +28
-1
lines changed Expand file tree Collapse file tree 1 file changed +28
-1
lines changed Original file line number Diff line number Diff line change @@ -15,7 +15,7 @@ docker build -f docker/Dockerfile -t llm-api:pytorch .
1515安装依赖
1616
1717``` shell
18- pip install torch= =1.13.1
18+ pip install torch> =1.13.1
1919pip install -r requirements.txt
2020```
2121
@@ -118,6 +118,12 @@ python server.py
118118
119119** 环境变量修改内容参考下面**
120120
121+ + [ deepseek] ( https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/SCRIPT.md#deepseekchat )
122+
123+ + [ deepseek-coder] ( https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/SCRIPT.md#deepseekcoder )
124+
125+ + [ yi-chat] ( https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/SCRIPT.md#yi-chat )
126+
121127+ [ baichuan2] ( https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/SCRIPT.md#baichuan2 )
122128
123129+ [ code-llama] ( https://github.com/xusenlinzy/api-for-open-llm/blob/master/docs/SCRIPT.md#code-llama )
@@ -428,3 +434,24 @@ MODEL_PATH=01-ai/Yi-34B-Chat
428434PROMPT_NAME=yi
429435DEVICE_MAP=auto
430436```
437+
438+ ### DeepSeekCoder
439+
440+ deepseek-ai/deepseek-coder-33b-instruct
441+
442+ ``` shell
443+ MODEL_NAME=deepseek-coder
444+ MODEL_PATH=deepseek-ai/deepseek-coder-33b-instruct
445+ DEVICE_MAP=auto
446+ ```
447+
448+
449+ ### DeepseekChat
450+
451+ deepseek-ai/deepseek-llm-67b-chat
452+
453+ ``` shell
454+ MODEL_NAME=deepseek
455+ MODEL_PATH=deepseek-ai/deepseek-llm-67b-chat
456+ DEVICE_MAP=auto
457+ ```
You can’t perform that action at this time.
0 commit comments