[LLM] Support multi machine deployment

[ltd0924]

Before submitting

• Lint code. If there are lint issues, please format the code first.

# Install and register `pre-commit` in the project folder pip install pre-commit && pre-commit install # Process previous code files separately pre-commit run --file XXXX.py

• Add test cases into tests folder. If there are codecov issues, please add tests cases first.

PR types

PR changes

Description

[paddle-bot]

Thanks for your contribution!

[CLAassistant]

All committers have signed the CLA.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 51.42%. Comparing base (765ab8d) to head (ae09a9c).
Report is 351 commits behind head on develop.

Additional details and impacted files

@@ Coverage Diff @@ ## develop #9872 +/- ## =========================================== - Coverage 52.06% 51.42% -0.65%  =========================================== Files 734 745 +11 Lines 116443 120605 +4162 =========================================== + Hits 60625 62018 +1393  - Misses 55818 58587 +2769 

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.