changes

[vinupreethi]

Thank you for taking time to contribute this pull request!
You might have already read the contributor guide, but as a reminder, please make sure to:

• Add a Signed-off-by line to each commit (git commit -s) per the DCO
• Rebase your changes on the latest main branch and squash your commits
• Add/Update unit tests as needed
• Run a build and make sure all tests pass prior to submission

For more details, please check the contributor guide.
Thank you upfront!

[markpollack]

@vinupreethi this is a large pr to review just from the source code changes. can you explain more please?

[vinupreethi]

@markpollack i was working at this issue... #3816 (comment) I'm a newbie..

[markpollack]

Thanks @vinupreethi so is this PR still relevant?

[vinupreethi]

@markpollack @192902649 need to verify the changes., When using Flux, the context is returned with every response, which results in large data volume. This can be optimized — for example, only include the context in the response when chatResponse.result.metadata.finishReason == "stop". this is the description given.