Skip to content

Add Streaming of Function Call Arguments to Chat Completions #999

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 17 commits into from
Jul 16, 2025
Merged

Add Streaming of Function Call Arguments to Chat Completions #999

Changes from 1 commit
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
0541476
feat: enable real-time streaming of function call arguments
devtalker Jul 3, 2025
ed1bee7
docs: add documentation for real-time streaming of function call argu…
devtalker Jul 3, 2025
2a704d6
refactor: improve function call detection in streaming examples
devtalker Jul 7, 2025
08d626a
fix: resolve mypy type errors in function call streaming examples
devtalker Jul 7, 2025
d3eb92a
fix: prevent function call_id from being reset during streaming
devtalker Jul 9, 2025
39b0370
docs: optimize stream function call arguments example
devtalker Jul 10, 2025
1deec68
Revert "docs: add function call argument streaming documentation"
devtalker Jul 10, 2025
cd617b8
style: refine comment in stream handler
devtalker Jul 10, 2025
34b1754
refactor: remove stream function call args example
devtalker Jul 10, 2025
6885e4f
Merge branch 'main' into feature/function-call-args-streaming
devtalker Jul 14, 2025
0fbf80d
fix: simplify function call streaming logic based on LLM provider beh…
devtalker Jul 14, 2025
930783c
Merge branch 'main' into feature/function-call-args-streaming
devtalker Jul 14, 2025
ddd8b0d
Merge branch 'main' into feature/function-call-args-streaming
devtalker Jul 15, 2025
c5d982e
Merge branch 'main' into feature/function-call-args-streaming
devtalker Jul 15, 2025
87a7a87
Merge branch 'main' into feature/function-call-args-streaming
devtalker Jul 15, 2025
b2f1242
Merge branch 'main' into feature/function-call-args-streaming
devtalker Jul 16, 2025
e79e0ca
Merge branch 'main' into feature/function-call-args-streaming
devtalker Jul 16, 2025
File filter

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix: prevent function call_id from being reset during streaming
  • Loading branch information
@devtalker
devtalker committed Jul 11, 2025
commit d3eb92a26c4f8cc20a3a427389fd8d807a2740be
3 changes: 2 additions & 1 deletion src/agents/models/chatcmpl_stream_handler.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -280,7 +280,8 @@ async def handle_stream(
state.function_calls[tc_delta.index].name += (
tc_function.name if tc_function else ""
) or ""
state.function_calls[tc_delta.index].call_id = tc_delta.id or ""
if tc_delta.id:
state.function_calls[tc_delta.index].call_id = tc_delta.id

# Check if we have enough info to start streaming this function call
function_call = state.function_calls[tc_delta.index]
Expand Down