Confirm this is an issue with the Python library and not an underlying OpenAI API

• This is an issue with the Python library

Describe the bug

A weird issue that I am facing in production, after the code is deployed and it has been 24-26 hours the any calls made using the above client start timing out. Usually taking out a redeployment helps.

This pattern makes it feel like the underlying HTTP connections are not being released or refreshed correctly, which may be causing a connection pool exhaustion.

Any best practices or recommendations on how to tackle this ?

My configuration

openai.api_key = os.environ.get("OPENAI_API_KEY") os.environ.setdefault("OPENAI_LOG", "debug") client = AsyncOpenAI( http_client=DefaultAioHttpClient( limits=httpx.Limits(max_connections=1000, max_keepalive_connections=100) ), ) 

I am streaming and once i am done with streaming I am closing the stream as well

response = return await chat_client.chat.completions.create(**params) ## Later on if response: await response.close() 

name = "openai" version = "1.99.9" 

To Reproduce

• NA since it it not easily replicable in local.

Code snippets

OS

Debian Linux

Python version

3.10.6

Library version

1.99.9