- Notifications
You must be signed in to change notification settings - Fork 329
Description
Currently users have to do a lot of work to use dynamic clients.
instead we could look into a more type-safe approach such as:
cr = b.ClientRegistry() cr.ExistingClient.ExtractResume(...) client = cr.add_llm_client(...) client.ExtractResume(...) client = cr.get_llm_client(...) client.ExtractResume(...)User requests:
Is there a way to set `temperature` per request without modifying whole client via `Client Registry`?
Hello, I use BAML with Azure Openai, which currently uses an auth token that expires after a certain amount of time, so I'd like to limit the client definitions in my python code, instead of having to use clients.baml.
Currently, I define the client in clients.baml, and use dummy variables for the credentials, and in my python code, I overwrite them with the correct credentials at runtime. Is there a cleaner way to accomplish this?
Please, add methods for requesting state of a Client Registry 🙏 Specifically:
- Something like
get_primaryto get the current primary client spec;- Something like
get_clientsto list all registered clients.
is there an easy way to override the client with another predefined client when calling a BAML function without having to create the entire client in code and using a client registry? use case: we want to evaluate a few models from different providers for a particular prompt to see which one passes all checks.
User requests:
Is there a way to set `temperature` per request without modifying whole client via `Client Registry`?
Hello, I use BAML with Azure Openai, which currently uses an auth token that expires after a certain amount of time, so I'd like to limit the client definitions in my python code, instead of having to use clients.baml.
Currently, I define the client in clients.baml, and use dummy variables for the credentials, and in my python code, I overwrite them with the correct credentials at runtime. Is there a cleaner way to accomplish this?
Please, add methods for requesting state of a Client Registry 🙏 Specifically:
- Something like
get_primaryto get the current primary client spec;- Something like
get_clientsto list all registered clients.
is there an easy way to override the client with another predefined client when calling a BAML function without having to create the entire client in code and using a client registry? use case: we want to evaluate a few models from different providers for a particular prompt to see which one passes all checks.