Skip to content

Add AutoGen logger for generating report and integrating with OCI monitoring. #1031

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 60 commits into from
Jan 6, 2025
Merged

Add AutoGen logger for generating report and integrating with OCI monitoring. #1031

Changes from 1 commit
Commits
Show all changes
60 commits
Select commit Hold shift + click to select a range
d743c47
Do not pop message from params.
qiuosier Nov 14, 2024
2bd2b65
Add logger for autogen.
qiuosier Nov 15, 2024
1928c21
Add report generation.
qiuosier Nov 15, 2024
ee0b154
Generate report when stop logging.
qiuosier Nov 15, 2024
2888b8d
Add multi-threading support.
qiuosier Nov 18, 2024
838c13b
Format tool call args if it is a valid JSON.
qiuosier Nov 18, 2024
c87704b
Support OCI object storage for logging and reports.
qiuosier Nov 19, 2024
004def7
Refactor logging.
qiuosier Nov 20, 2024
38b02aa
Update logic for creating new logging session.
qiuosier Nov 20, 2024
7683e0d
Support multiple AutoGen loggers.
qiuosier Nov 20, 2024
45caba9
Refactor code into ads.llm.autogen.v02
qiuosier Nov 21, 2024
82b067d
Update logger repr.
qiuosier Nov 21, 2024
209b5fa
Disable chat tab.
qiuosier Nov 21, 2024
c2aa1da
Add Chat tab.
qiuosier Nov 22, 2024
8c608ef
Handle chat rendering error.
qiuosier Nov 25, 2024
cc7f186
Add logs tab.
qiuosier Nov 25, 2024
f35a995
Log library versions.
qiuosier Nov 25, 2024
4c0ca6f
Create report_dir when it does not exist.
qiuosier Nov 25, 2024
ab64b62
Fix error when there is no LLM call.
qiuosier Nov 25, 2024
4328487
Fix error when starting multiple loggers.
qiuosier Dec 2, 2024
cd600a4
Add usage property to client response.
qiuosier Dec 2, 2024
57e60c4
Fix log_new_client() bug in session_logger.
qiuosier Dec 2, 2024
67c59e1
Print error instead raising exception when failed to create report.
qiuosier Dec 3, 2024
2e30362
Update copyright and sort imports.
qiuosier Dec 5, 2024
ee2df37
Add method to get all existing loggers.
qiuosier Dec 5, 2024
2aa919a
Catch logging exception and log traceback.
qiuosier Dec 5, 2024
9d13d8f
Use space to replace empty message for OCI GenAI LLM call.
qiuosier Dec 5, 2024
1430005
Include recipient in chat.
qiuosier Dec 5, 2024
bd239a0
Update session logger serialization.
qiuosier Dec 5, 2024
def985c
Ignore message from chat manager in chat tab.
qiuosier Dec 5, 2024
76a201c
Update Chat box template.
qiuosier Dec 6, 2024
696065d
Update response serialization.
qiuosier Dec 6, 2024
af5de13
Add HTML escape for displaying raw logs.
qiuosier Dec 6, 2024
728eeb5
Update timeline header and show whether LLM call is cached.
qiuosier Dec 6, 2024
9f89d0f
Show more metrics in invocation tab.
qiuosier Dec 6, 2024
9937b32
Count unique agents and chat managers.
qiuosier Dec 8, 2024
b4384e8
Align left within code block.
qiuosier Dec 9, 2024
d9a11fc
Do logging only if logger is started.
qiuosier Dec 9, 2024
20bccba
Remove loggers from LoggerManager once stopped.
qiuosier Dec 9, 2024
ef7876a
Skip logging new clients and new wrappers.
qiuosier Dec 9, 2024
cf1f152
Update Request/Response block in invocations.
qiuosier Dec 9, 2024
014f69f
Update new client logging.
qiuosier Dec 10, 2024
a0ffcd2
Show flow chat with timeline.
qiuosier Dec 10, 2024
a3ff197
Move SessionLogger into ads.llm.autogen.v02.loggers.
qiuosier Dec 12, 2024
3da1519
Show empty message as empty instead of None in chat tab.
qiuosier Dec 16, 2024
9750e06
Update copyrights.
qiuosier Dec 17, 2024
3c16972
Merge remote-tracking branch 'origin/main' into feature/autogen
qiuosier Dec 18, 2024
519508b
Refactor logging and report generation.
qiuosier Dec 19, 2024
faa2ca5
Add context manager for session logger.
qiuosier Dec 19, 2024
d84c178
Fix chat manager parsing.
qiuosier Dec 19, 2024
277e3b2
Log and show exception in report.
qiuosier Dec 19, 2024
fbb4257
Add OCI monitoring logger.
qiuosier Dec 19, 2024
d3ef8e7
Move functions to utils.py
qiuosier Dec 20, 2024
085249c
Update metric logger.
qiuosier Dec 20, 2024
6ddf9bf
Fix error in session logger.
qiuosier Dec 20, 2024
c63e6cf
Make dimensions optional in metric logger.
qiuosier Dec 20, 2024
389193d
Update default settings for metric logger.
qiuosier Dec 20, 2024
d95e4ea
Update docs.
qiuosier Dec 20, 2024
ec6dcdb
Fix typo in docs.
qiuosier Dec 20, 2024
277e3cf
Merge branch 'main' into feature/autogen
qiuosier Jan 6, 2025
File filter

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Fix error in session logger.
  • Loading branch information
@qiuosier
qiuosier committed Dec 20, 2024
commit 6ddf9bf97c15930a14113da3ceb5ed272bd521c3
17 changes: 9 additions & 8 deletions ads/llm/autogen/v02/loggers/session_logger.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -568,12 +568,13 @@ def __enter__(self) -> "SessionLogger":

def __exit__(self, exc_type, exc_value, tb):
"""Stops the session logger."""
record = self.new_record(event_name=Events.EXCEPTION)
record.kwargs = {
"exc_type": exc_type.__name__,
"exc_value": str(exc_value),
"traceback": "".join(traceback.format_tb(tb)),
"locals": serialize(tb.tb_frame.f_locals),
}
self.log(record)
if exc_type:
record = self.new_record(event_name=Events.EXCEPTION)
record.kwargs = {
"exc_type": exc_type.__name__,
"exc_value": str(exc_value),
"traceback": "".join(traceback.format_tb(tb)),
"locals": serialize(tb.tb_frame.f_locals),
}
self.log(record)
runtime_logging.stop(self)