Skip to content

[UIE Issue]UIE关系抽取后执行evaluate.py文件发现,对性能评估的问题:关系的类居然是一条一条class 输出的,不应该是都属于一类输出吗 #3224

@tingaicompass

Description

@tingaicompass

记得很早之前看过一个关于UIE关系抽取后执行evaluate.py文件发现,对性能评估的问题。

以这篇项目为例:
Paddlenlp之UIE关系抽取模型【高管关系抽取为例】
https://aistudio.baidu.com/aistudio/projectdetail/4371345?contributionType=1
项目中结果验证时:
Class Name: 人名
[2022-07-25 00:17:26,608] [ INFO] - Evaluation Precision: 1.00000 | Recall: 1.00000 | F1: 1.00000
[2022-07-25 00:17:26,641] [ INFO] - -----------------------------
[2022-07-25 00:17:26,641] [ INFO] - Class Name: 公司
[2022-07-25 00:17:26,641] [ INFO] - Evaluation Precision: 1.00000 | Recall: 0.66667 | F1: 0.80000
[2022-07-25 00:17:26,667] [ INFO] - -----------------------------
[2022-07-25 00:17:26,667] [ INFO] - Class Name: 网易公司的高管
[2022-07-25 00:17:26,667] [ INFO] - Evaluation Precision: 1.00000 | Recall: 1.00000 | F1: 1.00000
[2022-07-25 00:17:26,693] [ INFO] - -----------------------------
[2022-07-25 00:17:26,693] [ INFO] - Class Name: 百度公司的高管
[2022-07-25 00:17:26,693] [ INFO] - Evaluation Precision: 1.00000 | Recall: 1.00000 | F1: 1.00000

关系的类居然是一条一条class 输出的,不应该是都属于一类输出吗
百度公司的高管 网易公司的高管 应该输出为:Class Name:高管 Evaluation Precision: 1.00000 | Recall: 1.00000 | F1: 1.00000

不知道更新优化了吗

Metadata

Metadata

Assignees

Labels

questionFurther information is requestedstale

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions