When using the PPO or POCA, I only find the Actor's Policy Network, is there anyone knows where to find the Critic's Value Network? I search all the files, there is no Value Network's .onnx or .pt model?
The Critic may have the evaluation information of the Agent's behaviors, which is important to me .