We use op.inputs and op.outputs which is a map of key->python "Variable" type. This could be buggy because it's only present in python but not in protobuf.

We must retrieve these values from other ways.