Add a Make target that runs crd-schema-checker

[cbandy]

Checklist:

• Have you added an explanation of what your changes do and why you'd like them to be included?
• Have you updated or added documentation for the change, as applicable?
• Have you tested your changes on all related environments with successful results, as applicable?
  • Have you added automated tests?

---

This tool helped me understand the cost of CEL validation rules as I was writing them. The second and third commits are optional; I followed some of the recommendations emitted by the tool. Edit: Removed these commits.

The output for PGUpgrades looks similar to:

go run github.com/openshift/crd-schema-checker/cmd/crd-schema-checker@latest check-manifests --disabled-validators 'NoBools,NoMaps' --new-crd-filename 'config/crd/bases/postgres-operator.crunchydata.com_pgupgrades.yaml' 2>&1 | awk -f hack/check-manifests.awk ERROR: "ListsMustHaveSSATags": crd/pgupgrades.postgres-operator.crunchydata.com version/v1beta1 field/^.spec.imagePullSecrets must set x-kubernetes-list-type info: "CostBudget": ^.spec: Field has a maximum cardinality of 1. info: "CostBudget": ^.spec: Rule 0 raw cost is 5. Estimated total cost of 5. Rule is 0.00% of allowed budget, 10M. info: "CostBudget": ^.spec: Field has a maximum cardinality of 1. info: "CostBudget": ^.spec: Rule 1 raw cost is 19. Estimated total cost of 19. Rule is 0.00% of allowed budget, 10M. info: "CostBudget": ^.spec: Field has a maximum cardinality of 1. info: "CostBudget": ^.spec: Rule 2 raw cost is 20. Estimated total cost of 20. Rule is 0.00% of allowed budget, 10M. exit status 1 

[dsessler7]

What is this?

[benjaminjb]

Defining a newline? Does the awk on l. 156 need a newline?

[cbandy]

What is this?
Defining a newline?

Yeah, this is a Make variable that contains one newline.

Does the awk on l. 156 need a newline?

Without the newline, Make prints all the go run commands at once, then four outputs from the tool come out. With this, each command and its output are separated like this:

go run github.com/openshift/crd-schema-checker/cmd/crd-schema-checker@latest check-manifests --new-crd-filename 'config/crd/bases/postgresoperator.crunchydata.com_crunchybridgeclusters.yaml' 2>&1 | awk -f hack/check-manifests.awk ## ## wall of log lines ## go run github.com/openshift/crd-schema-checker/cmd/crd-schema-checker@latest check-manifests --new-crd-filename 'config/crd/bases/postgres-operator.crunchydata.com_pgadmins.yaml' 2>&1 | awk -f hack/check-manifests.awk ## ## wall of log lines ## go run github.com/openshift/crd-schema-checker/cmd/crd-schema-checker@latest check-manifests --new-crd-filename 'config/crd/bases/postgres-operator.crunchydata.com_pgupgrades.yaml' 2>&1 | awk -f hack/check-manifests.awk ## ## wall of log lines ## go run github.com/openshift/crd-schema-checker/cmd/crd-schema-checker@latest check-manifests --new-crd-filename 'config/crd/bases/postgres-operator.crunchydata.com_postgresclusters.yaml' 2>&1 | awk -f hack/check-manifests.awk ## ## wall of log lines ##

🤔 What's a better way to present / read this stuff?

[cbandy]

📝 https://www.github.com/openshift/crd-schema-checker/issues/44

[benjaminjb]

No blockers

[benjaminjb]

Just thinking aloud here, but this make target isn't wired up to any other make target, so we might want to write / think about some guidance about when to use it. It's not just for checking CEL rule budget, yeah?

[cbandy]

Just thinking aloud here, but this make target isn't wired up to any other make target, so we might want to write / think about some guidance about when to use it. It's not just for checking CEL rule budget, yeah?

I don't understand the tool enough to give any guidance, really. I used it to check CEL budgets, but I have no idea how accurate that was (or if accuracy even matters).

When we understand the tool better, we can configure it and wire it up as a blocking check.

• I'm curious about the old → new concept. It sounds like it can detect not-good changes to a CRD.
• This file has a list of checks and some ideas for others. Are these all enabled?
• Our strategy for v1 relies on validation ratcheting. What are these calls to RatchetCompare?

[cbandy]

I've reverted the CRD changes. This PR adds an easy way to invoke the schema checker.