This job is often taking well over an hour even with 8 cores and 20Gi assigned in prow. It used to be more like 30m or less.

(because these tests cases are mostly kubectl and apiserver)

A handful of specific tests seem to be large outliers

the CEL tests alone take 11+ minutes

k8s.io/kubernetes/test/integration/apiserver: cel | 11m13s

/sig api-machinery

cc @jpbetz @cici37

and OIDC

k8s.io/kubernetes/test/integration/apiserver: oidc | 11m16s

/sig auth

k8s.io/kubernetes/test/integration/controlplane: transformation | 14m33s

k8s.io/kubernetes/test/integration: examples | 7m47s

api machinery again?

k8s.io/kubernetes/test/integration: job | 14m16s

/sig apps

k8s.io/kubernetes/test/integration: scheduler_perf | 9m34s

/sig scheduling

Most of the SIG CLI tests take a few seconds

NOTE: I only skimmed a few of the excessive results here, you can see all of the timings if you expand the "174/174 tests passed!" field

https://prow.k8s.io/view/gs/kubernetes-jenkins/pr-logs/pull/126191/pull-kubernetes-integration/1813929954224640000

can we do something about this folks?

/kind bug