feat: add Controller Internals Grafana dashboard

[rawadhossain]

Description

This PR adds the Controller Internals section, fifth of five planned dashboard sections for node-readiness-controller.

Questions it answers:

• Is the controller up and reachable?
• Is it keeping up with incoming reconcile work?
• Are workqueues building up or taking too long to process?
• Are reconciliations failing?
• Which controller version is currently running?

Most of these panels use metrics from controller-runtime and kube-state-metrics.

Panels in this Section

• Controller Up - controller availability.
• Workqueue Depth - queued reconcile work per controller.
• Workqueue Latency (p99) - p99 time items spend waiting in the queue.
• Reconcile Errors - failed reconcile attempts per second.
• Bootstrap Completions - total bootstrap completions since the controller started.
• Build Info - deployed version and pod identity.

Screenshot

Video demo

Section.5.mp4

Related to Issue #459

Type of Change

/kind feature

Testing

• Verified all panels render correctly against live data in a kind + kwok test cluster
• Confirmed the setup is reproducible from a clean cluster

[netlify]

✅ Deploy Preview for node-readiness-controller canceled.

Name	Link
🔨 Latest commit	ae4a67c
🔍 Latest deploy log	https://app.netlify.com/projects/node-readiness-controller/deploys/6a96d30371818200084d86a3

[kubernetes-prow]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: rawadhossain
Once this PR has been reviewed and has the lgtm label, please assign mrunalp for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[rawadhossain]

/cc @AvineshTripathi

[AvineshTripathi]

initial look! I will need some time here to understand. Too many variables here!

[AvineshTripathi]

There can be a different name for the job for e.g. https://github.com/kubernetes-sigs/node-readiness-controller/blob/main/charts/node-readiness-controller/templates/servicemetrics.yaml#L5 which might break this