Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

Handle kubectl returning "Throttling" messages (retry)

Description

If k8s is busy, you may get back "Throttling" message from the API.
This currently causes job failures.
e.g.:

00000415 USR ERR 2021-06-18 09:18:09.028 1 13 UNK "0: agentexec.cpp(287) : Failed to run kubectl get jobs thormanager-w20210618-091500-graph1 -o jsonpath={.status.active}: error 0: I0618 09:18:07.629375 112050 request.go:621] Throttling request took 1.199621191s, request: GET:https://10.0.0.1:443/apis/policy/v1beta1?timeout=32s

was seen when trying to launch a thormanager job.

I think we need to spot these, pause and retry.

Conclusion

None

Activity

Show:

Jacob Cobbett-Smith June 30, 2021 at 11:54 AM

- FYI

Fixed
Pinned fields
Click on the next to a field label to start pinning.

Details

Components

Assignee

Reporter

Priority

Compatibility

Point

Fix versions

Pull Request URL

Roadmap

Not applicable

Created June 30, 2021 at 11:53 AM
Updated July 7, 2021 at 9:34 AM
Resolved July 7, 2021 at 9:34 AM