Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

Limit number of cores used in highly parallel operations to resourced limit

Description

Currently, containers will use as many threads in highly parallel tasks (e.g. sort, joinhelper etc), as there are cores on the underlying VM - irrespective of how many cores have been defined for the components resource.cpu configuration.

Conclusion

None

Activity

Show:

Gavin Halliday June 16, 2023 at 1:17 PM

Also worth discussing using whole numbers for the cpus combined with a static cpu management policy (https://kubernetes.io/docs/tasks/administer-cluster/cpu-management-policies/)

That is probably something to configure in AKS, but we could warn about fractional cpu resources for roxie/thor/dali that would prevent it being used effectively.

Fixed
Pinned fields
Click on the next to a field label to start pinning.

Details

Components

Assignee

Reporter

Priority

Fix versions

Pull Request URL

https://github.com/hpcc-systems/HPCC-Platform/pull/17484

Created June 16, 2023 at 12:23 PM
Updated June 28, 2023 at 8:44 AM
Resolved June 28, 2023 at 8:43 AM