...
To accomplish this, the following process needs to be followed:
- Make an educated guess of bucket limits (probably for each method) and add support to the SCM file
- Run a variety of tests against the service that represents a mix of work
- Review the results in Prometheus (or the file or log sink could be used)
- Adjust the bucket limits to improve the distribution, repeat starting at 2 above
These steps need to be executed iteratively through each ESP service for which execution profiling needs to be enabled and would give us a valid starting point to collect ESP service metrics.requirements must be considered:
- It should be completely generalized with no special casing - configured purely by the XML files.
- It should be integrated with the Linux command completion and provide context sensitive completion.
- It should have build in help, also generated from the XML files.
- Extension: The output could be controlled to use JSON/XML and it could use XPATH to extract values from the result.
- It would initially only support scalar arguments.
Completion of this project involves:
- Learning general HPCC Systems architecture
- Learning ESP web services frameworkLearning monitoring tools such as Prometheus
- Development of a functional command line tool as specified above
- Creation of test cases for web ESP services and specific methodsDefinition of appropriate bucket limits for each method/service
- Creation of documentation including a github repository for the project
Mentor | Ken Rowland Backup Mentor: TBD |
Skills needed |
|
Other resources |