Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

To accomplish this, the following process needs to be followed:

  1. Make an educated guess of bucket limits (probably for each method) and add support to the SCM file
  2. Run a variety of tests against the service that represents a mix of work
  3. Review the results in Prometheus (or the file or log sink could be used)
  4. Adjust the bucket limits to improve the distribution, repeat starting at 2 above

These steps need to be executed iteratively through each ESP service for which execution profiling needs to be enabled and would give us a valid starting point to collect ESP service metrics.requirements must be considered:

  1. It should be completely generalized with no special casing - configured purely by the XML files.
  2. It should be integrated with the Linux command completion and provide context sensitive completion.
  3. It should have build in help, also generated from the XML files.
  4. Extension: The output could be controlled to use JSON/XML and it could use XPATH to extract values from the result.
  5. It would initially only support scalar arguments. 

Completion of this project involves:

  • Learning general HPCC Systems architecture
  • Learning ESP web services frameworkLearning monitoring tools such as Prometheus
  • Development of a functional command line tool as specified above
  • Creation of test cases for web ESP services and specific methodsDefinition of appropriate bucket limits for each method/service 
  • Creation of documentation including a github repository for the project
Mentor

Ken Rowland
Kenneth.Rowland@lexisnexisrisk.comTBD
TBD

Backup Mentor: 

TBD

Skills needed
  • General knowledge of Linux and web services development
  • Self-motivated to learn about HPCC Systems and monitoring tools such as Prometheus (guidance will be provided)
  • Willing to explore new technologies
  • Basic programming skills such as Unix shell (bash), WSDL, Python, etc
Other resources