Versions Compared

Old Version 1

changes.mady.by.user Lorraine Chapman

Saved on

compared with

New Version 2

changes.mady.by.user Xiaoming Wang

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The full title of this project is:

Deploy HPCC Systems Platform on Google Kubernetes Engine (GKE). Apply Node Autoscaler, Pod Horizontal Autoscaler and Pod Vertical Pod Autoscaler.  Explore Google Cloud Run and Anthos support with HPCC Systems Platform Cluster on GKE.

Instructions: Delete this section when complete. Use this template to specify the parameters of a new project idea. Project ideas must be suitable for student to complete during a 12 week internship. Projects may contribute a new feature, enhancement, POC to the HPCC Systems Platform or an interesting use case leveraging HPCC Systems. Supply enough information that it is clear what must be included in a project proposal seeking to solve the problem/produce the desired result. Supply links to additional resources and itemise a checklist of deliverables.

Find out about the HPCC Systems Summer Internship Program.

The project proposal application period for 2020 summer internships is now closed. Check back in the Fall for details about applying to join our 2021 program.

Project Description

More details coming soon.HPCC Systems Platform 7.8+ is able to be deployed on local Kubernetes and Azure Kubernetes Service (AKS)  using "azurefile" as a out of box solution. We will add AWS EKS with EFS soon. Google Cloud is another major Cloud provider and we want to make HPCC System Platform can deployed on Google Kubernetes Engine (GKE) as well. We have some developers doing some initial work in this area (create a NFS pod and storage class, for example). Depends on their progress this intern program continue the work or make some improvements.  This project will cover Pod Horizontal Autoscaler , Pod Vertical  Autoscaler and GKE Node Autoscaler. We also hope the student can explore  Google Cloud Run and Anthos support with HPCC Systems Platform Cluster on GKE.

If you are interested in this project, please contact Add email link to mentor.

Completion of this project involves:

  • <4+ high level tasks to be completed>

By the mid term review we would expect you to have:

...

involve

1) Deploy HPCC Systems Platform 7.8+ Cluster on GKE

2) At least support Pod Horizontal Scaling PH.

3) Optional support Pod Vertical Scaling and GKE node scaling

4) Explore and if possible provide supports of Cloud Run for HPCC Systems Cluster

5) Explore and if possible provide initial support of Anthos for HPCC Systems Cluster

What must be completed to pass the evaluation and continue

...

on  to complete the project>


Mentor

Xiaoming Wang

Add link to Email Address 

xiaoming.wang@lexisnexis.com

Backup Mentor: 

Add Backup Mentor Name
Add link to Email Address 
Skills needed
<See below some ideas add ones appropriate to the project.>

Godson Fortil
fortil.godson@lexisnexis.com

Skills needed
  • Ability to build and test the HPCC system (guidance will be provided).
  • Ability to write test code. Knowledge of ECL is not a requirement since it should be possible to re-use existing code with minimal changes for this purpose. Links are provided below to our ECL training documentation and online courses should you wish to become familiar with the ECL  language.
    • Deliverables

    Midterm

    • <Deliverable(s) to be achieved>

    End of project

    <Deliverables expected by the end of the internship>
    • LInux , Bash and maybe Python
    • Knowledge of Kubernetes, Docker Containers
    • Knowledge of Google Cloud
    Deliverables

    Midterm

    • Deploy HPCC System Cluster on GKE with Horizontal scaling
    • Optional: Verical scaling and GEK Node autoscaler 

    End of project

    • Deploy HPCC System Cluster on GKE with supports of various scaling
    • Provide solution or research result for cloud run and Anthos support
    Other resources
    <Where relevant or other online resource>Existing examples: <github links etc>