Versions Compared

Old Version 4

changes.mady.by.user Xiaoming Wang

Saved on

compared with

New Version Current

changes.mady.by.user Lorraine Chapman

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

This project was completed during the 2020 HPCC Systems Intern Program by Jefferson Mao, Lambert High School, Suwanee, GA, USA.

Find out about the HPCC Systems Summer Internship Program.The project proposal application period for 2020 summer internships is now closed. Check back in the Fall for details about applying to join our 2021 program.

Resources Available to Learn More about this completed project:

Project Description

HPCC Systems Platform 7.8+ is able to be deployed on local Kubernetes and Azure Kubernetes Service (AKS)  using "azurefile" as a out of box solution. We will add AWS EKS with EFS soon. Google Cloud is another major Cloud provider and we want to make HPCC System Platform can deployed on Google Kubernetes Engine (GKE) as well. We have some developers doing some initial work in this area (create a NFS pod and storage class, for example). Depends on their progress this intern program continue the work or make some improvements.  This project will cover Pod cover

1) Testing HPCCSystems Cluster   2) Pod Horizontal Autoscaler , Pod Vertical  Autoscaler and GKE Node Autoscaler. We also hope the student can explore  Google Cloud Run and 3) Explore Anthos support with HPCC Systems Platform Cluster on GKE.


nameHPCC Systems Cloud on Google Kubernetes Engine (GKE) initial work: View filenfs.yamlheight250 View filename and values-for-gke.yamlheight250

Reference following blogs for how to use these two files.

...

Completion of this project involveinvolved

1) Deploy HPCC Systems Platform 7.8+ Cluster on GKE

...

3) Optional support Pod Vertical Scaling and GKE node scaling

4) Explore and if possible provide supports of Cloud Run  Explore an initial support of Anthos for HPCC Systems Cluster

5) Explore and if possible provide initial support supports of Anthos Cloud Run for HPCC Systems Cluster

What must be completed to pass the evaluation and continue on  to complete the project>


Mentor

Xiaoming Wang
xiaoming.wang@lexisnexis.com

Backup Mentor: Godson Fortil
fortil.godson@lexisnexis.com

Skills needed
  • Ability to build and test the HPCC system (guidance will be provided).
  • LInux , Bash and maybe Python
  • Knowledge of Kubernetes, Docker Containers
  • Knowledge of Google Cloud
Deliverables

Midterm

  • Deploy HPCC System Cluster on GKE with Horizontal scaling Optional: Verical and test HPCCSystems Platform
  • Test with Horizontal scaling  and optional verical scaling and GEK Node autoscaler 

End of project

  • Deploy HPCC System Cluster on GKE with supports of various scaling
  • Provide solution or research result for cloud run and Anthos Anthos  and optional Cloud Run support
Other resources