Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The proposal period for 2022 internships is now open
Submit your final proposal to Lorraine Chapman before Friday 18th March 2022


Project Description

Provide helm chart examples CSI driver support on various cloud providers and storage types,  for  example Azure Azurefile,  AWS EFS and FSx Lustre, etc.

...

Azurefile with CSI driver: https://docs.microsoft.com/en-us/azure/aks/azure-files-csi. Current HPCC Helm Chart example for Azure File (without CSI driver): https://github.com/hpcc-systems/helm-chart/tree/master/helm/examples/azure

AWS EFS with CSI driver: https://docs.aws.amazon.com/eks/latest/userguide/efs-csi.html. Current HPCC Helm Chart example for AWS EFS  (without CSI driver): https://github.com/hpcc-systems/helm-chart/tree/master/helm/examples/efs

AWS FSx Lustre with CSI driver: https://docs.aws.amazon.com/eks/latest/userguide/fsx-csi.html. It is optional

Student can based on current Azure File and EFS examples and adapt them to CSI driver.

Student work experience opportunities also exist for students who want to suggest their own project idea. Project suggestions must be relevant to HPCC Systems and of benefit to our open source community. 

This project is mainly for community user instead of HPCCSystems internal users

Find out about the HPCC Systems Summer Internship Program.Project Description


There are probably other similar storage solutions in public clouds. We already have one for EFS/CSI. More information coming soon.

...

Completion of this project involves:

By the mid term review we would expect you to have:

  • Coming soonUnderstand CSI driver and finish basic Azure File with CSI implementation for HPCCSystems Cluster Deployment
Mentor

Xiaoming Wang
Contact Details

Backup Mentor: Godson Fortil
Contact Details

Skills needed
  • General Cloud Environment knowledge
  • AWS EC2, Client API (shell), S3, Docker, Jenkins, Packer
  • Unix Shell, Pythoin
  • Ability to build and test the HPCC system (guidance will be provided).
  • Ability to write test code. Knowledge of ECL is not a requirement since it should be possible to re-use existing code with minimal changes for this purpose. Links are provided below to our ECL training documentation and online courses should you wish to become familiar with the ECL  language.
Deliverables

Midterm

End of project

Other resources