Implement a Preprocessing Bundle for HPCC Systems Machine Learning Library

This project is available as a student work experience opportunity with HPCC Systems this summer. Curious about other projects we are offering? Take a look at our Ideas List. 

Find out about the HPCC Systems Summer Internship Program.

The project proposal application period for 2020 summer internships is now closed. Check back in the Fall for details about applying to join our 2021 program.

Project Description

The student will produce a pre-processing bundle as part of the HPCC System Machine Learning Library that assists the user in performing some of the basic tasks of preparing their data for use with various ML Algorithms. The aim is to create tools in ECL to be added to the HPCC Systems machine learning library in the form of bundle to prepare data. Some examples of tools to be added are

• One-hot encoding/decoding
• Variable normalization and standardization
• Scaling
• Various sampling methods
• Other important pre-processing tasks identified during the course of the project

The project is open to accepting other suggested tools that users of the HPCC Systems ML library may find useful.

Completion of this project involves:

• Implementation of proposed pre-processing tools in ECL
• Unit Testing
• Code check in on Github
• Documentation
• White Paper

By the mid term review we would expect you to have:

• Implemented at least 60% of the proposed tools