Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Find out about the HPCC Systems Summer Internship Program.

Project Description

Neural Networks have become a key mechanism for the analysis of many types of data.  In particular they have been found to be very effective for the analysis of complex datasets such as images, video, and time-series, where classical methods have proven inadequate. The Generalized Neural Network Bundle (GNN) allows the ECL programmer to combine the parallel processing power of HPCC Systems with the powerful Neural Network capabilities of Keras and Tensorflow. The GNN bundle attaches each node in the HPCC Systems cluster to an independent Keras/Tensorflow environment and coordinates among those environments to provide a distributed environment that can parallelize all phases of Keras/Tensorflow usage. Most importantly this coordination is transparent to the GNN user, who can program as if running on a single node.

Despite the GNN implementation, endless variations and combinations of the neural network techniques continue to be proposed in order to push the state of the art in machine learning and optimization. This project will research, implement, and evaluate alternative methods for distributed training of Neural Networks.   Then, implement the most promising methods on HPCC Systems Platform using the GNN module. Design and implement bundle.

This work involves the design and implementation of alternative distribution models for parallelized training and evaluation of neural networks using the HPCC Systems GNN module bundle and Tensorflow.   Evaluate The student will evaluate the various methods, and document the new capabilities, including guidance as to which algorithms are preferable for different scenarios.

...

Mentor

Lili Xu
lili.xu@lexisnexisrisk.com

Backup Mentor: Roger Dev
roger.dev@lexisnexisrisk.com

Skills needed
  • Ability to build and test the HPCC system (guidance will be provided).
  • Ability to write test code.
  • Knowledge of ECL. Links are provided below to our ECL training documentation and online courses for you to become familiar with the ECL language.
Other resources