Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The implementation can be done completely in the ECL language and only a knowledge of ECL and distributed computing techniques is required.  A knowledge of linear algebra will be helpful.

Completion of this project involves:

  • Selection of the test data. The test data will be a collection of open data text documents.  The collection must have an open data license or be completely free of copyright restrictions.  The most important aspect of the collection is that you will be familiar with the subjects in the collection so that you can judge the effectiveness of your implementation.  The test text collection should be composed of 1000 to 10000 documents.  
  • Development of the algorithm using ECL.
  • Testing the algorithm for correctness and performance.

By the GSoC mid term review we would expect you to have written :

  • Written the ECL needed to process the text documents into a dataset of term vectors.
Mentor

John Holt
Contact Details

Skills needed
  • Knowledge of ECL. Training manuals and online courses are available on the HPCC Systems website.
  • Knowledge of distributed computing techniques
Deliverables
  • Test code demonstrating the correctness and performance of the algorithm.
  • Supporting documentation.
Other resources