Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

These videos were created by Allan Wrobel (Consulting Software Engineer). Allan has been working in the IT industry his entire adult life and has been an employee with LexisNexis Risk Solutions Group since 2010.

How to...

Use ECL Macros Session 1- A worked through case
A explanation of ECL (Enterprise Control Language) MACROS using a real life case study. Compare attributes between two key build where the number of attributes is so large that using MACROS is the only solution.

Use ECL Macros Session 2- A worked through case
Constructing a new output layer.

Use ECL Macros Session 3- A worked through case
Generating an email using ECL to act on the information discovered in the previous session
Use ECL Built in Functions: PROJECT
Converting records in a dataset from one format to another.

Use ECL Built in Functions: TABLE (Vertical Slice)
Taking an import dataset in one format and generating an output dataset in another format. 

Use ECL Built in Functions: TABLE (CrossTab)
Getting statistics on input datasets grouped by fields within the dataset.

Use ECL Built in Functions: ITERATE
Processes all records in the recordset one pair of records at a time, performing the transform function on each pair in turn.

Use ECL Built in Functions: PROCESS (Part 1)
Processes all records in the recordset one pair of records at a time, performing the datasettransform function on each pair of records in turn.
Use ECL Built in Functions: PROCESS (Part 2)
Processes all records in the recordset one pair of records at a time, performing the datasettransform function on each pair of records in turn.
Use ECL Built in Functions: GRAPH
A useful and underused function allowing you to search a dataset with different attributes/dimensions which have multiple values. Code examples for this tip can be found in the related HPCC Systems Tips and Trick Forum post.
Use ECL Built in Functions: NORMALIZE (COUNT Variant)
This is the simplest of the 2 NORMALIZE functions. This variant is used to call a TRANSFORM repeatedly for each record in a dataset. An interesting use of the NORMALIZE function can also be found in the HPCC Systems ECL Programmer's Guide.

Use ECL Built in Functions: NORMALIZE (Child Dataset Extraction)
This variant of the NORMALIZE function is used to extract child datasets from an hierarchical dataset.

Use ECL Built in Functions: NORMALIZE (Additional Information)
Find out more about some additional items such as using child datasets inside child datasets and the behaviour of SKIP.

Use ECL Built in Functions: DENORMALIZE (Single Record Presentation Variant)
The inverse to NORMALIZE. This variant covers where inputs are presented singularly to the TRANSFORM. This video also mentions some subtleties of the behaviour of this function.

Use ECL Built in Functions: DENORMALIZE (GROUP Presentation Variant)
The inverse to NORMALIZE for child datasets. This variant covers when Child records are presented as DATASETs to the TRANSFORM.
Use ECL Built in Functions: ECL DICTIONARY (Examples of use)
DICTIONARY is a fast lookup for very large tables/datasets. This video expands on the examples included in the HPCC Systems ECL Language Reference Guide.
Use ECL Built in Functions: Working with distributed data (TABLE, ROLLUP and AGGREGATE)
How to mine data using the HPCC Systems Architecture.
Use ECL Built in Functions: ROLLUP (Part 1)
Allows you to deduplicate records with the additional facility to capture information from input records while deduplicating the same.

Use ECL Built in Functions: ROLLUP (Part 2)
Follows on from part 1 in this series covering how to preserve the information from one record to the next between iterations and while deduping.

Use ECL Built in Functions: ECL #EXPORT and #EXPORTXML
Processing record structures at compile time using MACROS.

Use ECL Built in Functions: DEDUP
The DEDUP function evaluates the recordset for duplicate records, as defined by the condition parameter, and returns a unique return set

Understand the differences Between Build and definition files in HPCC Systems 
Use Aggregates on sub sets of data in a cross tab report
Learn about ECL Gotchas: Explicit return types from functions
Use ECL PROJECT different from other built Ins
Be clear about the context in which the ECL FUNCTIONMACROs run
Be wary of using the Compiler hint DISTRIBUTED in ECL 
Find a Better way to optimise out file re-distributions using DISTRIBUTED
Resolve common ECL errors with unhelpful compiler messages
Understand the Distribution of data on HPCC Systems, with an example
Use ECL/HPCC Systems Events, Including Scheduling Events
Understand the idiosyncrasies of ECL MACROs and #EXPAND