Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

Spark use of keys: filtered index read

Description

The HpccFile object will create a Dataset<Row> object that performs a filtered read of the keyed.  The high level index with the file part map will be used to partition the dataset into approximately equal partitions.

Conclusion

None

relates to

Activity

Show:

Rodrigo Pastrana July 3, 2018 at 6:58 PM

this one has been resolved.

John Holt July 3, 2018 at 12:02 PM

Yes.  We now support pulling keys with index filtering.  It also added row filtering for sequential datasets.  So, we now support removal of both columns and rows at the HPCC node.

Rodrigo Pastrana July 2, 2018 at 1:44 PM

Fixed
Pinned fields
Click on the next to a field label to start pinning.

Details

Components

Assignee

Reporter

Priority

Compatibility

Major

Fix versions

Pull Request URL

Created March 27, 2018 at 9:07 PM
Updated July 4, 2018 at 8:07 AM
Resolved July 4, 2018 at 8:07 AM