Add LZ4 HC (High Compression)

Description

LZ4 is very fast, both compressing and decompressing, but has a lower compression ratio on average than LZW.
LZ4HC offers similar compression ratios to LZW (slightly better on average), and decompression speeds are the same (as LZ4).

Compression is significantly slower though, similar to LZW.

For use cases where disk space is a premium and reads are far more frequent than writes, this would be a good choice.

Conclusion

None

Activity

Show:

Jacob Cobbett-Smith July 27, 2020 at 2:00 PM

NB: files written with this compressor implementation are backward compatible with the existing LZ4 decompressor, so files written with this compressor in 7.10.10 will be readable by earlier platform versions.

To use this compression implementation, either provide 'forceLZ4HC' as a HINT, or as a workunit #option, or as a global Thor config option.
NB: this option only effects published outputs.

1) as a HINT , e.g.:

2) as a #option

3) as a global Thor config option

set forceLZ4HC="true" under the Debug section in the Thor configuration.

Fixed
Pinned fields
Click on the next to a field label to start pinning.

Details

Components

Assignee

Reporter

Priority

Fix versions

Pull Request URL

Created July 22, 2020 at 11:12 AM
Updated July 27, 2020 at 2:00 PM
Resolved July 27, 2020 at 1:46 PM