test spray single file and multiple from a zip file
Description
Conclusion
Attachments
Activity
Attila Vamos June 13, 2023 at 10:01 PM
I am not sure I can understand what and ho it expects.
I created a small zip file with 2 csv files:
So, there are only the files without any directory structure .
I tried to spray the second one (Data-00000008-b.csv) with:
It is failed with: Could not open source file //192.168.1.52:7100/var/lib/HPCCSystems/mydropzone/Data-00000008.zip/Data-00000008-b.csv
The next attempt was:
Failed as well with: No Drop Zone on '192.168.1.52' configured at '/var/lib/HPCCSystems/myesp/Data-00000008.zip/Data-00000008-b.csv'.
Next attempt:
It is started, but soon failed with: assert(tail) failed - file: archive.cpp, line 67
It failed at the second call of splitArchivedFileName() (called from ArchiveDirectoryIterator ctor), where fullName is "/var/lib/HPCCSystems/mydropzone/Data-00000008.zip" without trailing '/' therefore splitName returns with NULL.
Adding a trailing '/' doesn't fix the problem, because the relDir in ArchiveDirectoryIterator::first() is nullptr and memcmp() in line 523 throws an exception.
Gavin Halliday June 12, 2023 at 9:53 AM
please can you test this functionality? Someone told me teams are currently unzippping files before spraying and as far as I know that should not be necessary. If this can be be tested and documented that would be great.
Details
Details
Components
Assignee
Reporter
Priority
Major
I think it should be possible to directly spray one or more files from a zip file by using the input fileame
fullzipfilename.zip/<path-within-zip>
It would be really good to test and document this functionality. It will require the libarchivefile.so to be registered as a file plugin. If this is not automatically available it should be fixed.