Details
-
Feature
-
Status: Deferred (View Workflow)
-
Minor
-
Resolution: Unresolved
-
None
-
None
Description
Feature
- A file order source can be configured to wait for a group of files.
- One file is configured as with the existing feature for a <file_order_source>. This file is moved or removed by JobScheduler according to a <file_order_sink> configuration.
- Additional files can be configured to be waited for until the file group is complete. Each additional file can be specified separately by a regular expression.
- Implications
- For additional files a separate directory can be specified for file watching
- The file path of additional files is provided with the parameter scheduler_required_files with file paths being separated by semicolon.
- Additional files are not moved or removed by JobScheduler as for the first file with a file_order_sink.
- Example
<file_order_source directory="/input" regex="data-([0-9]+)\.txt"> <require_file regex="data-\1-[a-z+]-a.txt"/> <require_file directory="/input2" regex="data-\1-[a-z+]-b.txt"/> </file_order_source>
Maintainer Notes
- This feature is not assigned to a release for immediate implementation.
- Please vote for this issue and let us know your feedback.