Uploaded image for project: 'YADE - Yet Another Data Exchange Tool'
  1. YADE - Yet Another Data Exchange Tool
  2. YADE-471

Improve pre- and post-processing for skipped transfers and failed transfers

    XMLWordPrintable

Details

    Description

      Current Situation

      • Pre-Processing occurs on the following events:
        • CommandBeforeFile
          • Processing is performed for target files that can be written.
          • Processing is dropped in case of skipped transfers
            • e.g. in case that existing should not be overwritten
              • DisableOverwriteFiles (mapping overwrite_files=false)
          • Processing is performed for the first file in case of failed transfers
            • e.g. if target folders do not exist
        • CommandBeforeOperation
          • Processing is performed in any situation
      • Post-Processing occurs on the following events:
        • CommandAfterFile Event
          • Processing is performed in case of skipped transfers
          • Processing is dropped in case of failed transfers
        • CommandAfterOperation Event
          • Processing is performed in case of skipped transfers
          • Processing is dropped in case of failed transfers
            • e.g. if target folders do not exist

      DesiredBehavior

      • Users would want to control in which situation pre- and post-processing scripts should be executed.
      • Pre-Processing
        • CommandBeforeFile
          • Attribute: enable_for_skipped_transfer.
            • The default value is false which corresponds to the behavior with previous releases.
            • Mapping: pre_command_enable_for_skipped_transfer
      • Post-Processing
        • CommandAfterFile
          • Attribute: disable_for_skipped_transfer.
            • The default value is false which corresponds to the behavior with previous releases.
            • Mapping: post_command_disable_for_skipped_transfer
        • Environment variables in the SFTPPostProcessing and LocalPostProcessing:
          • YADE_FILE_TRANSFER_STATUS
            • possible values: transferUndefined, waiting4transfer, transferring, transferInProgress, transferred, transfer_skipped, transfer_has_errors, transfer_aborted, compressed, notOverwritten, deleted, renamed, ignoredDueToZerobyteConstraint, setBack, polling
          • YADE_FILE_IS_TRANSFERRED
            • possible values: 0 or 1

      Configuration requirements

      Attachments

        Issue Links

          Activity

            People

              re Robert Ehrlich
              ap Andreas PĆ¼schel
              Oliver Haufe Oliver Haufe
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: