Uploaded image for project: 'YADE - Yet Another Data Exchange Tool'
  1. YADE - Yet Another Data Exchange Tool
  2. YADE-542

PollingServer functionality is broken

    XMLWordPrintable

Details

    Description

      Current Situation

      • When YADE configured with PollingServer = true then the polling server starts polling trials endlessly (see PollForever) or until PollingServerDuration is reached. If some files are found inside a polling trial then these files are transferred before the next polling trial is started.
      • This functionality is broken:
        • YADE aborts the processing with an SftpATTRS is null exception when the Rename setting is used
        • Configuration item TransferZeroByteFiles - zero bytes handlig:
          • strict - YADE Client execution will be aborted if any zero byte file is found.
        • Configuration item DisableErrorOnNoFilesFounded - this parameter specifies whether an error should be raised if no files can be found for transfer:
          • false - YADE Client execution will be aborted if no files are found .
        • Configuration item PollingServerDuration - this parameter specifies how long the YADE polling server should run:
          • the YADE schema allows only usage of the numerical values. It means, the PollingServerDuration must be defined in seconds when the XML Editor is used.
        • Configuration item WaitForSourceFolder - this parameter determines the behavior of the polling when the source folder doesn't exist:
          • false - no error will be raised when the source directory doesn't exist.
        • Configuration item NotificationTriggers
          • Send a notification (OnSuccess, OnError, OnEmptyFiles) on program end.
          • OnSuccess, OnError, OnEmptyFiles notifications have the same content with the List of files.
            • OnError notification doesn't contain the error.
            • MailOnEmptyFiles notification contains the list of all files.
        • Lost the connection to the source|target during polling.
          • Polling without error detection. No reconnect functionality.
        • Aborting the YADE Client execution.
          • the connection to the source|target will be not closed properly.
          • no summary

      Desired Behaviour

      • The PollingServer functionallity should work as expected:
        • Configuration item TransferZeroByteFiles - zero bytes handling:
          • strict - if any zero byte file is found - abort the current polling period and continue the YADE Client execution.
        • Configuration item DisableErrorOnNoFilesFounded - this parameter specifies whether an error should be raised if no files can be found for transfer:
          • false - if no files are found - abort the current polling period and continue the YADE Client execution
        • Configuration item PollingServerDuration - this parameter specifies how long the YADE polling server should run:
          • Supported formats:
            • s(n) - seconds, e.g. 30,180...
            • m(n):s(n) - minutes:seconds, e.g. 10:30, 123:456 ...
            • h(n):m(n):s(n) - hours:minutes:seconds, e.g. 12:30:30, 123456:7:8 ...
        • Configuration item WaitForSourceFolder - this parameter determines the behavior of the polling when the source folder doesn't exist:
          • false - abort the YADE Client execution when the source folder doesn't exist.
        • Configuration item NotificationTriggers
          • Send a notification (OnSuccess, OnError, OnEmptyFiles) after each file transfer.
          • All notification types should be contain a possible error message and the List of files with the file transfer status (transferred, transfer_aborted, skipped etc.) and the file size.
            • MailOnEmptyFiles notification should be contain the list of all empty files.
        • Lost the connection to the source|target during polling.
          • Providing reconnection functionality
        • Aborting the YADE Client execution.
          • the connection to the source|target should be closed properly.
          • show summary

       
      Applicable YADE Client releases

      A patch is available for download with YADE Client releases:

      • YADE Client 1.13.0
        • Download the patch patch-20190916-YADE-541.542-1.13.0.zip.
        • Extract the patch-20190916-YADE-541.542-1.13.0.zip to any_ location.
        • Remove patch provided by YADE-541 ({$yade_home}/lib/3rd-party/patch-yade-1.13.0.jar) if exists.
        • Copy patch-20190916-YADE-541.542-1.13.0.jar to the {$yade_home}/lib/3rd-party directory.
        • Use provided YADE_configuration_v1.12.xsd schema file to configure the YADE settings with the XML Editor.

       

      Attachments

        Activity

          People

            re Robert Ehrlich
            re Robert Ehrlich
            Robert Ehrlich Robert Ehrlich
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: