Uploaded image for project: 'YADE - Yet Another Data Exchange Tool'
  1. YADE - Yet Another Data Exchange Tool
  2. YADE-372

YADE Client CheckSteadyState broken

    XMLWordPrintable

Details

    Description

      Current Behavior

      • YADE aborts transfer of a series of (identically sized) files arriving in a directory 'monitored' with CheckSteadyState shortly after incorrectly noting all files are steady:
        • main INFO  10:37:10,949   (SOSDataExchangeEngine.java:154) ::checkSteadyStateOfFiles steady check (5 of 10). break steady check. all files are steady.
          
        • YADE transfers the first fully downloaded file correctly and then attempts to transfer the second which is still being downloaded. It then aborts the transfer with the error:
        • Grund: com.sos.JSHelper.Exceptions.JobSchedulerException: SOSVfs_E_271: Dateigr÷▀e
      • The value of the CheckSteadyStateCount element is incorrectly shown in the log (10 is shown where the default of 30 is set).
      • The first file is correctly transferred, the second partially transferred, the third file arriving is not considered.
      • Transfer of a single file works without problem.

      Sample Output

        Version                 = 1.10.1-SNAPSHOT (2015-09-25 00:31, revision 1c90c33c019b5531ce3ac100148e17ef31132bc7) Copyright 2003-2015 SOS GmbH Berlin
        Date                    = 2015-09-29 10:37:00
        SettingsFile            = C:\Users\aa\jade_demo\editor\local_2_local_steady_state.ini
        Profile                 = local_2_local_steady_state
        Operation               = copy
        Transactional           = false
      
        +------------Source------------
        | Protocol              = local
        | Host                  = AA-Win7
        | Directory             = C:\Users\aa\jade_demo\a/
        | FileSpec              = ^test_large_.\.txt$
        | ErrorWhenNoFilesFound = true
        | Recursive             = false
        | Remove                = false
        | CheckSteadyInterval   = 2
        | CheckSteadyCount      = 10
      
        +------------Target------------
        | Protocol              = local
        | Host                  = AA-Win7
        | Directory             = C:\Users\aa\jade_demo\b/
        | OverwriteFiles        = true
      
      main INFO  10:37:00,924   (SOSDataExchangeEngine.java:1050) ::setInfo 3 files found for regexp '^test_large_.\.txt$'.
      main INFO  10:37:00,925   (SOSDataExchangeEngine.java:1050) ::setInfo checking file(s) for steady state
      main INFO  10:37:00,926   (SOSDataExchangeEngine.java:130) ::checkSteadyStateOfFiles steady check (1 of 10). waiting 2s.
      
      main INFO  10:37:02,931   (SOSDataExchangeEngine.java:148) ::checkSteadyStateOfFiles steady check (1 of 10). Changed. file size: new = 131072 bytes, old = 98304 bytes. 'C:\Users\aa\jade_demo\a\test_large_1.txt'
      main INFO  10:37:02,933   (SOSDataExchangeEngine.java:130) ::checkSteadyStateOfFiles steady check (2 of 10). waiting 2s.
      
      main INFO  10:37:04,940   (SOSDataExchangeEngine.java:148) ::checkSteadyStateOfFiles steady check (2 of 10). Changed. file size: new = 163840 bytes, old = 131072 bytes. 'C:\Users\aa\jade_demo\a\test_large_1.txt'
      main INFO  10:37:04,941   (SOSDataExchangeEngine.java:130) ::checkSteadyStateOfFiles steady check (3 of 10). waiting 2s.
      
      main INFO  10:37:06,946   (SOSDataExchangeEngine.java:148) ::checkSteadyStateOfFiles steady check (3 of 10). Changed. file size: new = 196608 bytes, old = 163840 bytes. 'C:\Users\aa\jade_demo\a\test_large_1.txt'
      main INFO  10:37:06,947   (SOSDataExchangeEngine.java:130) ::checkSteadyStateOfFiles steady check (4 of 10). waiting 2s.
      
      main INFO  10:37:08,948   (SOSDataExchangeEngine.java:148) ::checkSteadyStateOfFiles steady check (4 of 10). Changed. file size: new = 224498 bytes, old = 196608 bytes. 'C:\Users\aa\jade_demo\a\test_large_1.txt'
      main INFO  10:37:08,949   (SOSDataExchangeEngine.java:130) ::checkSteadyStateOfFiles steady check (5 of 10). waiting 2s.
      
      main INFO  10:37:10,949   (SOSDataExchangeEngine.java:154) ::checkSteadyStateOfFiles steady check (5 of 10). break steady check. all files are steady.
      main ERROR 10:37:10,977   (SOSFileListEntry.java:1133) ::setNoOfBytesTransferred SOSVfs_E_216: Dateigr÷▀enfehler f³r Datei 'C:\Users\aa\jade_demo\a\test_large_2.txt'. Anzahl der ³bertragenend Bytes: '49152', Dateigr÷▀e: '224498'
      main ERROR 10:37:10,979   (SOSFileListEntry.java:1027) ::run SOSVfs_E_229: Fehler. Daten³bertragung nicht m÷glich. Grund: com.sos.JSHelper.Exceptions.JobSchedulerException: SOSVfs_E_271: Dateigr÷▀e
      main ERROR 10:37:10,984   (SOSDataExchangeEngine.java:1275) ::transfer SOSDataExchangeEngine.TRANSFER_ABORTED
      main INFO  10:37:10,985   (SOSFileList.java:506) ::Rollback Rollback aborted files.
      main INFO  10:37:10,991   (SOSDataExchangeEngine.java:1450) ::sendTransferHistory No data sent to the background service due to missing host name
      main INFO  10:37:11,007   (SOSDataExchangeEngine.java:393) ::showResult
      *************************************************************************
       Ausf³hrungsstatus                 = Fehlerhaft.
       Erfolgreiche ▄bertragungen        = 1
       ▄bersprungene ▄bertragungen       = 0
       Fehlgeschlagene ▄bertragungen     = 2
       letzter aufgetretener Fehler      = SOSVfs_E_271: Dateigr÷▀e
      

      Example Configuration
      A working setup is described and an XML download file is available under the 'Check Steady State' section of the following YADE Tutorial:

      Desired Behavior

      • Completed arrival of the first file in a series should be correctly interpreted as the arrival of a single file and not that of all files.
      • The value of the CheckSteadyStateCount element should be correctly implemented.

      Attachments

        Issue Links

          Activity

            People

              oh Oliver Haufe
              aa Alan Amos
              Alan Amos Alan Amos
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 2 days
                  2d
                  Remaining:
                  Remaining Estimate - 2 days
                  2d
                  Logged:
                  Time Spent - Not Specified
                  Not Specified