YADE - Yet Another Data Exchange Tool
  1. YADE - Yet Another Data Exchange Tool
  2. YADE-293

YADE throws an error when operation getlist with WebDAV is used

    Details

    • Type: Fix Fix
    • Status: Dismissed (View Workflow)
    • Priority: Minor Minor
    • Resolution: Duplicate
    • Affects Version/s: 1.5.4014, 1.6.4043
    • Fix Version/s: None
    • Component/s: YADE Client
    • Labels:

      Description

      Current Situation

      • YADE supports the operation getlist over WebDAV since version 1.5.4041 onward
      • YADE also support WebDAV transfers over Proxys since version 1.5.4041 onward
      • For versions 1.5.4041 and 1.6.4043 the YADE getlist operation although complete with correct results e.g. filelist file has been written on file system, but at the end YADE throws an error
        *** ResultSet End ***
        main INFO  04:21:49,905   INFO (SOSDataExchangeEngine.java:626) ::printState SOSJADE_E_0100: No filename found which match the criteria as specified using the regular expression '^.*$'
        main INFO  04:21:49,905   INFO (SOSDataExchangeEngine.java:654) ::printState SOSJADE_E_0100: No filename found which match the criteria as specified using the regular expression '^.*$'
        main INFO  04:21:49,905   INFO (SOSDataExchangeEngine.java:976) ::transfer SOSJADE_E_0101: data transfer ended with error 'SOSJADE_E_0100: No filename found which match the criteria as specified using
         the regular expression '^.*$''
        changeEngine.java:627)
        

      Desired Behavior

      • Since there is no actual file transfer between source and target, YADE should not throw error
        "No Filename found....."

      Work Around

      • To avoid this error set parameter
        force_files            = false 
        

      How to reproduce

      • Download jade_settings.ini jade_settings_webdav.ini
      • Execute following CLI command
        C:\Program Files\sos-berlin.com\jade>jade_client_1.6.4075\bin\jade.cmd -settings=jade_settings_webdav.ini -profile=getlist_webdav_to_localhost_with_proxy
        

      YADE Session Log

      
      C:\Program Files\sos-berlin.com\jade>jade_client_1.6.4075\bin\jade.cmd -settings=jade_settings.ini -profile=getlist_webdav_to_localhost_with_proxy
      main INFO  04:53:25,505   INFO (SOSDataExchangeEngineMain.java:103) ::Execute SOSDataExchange - Main routine started ... -- 1.6.4075 (2014-03-16T22:40:36.062+0100) Copyright 2003-2014 SOS GmbH Berlin
      
      main INFO  04:53:25,521   INFO (SOSFTPOptions.java:1244) ::ChangeValue SOSVfs_I_263: Value of 'SOSFtpOptionsSuperClass.target_dir' overwritten with './'
      main INFO  04:53:25,521   INFO (SOSFTPOptions.java:1244) ::ChangeValue SOSVfs_I_263: Value of 'SOSFtpOptionsSuperClass.target_dir' overwritten with './'
      main INFO  04:53:25,521   INFO (SOSDataExchangeEngine.java:292) ::Execute $Id: SOSDataExchangeEngine.java 22830 2014-03-11 17:25:00Z kb $ -- 1.6.4075 (2014-03-16T22:40:36.062+0100) Copyright 2003-2014
       SOS GmbH Berlin
      main INFO  04:53:25,521   INFO (SOSOptionLogFileName.java:179) ::setLogger setLogger without instance of logger called.
      main INFO  04:53:25,536   INFO (SOSDataExchangeEngine.java:300) ::Execute
      *************************************************************************
      *                                                                       *
      *                JADE - JobScheduler Advanced Data Exchange             *
      *                ---www.sos-berlin.com---------------------             *
      *                                                                       *
      *************************************************************************
      version              = $Id: SOSDataExchangeEngine.java 22830 2014-03-11 17:25:00Z kb $ -- 1.6.4075 (2014-03-16T22:40:36.062+0100) Copyright 2003-2014 SOS GmbH Berlin
      date                 = 2015-04-23 04:53:25
      operation            = getlist
      protocol             = ftp
      port                 = 21
      file specification   = ^.*$
      file path            =
      local host           = MP
      local directory      = /home/test/outbound/
      target host          =
      target directory     = ./
      pid                  =
      *************************************************************************
      
      main INFO  04:53:25,583   INFO (SOSFTPOptions.java:1244) ::ChangeValue SOSVfs_I_263: Value of 'SOSFtpOptionsSuperClass.target_dir' overwritten with './'
      main INFO  04:53:26,840   INFO (SOSVfsWebDAV.java:1029) ::doAuthenticate using proxy: host homer.sos:3128 user = proxy_user
      main INFO  04:53:31,448   INFO (SOSDataExchangeEngine.java:786) ::setInfo 4 files found for regexp '^.*$'.
      main INFO  04:53:31,448   INFO (SOSDataExchangeEngine.java:898) ::transfer SOSJADE_I_0115: Operation 'getList' is specified. no transfer will be done.
      main INFO  04:53:31,448   INFO (SOSDataExchangeEngine.java:899) ::transfer SOSJADE_I_0115: Operation 'getList' is specified. no transfer will be done.
      *** ResultSet End ***
      main INFO  04:53:31,526   INFO (SOSFileList.java:496) ::CreateResultSetFile ResultSet to StdOut and to csv-File 'c:\__temp\getlist-output.txt.csv' written
      *** ResultSet Start ***
      aef86099-d188-4880-ab77-657e14e57d1d;SOS;2015-04-23 16:53:31;9316;0;getlist;https://mediacenter.gmx.net;213.165.67.60;Mahendra;;;;;21;/home/test/outbound/;;/home/test/outbound/TRX003DE20140708CET0400.
      DAT;n.a.;4;n.a.;waiting4transfer;;stdout; ;;22;sftp;;1970-01-01 01:00:00;aef86099-d188-4880-ab77-657e14e57d1d;SOS;2015-04-23 16:53:31;9316;0;getlist;https://mediacenter.gmx.net;213.165.67.60;Mahendra;
      ;;;;21;/home/test/outbound/;;/home/test/outbound/TRX003DE20140708CET0400.DAT;n.a.;4;n.a.;waiting4transfer;;stdout; ;;22;sftp;;1970-01-01 01:00:00
      5b6d800c-53c9-423e-acb3-bbaa4f26598e;SOS;2015-04-23 16:53:31;9316;0;getlist;https://mediacenter.gmx.net;213.165.67.60;Mahendra;;;;;21;/home/test/outbound/;;/home/test/outbound/TRX004DE20140708CET0400.
      DAT;n.a.;4;n.a.;waiting4transfer;;stdout; ;;22;sftp;;1970-01-01 01:00:00;5b6d800c-53c9-423e-acb3-bbaa4f26598e;SOS;2015-04-23 16:53:31;9316;0;getlist;https://mediacenter.gmx.net;213.165.67.60;Mahendra;
      ;;;;21;/home/test/outbound/;;/home/test/outbound/TRX004DE20140708CET0400.DAT;n.a.;4;n.a.;waiting4transfer;;stdout; ;;22;sftp;;1970-01-01 01:00:00
      15d714ed-dd9f-4bdf-a19e-2e5b836b24a5;SOS;2015-04-23 16:53:31;9316;0;getlist;https://mediacenter.gmx.net;213.165.67.60;Mahendra;;;;;21;/home/test/outbound/;;/home/test/outbound/TRX001DE20140708CET0400.
      DAT;n.a.;4;n.a.;waiting4transfer;;stdout; ;;22;sftp;;1970-01-01 01:00:00;15d714ed-dd9f-4bdf-a19e-2e5b836b24a5;SOS;2015-04-23 16:53:31;9316;0;getlist;https://mediacenter.gmx.net;213.165.67.60;Mahendra;
      ;;;;21;/home/test/outbound/;;/home/test/outbound/TRX001DE20140708CET0400.DAT;n.a.;4;n.a.;waiting4transfer;;stdout; ;;22;sftp;;1970-01-01 01:00:00
      78fff2a0-a60e-4e98-96ce-3bd084877427;SOS;2015-04-23 16:53:31;9316;0;getlist;https://mediacenter.gmx.net;213.165.67.60;Mahendra;;;;;21;/home/test/outbound/;;/home/test/outbound/TRX002DE20140708CET0400.
      DAT;n.a.;4;n.a.;waiting4transfer;;stdout; ;;22;sftp;;1970-01-01 01:00:00;78fff2a0-a60e-4e98-96ce-3bd084877427;SOS;2015-04-23 16:53:31;9316;0;getlist;https://mediacenter.gmx.net;213.165.67.60;Mahendra;
      ;;;;21;/home/test/outbound/;;/home/test/outbound/TRX002DE20140708CET0400.DAT;n.a.;4;n.a.;waiting4transfer;;stdout; ;;22;sftp;;1970-01-01 01:00:00
      *** ResultSet End ***
      main INFO  04:53:31,542   INFO (SOSDataExchangeEngine.java:626) ::printState SOSJADE_E_0100: No filename found which match the criteria as specified using the regular expression '^.*$'
      main INFO  04:53:31,542   INFO (SOSDataExchangeEngine.java:654) ::printState SOSJADE_E_0100: No filename found which match the criteria as specified using the regular expression '^.*$'
      main INFO  04:53:31,542   INFO (SOSDataExchangeEngine.java:976) ::transfer SOSJADE_E_0101: data transfer ended with error 'SOSJADE_E_0100: No filename found which match the criteria as specified using
       the regular expression '^.*$''
      com.sos.JSHelper.Exceptions.JobSchedulerException: SOSJADE_E_0100: No filename found which match the criteria as specified using the regular expression '^.*$'
              at com.sos.DataExchange.SOSDataExchangeEngine.printState(SOSDataExchangeEngine.java:627)
              at com.sos.DataExchange.SOSDataExchangeEngine.transfer(SOSDataExchangeEngine.java:961)
              at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:303)
              at com.sos.DataExchange.SOSDataExchangeEngineMain.Execute(SOSDataExchangeEngineMain.java:107)
              at com.sos.DataExchange.SOSDataExchangeEngineMain.main(SOSDataExchangeEngineMain.java:63)
      com.sos.JSHelper.Exceptions.JobSchedulerException: SOSJADE_E_0100: No filename found which match the criteria as specified using the regular expression '^.*$'
              at com.sos.DataExchange.SOSDataExchangeEngine.printState(SOSDataExchangeEngine.java:627)
              at com.sos.DataExchange.SOSDataExchangeEngine.transfer(SOSDataExchangeEngine.java:961)
              at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:303)
              at com.sos.DataExchange.SOSDataExchangeEngineMain.Execute(SOSDataExchangeEngineMain.java:107)
              at com.sos.DataExchange.SOSDataExchangeEngineMain.main(SOSDataExchangeEngineMain.java:63)
      com.sos.JSHelper.Exceptions.JobSchedulerException: SOSJADE_E_0101: data transfer ended with error 'SOSJADE_E_0100: No filename found which match the criteria as specified using the regular expression
      '^.*$''
              at com.sos.DataExchange.SOSDataExchangeEngine.transfer(SOSDataExchangeEngine.java:977)
              at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:303)
              at com.sos.DataExchange.SOSDataExchangeEngineMain.Execute(SOSDataExchangeEngineMain.java:107)
              at com.sos.DataExchange.SOSDataExchangeEngineMain.main(SOSDataExchangeEngineMain.java:63)
      main INFO  04:53:31,557   INFO (SOSDataExchangeEngine.java:315) ::Execute Elapsed time = 6036, per File = 6036, total bytes = 16
      main INFO  04:53:31,557   INFO (SOSDataExchangeEngine.java:320) ::Execute
      *************************************************************************
       execution status     = failure. Errors reported.
       successful transfers = 0
       failed transfers     = 0
       last error           = SOSJADE_E_0101: data transfer ended with error 'SOSJADE_E_0100: No filename found which match the criteria as specified using the regular expression '^.*$'' (SOSJADE_E_0101: da
      ta transfer ended with error 'SOSJADE_E_0100: No filename found which match the criteria as specified using the regular expression '^.*$'')
      *************************************************************************
      
      main ERROR 04:53:31,557   ERROR (SOSDataExchangeEngineMain.java:112) ::Execute SOSDataExchangeEngineMain::Execute: Error occurred ...: SOSJADE_E_0101: data transfer ended with error 'SOSJADE_E_0100: N
      o filename found which match the criteria as specified using the regular expression '^.*$'', exit-code 99 raised
      com.sos.JSHelper.Exceptions.JobSchedulerException: SOSJADE_E_0101: data transfer ended with error 'SOSJADE_E_0100: No filename found which match the criteria as specified using the regular expression
      '^.*$''
              at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:306)
              at com.sos.DataExchange.SOSDataExchangeEngineMain.Execute(SOSDataExchangeEngineMain.java:107)
              at com.sos.DataExchange.SOSDataExchangeEngineMain.main(SOSDataExchangeEngineMain.java:63)
      main ERROR 04:53:31,573   ERROR (SOSDataExchangeEngineMain.java:119) ::Execute SOSDataExchangeEngineMain::Execute - terminated with exit-code 99
      com.sos.JSHelper.Exceptions.JobSchedulerException: SOSJADE_E_0101: data transfer ended with error 'SOSJADE_E_0100: No filename found which match the criteria as specified using the regular expression
      '^.*$''
              at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:306)
              at com.sos.DataExchange.SOSDataExchangeEngineMain.Execute(SOSDataExchangeEngineMain.java:107)
              at com.sos.DataExchange.SOSDataExchangeEngineMain.main(SOSDataExchangeEngineMain.java:63)
      
      C:\Program Files\sos-berlin.com\jade>
      

        Issue Links

          Activity

          Hide
          Mahendra Patidar added a comment -

          Test profile

          Show
          Mahendra Patidar added a comment - Test profile
          Hide
          Mahendra Patidar added a comment -
          • Work around
          • set parameter
            force_files            = false 
            
          Show
          Mahendra Patidar added a comment - Work around set parameter force_files = false
          Hide
          Mahendra Patidar added a comment -
          • For this issue there is already a workaround
          Show
          Mahendra Patidar added a comment - For this issue there is already a workaround

            People

            • Assignee:
              TeamYADE
              Reporter:
              Mahendra Patidar
              Approver:
              Mahendra Patidar
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: