Uploaded image for project: 'YADE - Yet Another Data Exchange Tool'
  1. YADE - Yet Another Data Exchange Tool
  2. YADE-228

YADE failed operation should be written as a history entry into history.csv

    XMLWordPrintable

Details

    Description

      Current Situation

      • If a YADE operation failed due to a wrong profile or incorrect settings or a target that is not reachable then YADE throws an error but the history entry status field shows wating4transfer. This should be error or failed.
      • See YADE-227

      History entry

      7e182fdc-b2fe-4edf-82fc-20ff5586c81a;SOS;2014-11-25 10:12:10;65505;0;copy;localhost;127.0.0.1;jenkins;mediacenter.gmx.net;213.165.67.60;sos.apl@gmx.de;webdav;443;/home/jenkins/jade_test/out/XX/;/home/test/inbound/;/home/jenkins/jade_test/out/XX/;n.a.;0;n.a.;waiting4transfer;;/home/jenkins/sos-berlin.com/jade/log/jade_history.log; ;;22;sftp;;1970-01-01 01:00:00

      Error log

      2014-11-25 10:11:49.245+0100 [info]   ************************************************************************* 
2014-11-25 10:11:49.245+0100 [info]   *                                                                       * 
2014-11-25 10:11:49.245+0100 [info]   *                JADE - JobScheduler Advanced Data Exchange             * 
2014-11-25 10:11:49.245+0100 [info]   *                ---www.sos-berlin.com---------------------             * 
2014-11-25 10:11:49.245+0100 [info]   *                                                                       * 
2014-11-25 10:11:49.245+0100 [info]   ************************************************************************* 
2014-11-25 10:11:49.245+0100 [info]   version              = $Id: SOSDataExchangeEngine.java 27865 2014-10-31 15:45:55Z oh $ -- 1.7.4321 (2014-11-20 13:42, revision 28277) Copyright 2003-2014 SOS GmbH Berlin 
2014-11-25 10:11:49.245+0100 [info]   date                 = 2014-11-25 10:11:49 
2014-11-25 10:11:49.245+0100 [info]   operation            = copy 
2014-11-25 10:11:49.245+0100 [info]   protocol             = webdav 
2014-11-25 10:11:49.245+0100 [info]   port                 = 21 
2014-11-25 10:11:49.245+0100 [info]   file specification   = ^TRX[0-9]{3}DE[0-9]{8}CET[0-9]{4}.DAT.OUT$  
2014-11-25 10:11:49.245+0100 [info]   file path            =  
2014-11-25 10:11:49.245+0100 [info]   local host           = gollum.sos 
2014-11-25 10:11:49.245+0100 [info]   local directory      = /home/jenkins/jade_test/out/XX/ 
2014-11-25 10:11:49.245+0100 [info]   target host          = https://mediacenter.gmx.net 
2014-11-25 10:11:49.245+0100 [info]   target directory     = /home/test/inbound/ 
2014-11-25 10:11:49.245+0100 [info]   pid                  =    
2014-11-25 10:11:49.245+0100 [info]   ************************************************************************* 
2014-11-25 10:11:49.245+0100 [info]   
2014-11-25 10:12:10.494+0100 [info]    INFO [main] (SOSFileListEntry.java:812) - SOSVfs_I_0108: transfer of /home/jenkins/jade_test/out/XX/ started
2014-11-25 10:12:10.504+0100 [ERROR]  ERROR [main] (SOSFileListEntry.java:997) - SOSVfs_E_229: error. unable to transfer data, reason: com.sos.JSHelper.Exceptions.JobSchedulerException: SOSVfs_E_226: .. file '/home/jenkins/jade_test/out/XX/' does not exist.
2014-11-25 10:12:10.511+0100 [ERROR]  ERROR [main] (SOSDataExchangeEngine.java:963) - SOSDataExchangeEngine.TRANSACTION_ABORTED
2014-11-25 10:12:10.516+0100 [info]    INFO [main] (SOSDataExchangeEngine.java:964) - SOSDataExchangeEngine.TRANSACTION_ABORTED
2014-11-25 10:12:10.520+0100 [info]    INFO [main] (SOSFileList.java:551) - SOSVfs_I_211: Rollback initiated.
2014-11-25 10:12:10.525+0100 [info]    INFO [main] (SOSFileList.java:552) - SOSVfs_I_211: Rollback initiated.
2014-11-25 10:12:10.530+0100 [info]    INFO [main] (SOSFileList.java:594) - SOSVfs_D_213: Transfer-operation 'copy' started at 20141125101149, ended at 20141125101210. Duration: 21000
2014-11-25 10:12:10.540+0100 [info]    INFO [main] (SOSDataExchangeEngine.java:984) - SOSJADE_E_0101: data transfer ended with error 'SOSVfs_E_229: error. unable to transfer data, reason: com.sos.JSHelper.Exceptions.JobSchedulerException: SOSVfs_E_226: .. file '/home/jenkins/jade_test/out/XX/' does not exist.'
2014-11-25 10:12:10.545+0100 [info]    INFO [main] (SOSDataExchangeEngine.java:304) - Elapsed time = 21319, per File = 21319, total bytes = 0
2014-11-25 10:12:10.550+0100 [info]    INFO [main] (SOSDataExchangeEngine.java:314) - 
2014-11-25 10:12:10.550+0100 [info]   ************************************************************************* 
2014-11-25 10:12:10.550+0100 [info]    execution status     = failure. Errors reported. 
2014-11-25 10:12:10.550+0100 [info]    successful transfers = 0 
2014-11-25 10:12:10.550+0100 [info]    failed transfers     = 0 
2014-11-25 10:12:10.550+0100 [info]    last error           = SOSVfs_E_229: error. unable to transfer data, reason: com.sos.JSHelper.Exceptions.JobSchedulerException: SOSVfs_E_226: .. file '/home/jenkins/jade_test/out/XX/' does not exist. (SOSVfs_E_229: error. unable to transfer data, reason: com.sos.JSHelper.Exceptions.JobSchedulerException: SOSVfs_E_226: .. file '/home/jenkins/jade_test/out/XX/' does not exist.) 
2014-11-25 10:12:10.550+0100 [info]   *************************************************************************
2014-11-25 10:12:10.550+0100 [info]   
2014-11-25 10:12:10.555+0100 [ERROR]  ERROR [main] (SOSDExJSAdapterClass.java:74) - SOSDExJSAdapterClass ended abnormal.
2014-11-25 10:12:10.560+0100 [ERROR]  ERROR [main] (SOSDExJSAdapterClass.java:75) - SOSVfs_E_229: error. unable to transfer data, reason: com.sos.JSHelper.Exceptions.JobSchedulerException: SOSVfs_E_226: .. file '/home/jenkins/jade_test/out/XX/' does not exist.
2014-11-25 10:12:10.560+0100 [ERROR]  com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:295)
2014-11-25 10:12:10.560+0100 [ERROR]  sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115)
2014-11-25 10:12:10.560+0100 [ERROR]  sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70)
2014-11-25 10:12:10.560+0100 [ERROR]  
2014-11-25 10:12:10.578+0100 [info]   com.sos.JSHelper.Exceptions.JobSchedulerException: SOSVfs_E_226: .. file '/home/jenkins/jade_test/out/XX/' does not exist.
2014-11-25 10:12:10.578+0100 [info]   	at com.sos.VirtualFileSystem.DataElements.SOSFileListEntry.run(SOSFileListEntry.java:848)
2014-11-25 10:12:10.578+0100 [info]   	at com.sos.DataExchange.SOSDataExchangeEngine.sendFiles(SOSDataExchangeEngine.java:738)
2014-11-25 10:12:10.578+0100 [info]   	at com.sos.DataExchange.SOSDataExchangeEngine.transfer(SOSDataExchangeEngine.java:920)
2014-11-25 10:12:10.578+0100 [info]   	at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:292)
2014-11-25 10:12:10.578+0100 [info]   	at sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115)
2014-11-25 10:12:10.578+0100 [info]   	at sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70)
2014-11-25 10:12:10.578+0100 [info]   com.sos.JSHelper.Exceptions.JobSchedulerException: SOSVfs_E_229: error. unable to transfer data, reason: com.sos.JSHelper.Exceptions.JobSchedulerException: SOSVfs_E_226: .. file '/home/jenkins/jade_test/out/XX/' does not exist.
2014-11-25 10:12:10.578+0100 [info]   	at com.sos.VirtualFileSystem.DataElements.SOSFileListEntry.run(SOSFileListEntry.java:998)
2014-11-25 10:12:10.578+0100 [info]   	at com.sos.DataExchange.SOSDataExchangeEngine.sendFiles(SOSDataExchangeEngine.java:738)
2014-11-25 10:12:10.578+0100 [info]   	at com.sos.DataExchange.SOSDataExchangeEngine.transfer(SOSDataExchangeEngine.java:920)
2014-11-25 10:12:10.578+0100 [info]   	at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:292)
2014-11-25 10:12:10.578+0100 [info]   	at sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115)
2014-11-25 10:12:10.578+0100 [info]   	at sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70)
2014-11-25 10:12:10.578+0100 [info]   com.sos.JSHelper.Exceptions.JobSchedulerException: SOSVfs_E_229: error. unable to transfer data, reason: com.sos.JSHelper.Exceptions.JobSchedulerException: SOSVfs_E_226: .. file '/home/jenkins/jade_test/out/XX/' does not exist.
2014-11-25 10:12:10.578+0100 [info]   	at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:295)
2014-11-25 10:12:10.578+0100 [info]   	at sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115)
2014-11-25 10:12:10.578+0100 [info]   	at sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70)
2014-11-25 10:12:10.579+0100 [ERROR]  COM-80020009  DISP_E_EXCEPTION [step] [] [Z-JAVA-105  Java exception com.sos.JSHelper.Exceptions.JobSchedulerException: SOSVfs_E_229: error. unable to transfer data, reason: com.sos.JSHelper.Exceptions.JobSchedulerException: SOSVfs_E_226: .. file '/home/jenkins/jade_test/out/XX/' does not exist., method=spooler_process()Z [], in Remote_module_instance_server::step], method=call
2014-11-25 10:12:10.584+0100 [info]    INFO [main] (SOSVfsTransferBaseClass.java:1164) - (SOSVfsWebDAV::disconnect) disconnect OK
2014-11-25 10:12:10.588+0100 [info]    INFO [main] (SOSVfsTransferBaseClass.java:1164) - (SOSVfsWebDAV::disconnect) disconnect OK
2014-11-25 10:12:10.658+0100 [info]   Job JADEWebDAV/JADE_WebDAV_Upload terminated.
2014-11-25 10:12:10.806+0100 [WARN]   SCHEDULER-280  Process terminated with exit code 1 (0x1)
2014-11-25 10:12:10.926+0100 [info]   SCHEDULER-918  state=closed
2014-11-25 10:12:10.927+0100 [info]   SCHEDULER-962  Protocol ends in /home/jenkins/sos-berlin.com/jobscheduler/scheduler_distributed_sos/logs/task.JADEWebDAV,JADE_WebDAV_Upload.log

      Maintainer Notes

      • Due to the complexitiy of this fix it will not be applied to maintenance release 1.7 and 1.8 in order to keep this fix free from side effects.

      Attachments

        Issue Links

          is related to

          Feature - A feature of the product, which has yet to be developed. YADE-232 YADE info log messages should be more concise

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Released
          relates to

          Fix - YADE-227 Send TCP/UDP signal to the YADE Background Service if operation failed

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Released

          Activity

            People

              re Robert Ehrlich
              mp Mahendra Patidar
              Mahendra Patidar Mahendra Patidar
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 4 hours
                  4h
                  Remaining:
                  Remaining Estimate - 4 hours
                  4h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified