Uploaded image for project: 'YADE - Yet Another Data Exchange Tool'
  1. YADE - Yet Another Data Exchange Tool
  2. YADE-224

YADE operation copytointernet ended succesfully even jump_command path is wrong in the profile

    XMLWordPrintable

Details

    • Fix
    • Status: Released (View Workflow)
    • Major
    • Resolution: Fixed
    • 1.7.1
    • 1.7.4
    • YADE Client
    • None
    • JADE 1.7.4321-RC1 / homer.sos /Jenkins.sos

    Description

      If the parameter 'jump_command' in a YADE profile for jumphost operation is wrong i.e. path-mismatch etc, YADE complete the operation without any error and return success code 0.
      Please see the parameter

      jump_command= /home/jenkins/sos-berlin.com/jade/jade_client.1.7.4321-RC1/xbin/jade.sh

      Although YADE shows an error main ERROR 03:42:44,740 ERROR (SOSSSHJob2.java:357) ::CheckExitCode SOS-SSH-E-150: remote command terminated with exit code: 127

      Profile
      [jumphost_test_copytointernet]
      file_spec            = ^.*\.txt$
      operation            = copytointernet
      ;;
      source_dir           = /home/test/outbound/
      source_protocol      = local
      source_port          = 22
      ;;;
      jump_host            = gollum.sos
      jump_user            = jenkins
      jump_ssh_auth_method = password
      jump_password        = jenkins
      jump_protocol        = sftp
      jump_port            = 22
      jump_command         = /home/jenkins/sos-berlin.com/jade/jade_client.1.7.4321-RC1/xbin/jade.sh
      ;;;
      target_dir           = /inbound
      target_protocol      = ftp
      target_port          = 21
      target_host          = mp.sos
      target_user          = test
      target_password      = test
      
      
      YADE log
      test@homer:~/jade_client.1.7.4321-RC1/bin> ./jade4dmz.sh -settings=jade_jumhost.ini -profile=jumphost_test_copytointernet
      0 [main] INFO com.sos.DataExchange.Jade4DMZ  - Jade4DMZ --- $Id: Jade4DMZ.java 27842 2014-10-30 12:35:02Z oh $
      43 [main] INFO sos.net.ssh.SOSSSHJob2  - $Id: SOSSSHJob2.java 27529 2014-10-10 08:33:03Z ur $
      main INFO  03:42:38,776   INFO (SOSDataExchangeEngine4DMZMain.java:103) ::Execute SOSDataExchange - Main routine started ... -- 1.7.4321-RC1 (2014-11-18 14:58, revision 28207) Copyright 2003-2014 SOS GmbH Berlin
      main INFO  03:42:38,781   INFO (Jade4DMZ.java:555) ::EstablishSSHConnection SOSSSHJobOptions.url (the url for the connection):
      SOSSSHJobOptions.raise_exception_on_error (Raise an Exception if an error occured): true
      SOSFtpOptionsSuperClass.jump_ssh_auth_file (This parameter specifies the path and name of a us):
      SOSFtpOptionsSuperClass.jump_ssh_auth_method (This parameter specifies the authentication method): password
      SOSSSHJobOptions.command (This parameter specifies a command that is to be executed):
      SOSSSHJobOptions.command_delimiter (Command delimiter characters are specified using this par): %%
      SOSSSHJobOptions.command_script (This parameter can be used as an alternative to command,):
      SOSSSHJobOptions.command_script_file (This parameter can be used as an alternative to command,):
      SOSSSHJobOptions.command_script_param (This parameter contains a parameterstring, which will be):
      gollum.sos (192.11.0.120)
      SOSSSHJobOptions.protocol (Type of requested Datatransfer The values ftp, sftp): ssh
      SOSSSHJobOptions.ignore_error (Should the value true be specified, then execution errors): false
      SOSSSHJobOptions.ignore_exit_code (This parameter configures one or more exit codes which wi):
      SOSSSHJobOptions.ignore_signal (Should the value true be specified, then on): false
      SOSSSHJobOptions.ignore_stderr (This job checks if any output to stderr has been created): false
      SOSFtpOptionsSuperClass.jump_password (Password for authentication with the jump_host.): *****
      SOSFtpOptionsSuperClass.jump_port (Port on the jump_host by which files should be tra): 22
      SOSSSHJobOptions.proxy_host (The value of this parameter is the host name or the IP ad):
      SOSSSHJobOptions.proxy_password (This parameter specifies the password for the proxy serve): *****
      SOSSSHJobOptions.proxy_port (This parameter specifies the port number of the proxy,): 0
      SOSSSHJobOptions.proxy_user (The value of this parameter specifies the user account fo): user
      SOSSSHJobOptions.simulate_shell (Should the value true be specified for this parameter,): false
      SOSSSHJobOptions.simulate_shell_inactivity_timeout (If no new characters are written to stdout or stderr afte): 0
      SOSSSHJobOptions.simulate_shell_login_timeout (If no new characters are written to stdout or stderr afte): 0
      SOSSSHJobOptions.simulate_shell_prompt_trigger (The expected comman line prompt. Using this prompt the jo):
      SOSFtpOptionsSuperClass.jump_user (User name for authentication with the jump_host.): jenkins
      SOSSSHJobOptions.ignore_hangup_signal (Should the value true be specified, then execution errors): true
      SOSSSHJobOptions.Base_Directory (A Base Directory for all relative FileNames used by SOSOptionFileName): /home/test/jade_client.1.7.4321-RC1/bin
      .CreateFolder (Folder anlegen, wenn noch nicht vorhanden): true
      SOSSSHJobOptions.Date_Format_Mask (General Mask for date fomatting): yyyy-MM-dd
      SOSSSHJobOptions.Time_Format_Mask (General Mask for time formatting): HH:mm:ss
      SOSSSHJobOptions.Scheduler_Hot_Folder (Pathname to the JobScheduler live-folder): null/config/live
      .CreateFolder (Folder anlegen, wenn noch nicht vorhanden): true
      SOSSSHJobOptions.Scheduler_Data (Data Folder of JobScheduler Installation):
      .CreateFolder (Folder anlegen, wenn noch nicht vorhanden): true
      SOSSSHJobOptions.Scheduler_Home (Home Root Folder of JobScheduler):
      .CreateFolder (Folder anlegen, wenn noch nicht vorhanden): true
      SOSSSHJobOptions.local_user (Name of local user): test
      SOSSSHJobOptions.Locale (I18N is for internationalization of Application): en_US
      SOSSSHJobOptions.CheckNotProcessedOptions (If this Option is set to true, all not processed or recognized options are reported as a warning): false
      SOSSSHJobOptions.XmlId (This ist the ...): root
      SOSSSHJobOptions.TestMode (Test Modus schalten ): false
      SOSSSHJobOptions.Debug (Debug-Modus schalten (true/false)): false
      SOSSSHJobOptions.DebugLevel (DebugLevel): 0
      SOSSSHJobOptions.log_filename (Name der Datei mit den Logging-Eintr�gen): stdout
      SOSSSHJobOptions.log4j_Property_FileName (Name of the LOG4J Property File): ./log4j.properties
      SOSSSHJobOptions.ApplicationName (Name of the Application):
      SOSSSHJobOptions.ApplicationDocuUrl (The Url of the Documentation of this Application):
      SOSSSHJobOptions.AllowEmptyParameterList (If true, an empty parameter list leads not into an error): true
      
      main INFO  03:42:39,004   INFO (SOSSSH2TriLeadImpl.java:595) ::Authenticate SOSVfs_D_133: user 'jenkins' logged in.
      main INFO  03:42:39,170   INFO (SOSSSHJob2.java:444) ::CheckStdOut stdout = 22007
      
      main INFO  03:42:40,605   INFO (SOSDataExchangeEngine.java:275) ::Execute $Id: SOSDataExchangeEngine.java 27865 2014-10-31 15:45:55Z oh $ -- 1.7.4321-RC1 (2014-11-18 14:58, revision 28207) Copyright 2003-2014 SOS GmbH Berlin
      main INFO  03:42:40,605   INFO (SOSOptionLogFileName.java:179) ::setLogger setLogger without instance of logger called.
      main INFO  03:42:40,612   INFO (SOSDataExchangeEngine.java:289) ::Execute
      *************************************************************************
      *                                                                       *
      *                JADE - JobScheduler Advanced Data Exchange             *
      *                ---www.sos-berlin.com---------------------             *
      *                                                                       *
      *************************************************************************
      version              = $Id: SOSDataExchangeEngine.java 27865 2014-10-31 15:45:55Z oh $ -- 1.7.4321-RC1 (2014-11-18 14:58, revision 28207) Copyright 2003-2014 SOS GmbH Berlin
      date                 = 2014-11-19 15:42:40
      operation            = copy
      protocol             = ftp
      port                 = 21
      file specification   = ^.*/.txt$
      file path            =
      local host           = homer
      local directory      = /home/test/outbound/
      target host          = gollum.sos
      target directory     = /tmp/jade-2f77bfb0-1b48-405e-a624-07c66117c0ef/
      pid                  = 6617
      *************************************************************************
      
      main INFO  03:42:41,050   INFO (SOSDataExchangeEngine.java:783) ::setInfo 3 files found for regexp '^.*\.txt$'.
      main INFO  03:42:41,051   INFO (SOSFileListEntry.java:812) ::run SOSVfs_I_0108: transfer of /home/test/outbound/TEST_FILE_001.txt started
      main INFO  03:42:42,505   INFO (SOSFileListEntry.java:333) ::doTransfer SOSVfs_I_274: Security hash (MD5) for file TEST_FILE_001.txt is 46a07e571c6c52e31546463891439db9
      main INFO  03:42:42,506   INFO (SOSFileListEntry.java:812) ::run SOSVfs_I_0108: transfer of /home/test/outbound/TEST_FILE_002.txt started
      main INFO  03:42:43,181   INFO (SOSFileListEntry.java:333) ::doTransfer SOSVfs_I_274: Security hash (MD5) for file TEST_FILE_002.txt is 46a07e571c6c52e31546463891439db9
      main INFO  03:42:43,181   INFO (SOSFileListEntry.java:812) ::run SOSVfs_I_0108: transfer of /home/test/outbound/TEST_FILE_100.txt started
      main INFO  03:42:43,323   INFO (SOSFileListEntry.java:333) ::doTransfer SOSVfs_I_274: Security hash (MD5) for file TEST_FILE_100.txt is 46a07e571c6c52e31546463891439db9
      main INFO  03:42:43,325   INFO (SOSVfsSFtpJCraft.java:519) ::rename (jenkins@gollum.sos:22) SOSVfs_I_189: ..server reply [rename] from ['/tmp/jade-2f77bfb0-1b48-405e-a624-07c66117c0ef/TEST_FILE_001.txt~'] to ['/tmp/jade-2f77bfb0-1b48-405e-a624-07c66117c0ef/TEST_FILE_001.txt'] : /tmp/jade-2f77bfb0-1b48-405e-a624-07c66117c0ef/TEST_FILE_001.txt
      main INFO  03:42:43,326   INFO (SOSVfsSFtpJCraft.java:519) ::rename (jenkins@gollum.sos:22) SOSVfs_I_189: ..server reply [rename] from ['/tmp/jade-2f77bfb0-1b48-405e-a624-07c66117c0ef/TEST_FILE_002.txt~'] to ['/tmp/jade-2f77bfb0-1b48-405e-a624-07c66117c0ef/TEST_FILE_002.txt'] : /tmp/jade-2f77bfb0-1b48-405e-a624-07c66117c0ef/TEST_FILE_002.txt
      main INFO  03:42:43,329   INFO (SOSVfsSFtpJCraft.java:519) ::rename (jenkins@gollum.sos:22) SOSVfs_I_189: ..server reply [rename] from ['/tmp/jade-2f77bfb0-1b48-405e-a624-07c66117c0ef/TEST_FILE_100.txt~'] to ['/tmp/jade-2f77bfb0-1b48-405e-a624-07c66117c0ef/TEST_FILE_100.txt'] : /tmp/jade-2f77bfb0-1b48-405e-a624-07c66117c0ef/TEST_FILE_100.txt
      main INFO  03:42:43,330   INFO (SOSFileList.java:594) ::WriteHistory SOSVfs_D_213: Transfer-operation 'copy' started at 20141119034240, ended at 20141119034243. Duration: 3000
      main INFO  03:42:43,330   INFO (SOSFileList.java:621) ::WriteHistory SOSVfs_D_214: Operation = copy, TargetFile = /tmp/jade-2f77bfb0-1b48-405e-a624-07c66117c0ef/TEST_FILE_001.txt, SourceFile = /home/test/outbound/TEST_FILE_001.txt, BytesTransferred = 3724063
      main INFO  03:42:43,330   INFO (SOSFileList.java:621) ::WriteHistory SOSVfs_D_214: Operation = copy, TargetFile = /tmp/jade-2f77bfb0-1b48-405e-a624-07c66117c0ef/TEST_FILE_002.txt, SourceFile = /home/test/outbound/TEST_FILE_002.txt, BytesTransferred = 3724063
      main INFO  03:42:43,330   INFO (SOSFileList.java:621) ::WriteHistory SOSVfs_D_214: Operation = copy, TargetFile = /tmp/jade-2f77bfb0-1b48-405e-a624-07c66117c0ef/TEST_FILE_100.txt, SourceFile = /home/test/outbound/TEST_FILE_100.txt, BytesTransferred = 3724063
      main INFO  03:42:43,331   INFO (SOSDataExchangeEngine.java:643) ::printState SOSJADE_I_0101: 3 files transferred
      main INFO  03:42:43,331   INFO (SOSDataExchangeEngine.java:304) ::Execute Elapsed time = 2726, per File = 908, total bytes = 3
      main INFO  03:42:43,332   INFO (SOSDataExchangeEngine.java:314) ::Execute
      *************************************************************************
       execution status     = sucess. Without Errors.
       successful transfers = 3
       failed transfers     = 0
       last error           =
      *************************************************************************
      
      main INFO  03:42:43,332   INFO (SOSVfsTransferBaseClass.java:1164) ::logINFO (SOSVfsSFtpJCraft::disconnect) disconnect OK
      main INFO  03:42:43,332   INFO (SOSVfsTransferBaseClass.java:1164) ::logINFO (SOSVfsSFtpJCraft::disconnect) disconnect OK
      main INFO  03:42:44,739   INFO (SOSSSHJob2.java:444) ::CheckStdOut stdout = 22041
      
      main INFO  03:42:44,739   INFO (SOSSSHJob2.java:389) ::CheckStdErr stderr = bash: /home/jenkins/sos-berlin.com/jade/jade_client.1.7.4321-RC1/xbin/jade.sh: No such file or directory
      
      main INFO  03:42:44,740   INFO (SOSSSHJob2.java:393) ::CheckStdErr SOS-SSH-I-150: output to stderr is ignored: bash: /home/jenkins/sos-berlin.com/jade/jade_client.1.7.4321-RC1/xbin/jade.sh: No such file or directory
      
      main ERROR 03:42:44,740   ERROR (SOSSSHJob2.java:357) ::CheckExitCode SOS-SSH-E-150: remote command terminated with exit code: 127
      main INFO  03:42:44,760   INFO (SOSSSHJob2.java:444) ::CheckStdOut stdout = 22055
      
      main INFO  03:42:44,762   INFO (SOSDataExchangeEngine4DMZMain.java:118) ::Execute SOSDataExchangeEngine4DMZMain::Execute - ended without errorsended without errors
      test@homer:~/jade_client.1.7.4321-RC1/bin> echo $?
      0
      test@homer:~/jade_client.1.7.4321-RC1/bin>
      
      

      Attachments

        Issue Links

          Activity

            People

              oh Oliver Haufe
              mp Mahendra Patidar
              Oliver Haufe Oliver Haufe
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 1 hour
                  1h
                  Remaining:
                  Remaining Estimate - 0 minutes
                  0m
                  Logged:
                  Time Spent - 1 hour
                  1h