Uploaded image for project: 'JITL - JobScheduler Integrated Template Library'
  1. JITL - JobScheduler Integrated Template Library
  2. JITL-130

JITL job JADE4DMZJob should use the configured jump host

    XMLWordPrintable

Details

    • Fix
    • Status: Dismissed (View Workflow)
    • Major
    • Resolution: Duplicate
    • 1.7.4
    • 1.7.5, 1.8

    Description

      Current Situation

      • The JADE JITL job is trying to connect directly to a target server. Since the private key for the user connecting to the target server is not available to the JobScheduler host (key is present at jump host), it therefore cannot connect and throws an error.
      • See the attached job and log file for more information
        
        2014-12-04 11:25:51.178+0100 [info]   SCHEDULER-918  state=starting (at=2014-12-04 11:25:51.061+0100)
        2014-12-04 11:25:51.803+0100 [info]    INFO [main] (JobSchedulerJobAdapter.java:98) - 1.7.4321 (2014-11-20 13:42, revision 28277) Copyright 2003-2014 SOS GmbH Berlin
        2014-12-04 11:25:51.932+0100 [info]    INFO [main] (SOSMsg.java:127) - JSJ_I_0010: JobSchedulerJobAdapter::getNodeName: Current Job is 'JADEJumpHostTest'.
        2014-12-04 11:25:53.327+0100 [info]    INFO [main] (SOSDExJSAdapterClass.java:113) - SOSDExJSAdapterClass::doProcessing with operation copytointernet started.
        2014-12-04 11:25:53.330+0100 [info]    INFO [main] (SOSDataExchangeEngine.java:275) - $Id: SOSDataExchangeEngine.java 27865 2014-10-31 15:45:55Z oh $ -- 1.7.4321 (2014-11-20 13:42, revision 28277) Copyright 2003-2014 SOS GmbH Berlin
        2014-12-04 11:25:53.334+0100 [info]    INFO [main] (SOSOptionLogFileName.java:179) - setLogger without instance of logger called.
        2014-12-04 11:25:53.346+0100 [info]    INFO [main] (SOSDataExchangeEngine.java:289) - 
        2014-12-04 11:25:53.346+0100 [info]   ************************************************************************* 
        2014-12-04 11:25:53.346+0100 [info]   *                                                                       * 
        2014-12-04 11:25:53.346+0100 [info]   *                JADE - JobScheduler Advanced Data Exchange             * 
        2014-12-04 11:25:53.346+0100 [info]   *                ---www.sos-berlin.com---------------------             * 
        2014-12-04 11:25:53.346+0100 [info]   *                                                                       * 
        2014-12-04 11:25:53.346+0100 [info]   ************************************************************************* 
        2014-12-04 11:25:53.346+0100 [info]   version              = $Id: SOSDataExchangeEngine.java 27865 2014-10-31 15:45:55Z oh $ -- 1.7.4321 (2014-11-20 13:42, revision 28277) Copyright 2003-2014 SOS GmbH Berlin 
        2014-12-04 11:25:53.346+0100 [info]   date                 = 2014-12-04 11:25:53 
        2014-12-04 11:25:53.346+0100 [info]   operation            = copytointernet 
        2014-12-04 11:25:53.346+0100 [info]   protocol             = sftp 
        2014-12-04 11:25:53.346+0100 [info]   port                 = 22 
        2014-12-04 11:25:53.346+0100 [info]   file specification   = ^.*/.txt$  
        2014-12-04 11:25:53.346+0100 [info]   file path            =  
        2014-12-04 11:25:53.346+0100 [info]   local host           = gollum.sos 
        2014-12-04 11:25:53.346+0100 [info]   local directory      = /home/jenkins/jade_test/out/ 
        2014-12-04 11:25:53.346+0100 [info]   target host          = homer.sos 
        2014-12-04 11:25:53.346+0100 [info]   target directory     = . 
        2014-12-04 11:25:53.346+0100 [info]   pid                  =    
        2014-12-04 11:25:53.346+0100 [info]   ************************************************************************* 
        2014-12-04 11:25:53.346+0100 [info]   
        2014-12-04 11:25:53.374+0100 [info]    INFO [main] (SOSVfsTransferBaseClass.java:1164) - (SOSVfsSFtpJCraft::disconnect) disconnect OK
        2014-12-04 11:25:55.820+0100 [info]    INFO [main] (SOSVfsTransferBaseClass.java:1164) - (SOSVfsSFtpJCraft::disconnect) disconnect OK
        2014-12-04 11:25:55.823+0100 [info]    INFO [main] (SOSDataExchangeEngine.java:984) - SOSJADE_E_0101: data transfer ended with error '(@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail'
        2014-12-04 11:25:55.827+0100 [info]    INFO [main] (SOSDataExchangeEngine.java:304) - Elapsed time = 2496, per File = 2496, total bytes = 0
        2014-12-04 11:25:55.831+0100 [info]    INFO [main] (SOSDataExchangeEngine.java:314) - 
        2014-12-04 11:25:55.831+0100 [info]   ************************************************************************* 
        2014-12-04 11:25:55.831+0100 [info]    execution status     = failure. Errors reported. 
        2014-12-04 11:25:55.831+0100 [info]    successful transfers = 0 
        2014-12-04 11:25:55.831+0100 [info]    failed transfers     = 0 
        2014-12-04 11:25:55.831+0100 [info]    last error           = (@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail ((@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail) 
        2014-12-04 11:25:55.831+0100 [info]   *************************************************************************
        2014-12-04 11:25:55.831+0100 [info]   
        2014-12-04 11:25:55.834+0100 [ERROR]  ERROR [main] (SOSDExJSAdapterClass.java:74) - SOSDExJSAdapterClass ended abnormal.
        2014-12-04 11:25:55.838+0100 [ERROR]  ERROR [main] (SOSDExJSAdapterClass.java:75) - (@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail
        2014-12-04 11:25:55.838+0100 [ERROR]  com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:295)
        2014-12-04 11:25:55.838+0100 [ERROR]  sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115)
        2014-12-04 11:25:55.838+0100 [ERROR]  sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70)
        2014-12-04 11:25:55.838+0100 [ERROR]  sos.scheduler.jade.SOSJade4DMZJSAdapter.spooler_process(SOSJade4DMZJSAdapter.java:62)
        2014-12-04 11:25:55.838+0100 [ERROR]  
        2014-12-04 11:25:55.841+0100 [ERROR]  ERROR [main] (SOSJade4DMZJSAdapter.java:67) - SOSJade4DMZJSAdapter ended abnormal.
        2014-12-04 11:25:55.844+0100 [ERROR]  ERROR [main] (SOSJade4DMZJSAdapter.java:68) - (@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail
        2014-12-04 11:25:55.844+0100 [ERROR]  com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:295)
        2014-12-04 11:25:55.844+0100 [ERROR]  sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115)
        2014-12-04 11:25:55.844+0100 [ERROR]  sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70)
        2014-12-04 11:25:55.844+0100 [ERROR]  sos.scheduler.jade.SOSJade4DMZJSAdapter.spooler_process(SOSJade4DMZJSAdapter.java:62)
        2014-12-04 11:25:55.844+0100 [ERROR]  
        2014-12-04 11:25:55.859+0100 [info]   java.lang.RuntimeException: SOSOptionInFileName::CheckMandatory: file '/home/test/.ssh/id_rsa' does not exists
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.JSHelper.Options.SOSOptionInFileName.CheckMandatory(SOSOptionInFileName.java:99)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.JSHelper.Options.SOSOptionInFileName.CheckMandatory(SOSOptionInFileName.java:77)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.SFTP.SOSVfsSFtpJCraft.doAuthenticate(SOSVfsSFtpJCraft.java:801)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.SFTP.SOSVfsSFtpJCraft.Authenticate(SOSVfsSFtpJCraft.java:128)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.doAuthenticate(SOSVfsConnectionFactory.java:131)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.getVfsHandler(SOSVfsConnectionFactory.java:99)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.createConnectionPool(SOSVfsConnectionFactory.java:61)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.<init>(SOSVfsConnectionFactory.java:32)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.DataExchange.SOSDataExchangeEngine.transfer(SOSDataExchangeEngine.java:848)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:292)
        2014-12-04 11:25:55.859+0100 [info]   	at sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115)
        2014-12-04 11:25:55.859+0100 [info]   	at sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70)
        2014-12-04 11:25:55.859+0100 [info]   	at sos.scheduler.jade.SOSJade4DMZJSAdapter.spooler_process(SOSJade4DMZJSAdapter.java:62)
        2014-12-04 11:25:55.859+0100 [info]   com.sos.JSHelper.Exceptions.JobSchedulerException: (@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.SFTP.SOSVfsSFtpJCraft.doAuthenticate(SOSVfsSFtpJCraft.java:820)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.SFTP.SOSVfsSFtpJCraft.Authenticate(SOSVfsSFtpJCraft.java:128)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.doAuthenticate(SOSVfsConnectionFactory.java:137)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.getVfsHandler(SOSVfsConnectionFactory.java:99)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.createConnectionPool(SOSVfsConnectionFactory.java:61)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.<init>(SOSVfsConnectionFactory.java:32)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.DataExchange.SOSDataExchangeEngine.transfer(SOSDataExchangeEngine.java:848)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:292)
        2014-12-04 11:25:55.859+0100 [info]   	at sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115)
        2014-12-04 11:25:55.859+0100 [info]   	at sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70)
        2014-12-04 11:25:55.859+0100 [info]   	at sos.scheduler.jade.SOSJade4DMZJSAdapter.spooler_process(SOSJade4DMZJSAdapter.java:62)
        2014-12-04 11:25:55.859+0100 [info]   com.sos.JSHelper.Exceptions.JobSchedulerException: (@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.SFTP.SOSVfsSFtpJCraft.Authenticate(SOSVfsSFtpJCraft.java:151)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.doAuthenticate(SOSVfsConnectionFactory.java:137)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.getVfsHandler(SOSVfsConnectionFactory.java:99)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.createConnectionPool(SOSVfsConnectionFactory.java:61)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.<init>(SOSVfsConnectionFactory.java:32)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.DataExchange.SOSDataExchangeEngine.transfer(SOSDataExchangeEngine.java:848)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:292)
        2014-12-04 11:25:55.859+0100 [info]   	at sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115)
        2014-12-04 11:25:55.859+0100 [info]   	at sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70)
        2014-12-04 11:25:55.859+0100 [info]   	at sos.scheduler.jade.SOSJade4DMZJSAdapter.spooler_process(SOSJade4DMZJSAdapter.java:62)
        2014-12-04 11:25:55.859+0100 [info]   com.sos.JSHelper.Exceptions.JobSchedulerException: (@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.getVfsHandler(SOSVfsConnectionFactory.java:105)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.createConnectionPool(SOSVfsConnectionFactory.java:61)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.<init>(SOSVfsConnectionFactory.java:32)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.DataExchange.SOSDataExchangeEngine.transfer(SOSDataExchangeEngine.java:848)
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:292)
        2014-12-04 11:25:55.859+0100 [info]   	at sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115)
        2014-12-04 11:25:55.859+0100 [info]   	at sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70)
        2014-12-04 11:25:55.859+0100 [info]   	at sos.scheduler.jade.SOSJade4DMZJSAdapter.spooler_process(SOSJade4DMZJSAdapter.java:62)
        2014-12-04 11:25:55.859+0100 [info]   com.sos.JSHelper.Exceptions.JobSchedulerException: (@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:295)
        2014-12-04 11:25:55.859+0100 [info]   	at sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115)
        2014-12-04 11:25:55.859+0100 [info]   	at sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70)
        2014-12-04 11:25:55.859+0100 [info]   	at sos.scheduler.jade.SOSJade4DMZJSAdapter.spooler_process(SOSJade4DMZJSAdapter.java:62)
        2014-12-04 11:25:55.859+0100 [info]   com.sos.JSHelper.Exceptions.JobSchedulerException: (@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail
        2014-12-04 11:25:55.859+0100 [info]   	at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:295)
        2014-12-04 11:25:55.859+0100 [info]   	at sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115)
        2014-12-04 11:25:55.859+0100 [info]   	at sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70)
        2014-12-04 11:25:55.859+0100 [info]   	at sos.scheduler.jade.SOSJade4DMZJSAdapter.spooler_process(SOSJade4DMZJSAdapter.java:62)
        2014-12-04 11:25:55.860+0100 [ERROR]  COM-80020009  DISP_E_EXCEPTION [step] [] [Z-JAVA-105  Java exception com.sos.JSHelper.Exceptions.JobSchedulerException: (@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail, method=spooler_process()Z [], in Remote_module_instance_server::step], method=call
        2014-12-04 11:25:55.888+0100 [info]   Job JADEJumpHostTest terminated.
        2014-12-04 11:25:56.016+0100 [WARN]   SCHEDULER-280  Process terminated with exit code 1 (0x1)
        2014-12-04 11:25:56.078+0100 [info]   SCHEDULER-918  state=closed
        2014-12-04 11:25:56.079+0100 [info]   SCHEDULER-962  Protocol ends in /home/jenkins/sos-berlin.com/jobscheduler/scheduler_distributed_sos/logs/task.JADEJumpHostTest.log
        

      Desired Behavior

      • JADE should always use a jump host if configured, independently from the fact that a target host might be directly accessible without using a jump host.

      Attachments

        Issue Links

          Activity

            People

              oh Oliver Haufe
              mp Mahendra Patidar
              Mahendra Patidar Mahendra Patidar
              Mahendra Patidar Mahendra Patidar
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: