Details
-
Fix
-
Status: Dismissed (View Workflow)
-
Major
-
Resolution: Duplicate
-
1.7.4
Description
Current Situation
- The JADE JITL job is trying to connect directly to a target server. Since the private key for the user connecting to the target server is not available to the JobScheduler host (key is present at jump host), it therefore cannot connect and throws an error.
- See the attached job and log file for more information
2014-12-04 11:25:51.178+0100 [info] SCHEDULER-918 state=starting (at=2014-12-04 11:25:51.061+0100) 2014-12-04 11:25:51.803+0100 [info] INFO [main] (JobSchedulerJobAdapter.java:98) - 1.7.4321 (2014-11-20 13:42, revision 28277) Copyright 2003-2014 SOS GmbH Berlin 2014-12-04 11:25:51.932+0100 [info] INFO [main] (SOSMsg.java:127) - JSJ_I_0010: JobSchedulerJobAdapter::getNodeName: Current Job is 'JADEJumpHostTest'. 2014-12-04 11:25:53.327+0100 [info] INFO [main] (SOSDExJSAdapterClass.java:113) - SOSDExJSAdapterClass::doProcessing with operation copytointernet started. 2014-12-04 11:25:53.330+0100 [info] INFO [main] (SOSDataExchangeEngine.java:275) - $Id: SOSDataExchangeEngine.java 27865 2014-10-31 15:45:55Z oh $ -- 1.7.4321 (2014-11-20 13:42, revision 28277) Copyright 2003-2014 SOS GmbH Berlin 2014-12-04 11:25:53.334+0100 [info] INFO [main] (SOSOptionLogFileName.java:179) - setLogger without instance of logger called. 2014-12-04 11:25:53.346+0100 [info] INFO [main] (SOSDataExchangeEngine.java:289) - 2014-12-04 11:25:53.346+0100 [info] ************************************************************************* 2014-12-04 11:25:53.346+0100 [info] * * 2014-12-04 11:25:53.346+0100 [info] * JADE - JobScheduler Advanced Data Exchange * 2014-12-04 11:25:53.346+0100 [info] * ---www.sos-berlin.com--------------------- * 2014-12-04 11:25:53.346+0100 [info] * * 2014-12-04 11:25:53.346+0100 [info] ************************************************************************* 2014-12-04 11:25:53.346+0100 [info] version = $Id: SOSDataExchangeEngine.java 27865 2014-10-31 15:45:55Z oh $ -- 1.7.4321 (2014-11-20 13:42, revision 28277) Copyright 2003-2014 SOS GmbH Berlin 2014-12-04 11:25:53.346+0100 [info] date = 2014-12-04 11:25:53 2014-12-04 11:25:53.346+0100 [info] operation = copytointernet 2014-12-04 11:25:53.346+0100 [info] protocol = sftp 2014-12-04 11:25:53.346+0100 [info] port = 22 2014-12-04 11:25:53.346+0100 [info] file specification = ^.*/.txt$ 2014-12-04 11:25:53.346+0100 [info] file path = 2014-12-04 11:25:53.346+0100 [info] local host = gollum.sos 2014-12-04 11:25:53.346+0100 [info] local directory = /home/jenkins/jade_test/out/ 2014-12-04 11:25:53.346+0100 [info] target host = homer.sos 2014-12-04 11:25:53.346+0100 [info] target directory = . 2014-12-04 11:25:53.346+0100 [info] pid = 2014-12-04 11:25:53.346+0100 [info] ************************************************************************* 2014-12-04 11:25:53.346+0100 [info] 2014-12-04 11:25:53.374+0100 [info] INFO [main] (SOSVfsTransferBaseClass.java:1164) - (SOSVfsSFtpJCraft::disconnect) disconnect OK 2014-12-04 11:25:55.820+0100 [info] INFO [main] (SOSVfsTransferBaseClass.java:1164) - (SOSVfsSFtpJCraft::disconnect) disconnect OK 2014-12-04 11:25:55.823+0100 [info] INFO [main] (SOSDataExchangeEngine.java:984) - SOSJADE_E_0101: data transfer ended with error '(@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail' 2014-12-04 11:25:55.827+0100 [info] INFO [main] (SOSDataExchangeEngine.java:304) - Elapsed time = 2496, per File = 2496, total bytes = 0 2014-12-04 11:25:55.831+0100 [info] INFO [main] (SOSDataExchangeEngine.java:314) - 2014-12-04 11:25:55.831+0100 [info] ************************************************************************* 2014-12-04 11:25:55.831+0100 [info] execution status = failure. Errors reported. 2014-12-04 11:25:55.831+0100 [info] successful transfers = 0 2014-12-04 11:25:55.831+0100 [info] failed transfers = 0 2014-12-04 11:25:55.831+0100 [info] last error = (@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail ((@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail) 2014-12-04 11:25:55.831+0100 [info] ************************************************************************* 2014-12-04 11:25:55.831+0100 [info] 2014-12-04 11:25:55.834+0100 [ERROR] ERROR [main] (SOSDExJSAdapterClass.java:74) - SOSDExJSAdapterClass ended abnormal. 2014-12-04 11:25:55.838+0100 [ERROR] ERROR [main] (SOSDExJSAdapterClass.java:75) - (@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail 2014-12-04 11:25:55.838+0100 [ERROR] com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:295) 2014-12-04 11:25:55.838+0100 [ERROR] sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115) 2014-12-04 11:25:55.838+0100 [ERROR] sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70) 2014-12-04 11:25:55.838+0100 [ERROR] sos.scheduler.jade.SOSJade4DMZJSAdapter.spooler_process(SOSJade4DMZJSAdapter.java:62) 2014-12-04 11:25:55.838+0100 [ERROR] 2014-12-04 11:25:55.841+0100 [ERROR] ERROR [main] (SOSJade4DMZJSAdapter.java:67) - SOSJade4DMZJSAdapter ended abnormal. 2014-12-04 11:25:55.844+0100 [ERROR] ERROR [main] (SOSJade4DMZJSAdapter.java:68) - (@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail 2014-12-04 11:25:55.844+0100 [ERROR] com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:295) 2014-12-04 11:25:55.844+0100 [ERROR] sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115) 2014-12-04 11:25:55.844+0100 [ERROR] sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70) 2014-12-04 11:25:55.844+0100 [ERROR] sos.scheduler.jade.SOSJade4DMZJSAdapter.spooler_process(SOSJade4DMZJSAdapter.java:62) 2014-12-04 11:25:55.844+0100 [ERROR] 2014-12-04 11:25:55.859+0100 [info] java.lang.RuntimeException: SOSOptionInFileName::CheckMandatory: file '/home/test/.ssh/id_rsa' does not exists 2014-12-04 11:25:55.859+0100 [info] at com.sos.JSHelper.Options.SOSOptionInFileName.CheckMandatory(SOSOptionInFileName.java:99) 2014-12-04 11:25:55.859+0100 [info] at com.sos.JSHelper.Options.SOSOptionInFileName.CheckMandatory(SOSOptionInFileName.java:77) 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.SFTP.SOSVfsSFtpJCraft.doAuthenticate(SOSVfsSFtpJCraft.java:801) 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.SFTP.SOSVfsSFtpJCraft.Authenticate(SOSVfsSFtpJCraft.java:128) 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.doAuthenticate(SOSVfsConnectionFactory.java:131) 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.getVfsHandler(SOSVfsConnectionFactory.java:99) 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.createConnectionPool(SOSVfsConnectionFactory.java:61) 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.<init>(SOSVfsConnectionFactory.java:32) 2014-12-04 11:25:55.859+0100 [info] at com.sos.DataExchange.SOSDataExchangeEngine.transfer(SOSDataExchangeEngine.java:848) 2014-12-04 11:25:55.859+0100 [info] at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:292) 2014-12-04 11:25:55.859+0100 [info] at sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115) 2014-12-04 11:25:55.859+0100 [info] at sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70) 2014-12-04 11:25:55.859+0100 [info] at sos.scheduler.jade.SOSJade4DMZJSAdapter.spooler_process(SOSJade4DMZJSAdapter.java:62) 2014-12-04 11:25:55.859+0100 [info] com.sos.JSHelper.Exceptions.JobSchedulerException: (@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.SFTP.SOSVfsSFtpJCraft.doAuthenticate(SOSVfsSFtpJCraft.java:820) 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.SFTP.SOSVfsSFtpJCraft.Authenticate(SOSVfsSFtpJCraft.java:128) 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.doAuthenticate(SOSVfsConnectionFactory.java:137) 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.getVfsHandler(SOSVfsConnectionFactory.java:99) 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.createConnectionPool(SOSVfsConnectionFactory.java:61) 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.<init>(SOSVfsConnectionFactory.java:32) 2014-12-04 11:25:55.859+0100 [info] at com.sos.DataExchange.SOSDataExchangeEngine.transfer(SOSDataExchangeEngine.java:848) 2014-12-04 11:25:55.859+0100 [info] at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:292) 2014-12-04 11:25:55.859+0100 [info] at sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115) 2014-12-04 11:25:55.859+0100 [info] at sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70) 2014-12-04 11:25:55.859+0100 [info] at sos.scheduler.jade.SOSJade4DMZJSAdapter.spooler_process(SOSJade4DMZJSAdapter.java:62) 2014-12-04 11:25:55.859+0100 [info] com.sos.JSHelper.Exceptions.JobSchedulerException: (@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.SFTP.SOSVfsSFtpJCraft.Authenticate(SOSVfsSFtpJCraft.java:151) 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.doAuthenticate(SOSVfsConnectionFactory.java:137) 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.getVfsHandler(SOSVfsConnectionFactory.java:99) 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.createConnectionPool(SOSVfsConnectionFactory.java:61) 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.<init>(SOSVfsConnectionFactory.java:32) 2014-12-04 11:25:55.859+0100 [info] at com.sos.DataExchange.SOSDataExchangeEngine.transfer(SOSDataExchangeEngine.java:848) 2014-12-04 11:25:55.859+0100 [info] at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:292) 2014-12-04 11:25:55.859+0100 [info] at sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115) 2014-12-04 11:25:55.859+0100 [info] at sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70) 2014-12-04 11:25:55.859+0100 [info] at sos.scheduler.jade.SOSJade4DMZJSAdapter.spooler_process(SOSJade4DMZJSAdapter.java:62) 2014-12-04 11:25:55.859+0100 [info] com.sos.JSHelper.Exceptions.JobSchedulerException: (@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.getVfsHandler(SOSVfsConnectionFactory.java:105) 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.createConnectionPool(SOSVfsConnectionFactory.java:61) 2014-12-04 11:25:55.859+0100 [info] at com.sos.VirtualFileSystem.DataElements.SOSVfsConnectionFactory.<init>(SOSVfsConnectionFactory.java:32) 2014-12-04 11:25:55.859+0100 [info] at com.sos.DataExchange.SOSDataExchangeEngine.transfer(SOSDataExchangeEngine.java:848) 2014-12-04 11:25:55.859+0100 [info] at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:292) 2014-12-04 11:25:55.859+0100 [info] at sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115) 2014-12-04 11:25:55.859+0100 [info] at sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70) 2014-12-04 11:25:55.859+0100 [info] at sos.scheduler.jade.SOSJade4DMZJSAdapter.spooler_process(SOSJade4DMZJSAdapter.java:62) 2014-12-04 11:25:55.859+0100 [info] com.sos.JSHelper.Exceptions.JobSchedulerException: (@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail 2014-12-04 11:25:55.859+0100 [info] at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:295) 2014-12-04 11:25:55.859+0100 [info] at sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115) 2014-12-04 11:25:55.859+0100 [info] at sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70) 2014-12-04 11:25:55.859+0100 [info] at sos.scheduler.jade.SOSJade4DMZJSAdapter.spooler_process(SOSJade4DMZJSAdapter.java:62) 2014-12-04 11:25:55.859+0100 [info] com.sos.JSHelper.Exceptions.JobSchedulerException: (@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail 2014-12-04 11:25:55.859+0100 [info] at com.sos.DataExchange.SOSDataExchangeEngine.Execute(SOSDataExchangeEngine.java:295) 2014-12-04 11:25:55.859+0100 [info] at sos.scheduler.job.SOSDExJSAdapterClass.doProcessing(SOSDExJSAdapterClass.java:115) 2014-12-04 11:25:55.859+0100 [info] at sos.scheduler.job.SOSDExJSAdapterClass.spooler_process(SOSDExJSAdapterClass.java:70) 2014-12-04 11:25:55.859+0100 [info] at sos.scheduler.jade.SOSJade4DMZJSAdapter.spooler_process(SOSJade4DMZJSAdapter.java:62) 2014-12-04 11:25:55.860+0100 [ERROR] COM-80020009 DISP_E_EXCEPTION [step] [] [Z-JAVA-105 Java exception com.sos.JSHelper.Exceptions.JobSchedulerException: (@homer.sos:22) com.jcraft.jsch.JSchException - Auth fail, method=spooler_process()Z [], in Remote_module_instance_server::step], method=call 2014-12-04 11:25:55.888+0100 [info] Job JADEJumpHostTest terminated. 2014-12-04 11:25:56.016+0100 [WARN] SCHEDULER-280 Process terminated with exit code 1 (0x1) 2014-12-04 11:25:56.078+0100 [info] SCHEDULER-918 state=closed 2014-12-04 11:25:56.079+0100 [info] SCHEDULER-962 Protocol ends in /home/jenkins/sos-berlin.com/jobscheduler/scheduler_distributed_sos/logs/task.JADEJumpHostTest.log
Desired Behavior
- JADE should always use a jump host if configured, independently from the fact that a target host might be directly accessible without using a jump host.
Attachments
Issue Links
- is duplicated by
-
YADE-229 JADE4DMZ job should use a jump host instead of trying to connect directly
- Released