[YADE-301] YADE getlist operation should not create result file list_of_files.txt.csv - SOS JIRA

Details

Type: Fix
Status: Released (View Workflow)
Priority: Major
Resolution: Fixed
Affects Version/s: 1.7.5, 1.8.2, 1.9
Fix Version/s: 1.7.6, 1.8.3, 1.9.1, 1.10
Component/s: YADE Client
Labels:
- ACC7566
Environment:
JADE 1.9.0 / Windows x64 / Java 1.8_51

Description

Current behavior

The YADE for operation getlist creates two result files, where file's location and name is configure using parameter result_set_filename
1. list_of_files.txt : this result file contains list of files found on source_dir matching with file_spec
2. list_of_file.txt.csv : this result file is CSV file, contains various information e.g. file size, name, md5hash etc.
- The contains of CSV result files are not complete and relevant for the operation getlist , since this information is also available in jade_transfer_history file.
- The name of CSV file is not explicitly configured in the YADE profile but derived from the parameter result_set_filename.
The YADE starting from version 1.9.0 also print file_list information on stdout console.

Desired behavior

The CSV result file should not be created.

How to reproduce

Profile

[getlist]
file_spec              = ^SOS-.*\.(xls|csv)$
operation              = getlist
;;
result_set_filename    = C:\__Temp\jade_logs\list_of_files.txt
create_result_set      = true
;;
source_protocol        = sftp
source_host            = homer.sos
source_port            = 22
source_user            = test
source_ssh_auth_method = password
source_password        = Wddse73Ksdf$;;23
source_dir             = /home/test/data/from_homer

session Log


C:\Program Files\sos-berlin.com\jade>jade_client.1.9.0\bin\jade.cmd -settings=jade_settings.ini -profile=getlist

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+                       START  : JADE.CMD                         +
+                       -----------------                         +
+ DATE     : 22.05.2015 11:14:28,63
+ HOSTNAME : MP
+ USER     : MP
+ CALL     : C:\Program Files\sos-berlin.com\jade\jade_client.1.9.0\bin\jade.cmd -settings=jade_settings.ini -profile=getlist
+                                                                 +
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +

main INFO  11:14:32,274   (SOSDataExchangeEngineMain.java:73) ::Execute SOSDataExchange - Main routine started ...
main INFO  11:14:32,299   (SOSDataExchangeEngine.java:485) ::showBanner
************************************************************************
*                                                                      *
*                JADE - JobScheduler Advanced Data Exchange            *
*                ---www.sos-berlin.com---------------------            *
*                                                                      *
************************************************************************
  Version                 = 1.9.0 (2015-04-30 12:26, revision d3a501831acf8d2ce0354da0b821f3a54bac2b7b) Copyright 2003-2015 SOS GmbH Berlin
  Date                    = 2015-05-22 11:14:32
  SettingsFile            = jade_settings.ini
  Profile                 = getlist
  Operation               = getlist
  Transactional           = false

  +------------Source------------
  | Protocol              = sftp
  | Host                  = homer.sos
  | User                  = test
  | AuthMethod            = password
  | AuthFile              = ***
  | Directory             = /home/test/data/from_homer/
  | FileSpec              = ^SOS-.*\.(xls|csv)$
  | ErrorWhenNoFilesFound = true
  | Recursive             = false
  | Remove                = false


main INFO  11:14:32,357   (SOSVfsSFtpJCraft.java:890) ::connect SOSVfs-D-0101: Try to connect to host 'homer.sos' at Port '22'.
main INFO  11:14:33,172   (SOSVfsSFtpJCraft.java:856) ::doAuthenticate SOSVfs_D_133: user 'test' logged in.
main INFO  11:14:33,263   (SOSDataExchangeEngine.java:931) ::setInfo 4 files found for regexp '^SOS-.*\.(xls|csv)$'.
main INFO  11:14:33,264   (SOSDataExchangeEngine.java:1059) ::transfer SOSJADE_I_0115: Operation 'getList' is specified. no transfer will be done.
main INFO  11:14:33,265   (SOSFileList.java:408) ::logFileList
/home/test/data/from_homer/SOS-100_09.03.2015.xls
/home/test/data/from_homer/SOS-200_22.01.2015.xls
/home/test/data/from_homer/SOS-100_22.01.2015.csv
/home/test/data/from_homer/SOS-100_22.01.2015.xls
*** ResultSet End ***
main INFO  11:14:33,304   (SOSFileList.java:446) ::CreateResultSetFile ResultSet to StdOut and to csv-File 'C:\__Temp\jade_logs\list_of_files.txt.csv' written
*** ResultSet Start ***
ed5913e6-7bc3-41f2-bf40-c66a56bd8154;SOS;2015-05-22 11:14:33;10040;0;getlist;homer.sos;192.11.0.95;test;MP;192.11.0.49;Mahendra;;0;/home/test/data/from_homer/;;/home/test/data/from_homer/SOS-100_09.03
.2015.xls;n.a.;344;n.a.;waiting4transfer;;stdout; ;;22;sftp;;1970-01-01 01:00:00;75d3d79d-2c5b-49d6-9b54-fb0305e98b4a;SOS;2015-05-22 11:14:33;10040;0;getlist;homer.sos;192.11.0.95;test;MP;192.11.0.49;
Mahendra;;0;/home/test/data/from_homer/;;/home/test/data/from_homer/SOS-100_09.03.2015.xls;n.a.;344;n.a.;waiting4transfer;;stdout; ;;22;sftp;;1970-01-01 01:00:00
acc6485d-104f-4d45-9c38-7dffc9bd90b9;SOS;2015-05-22 11:14:33;10040;0;getlist;homer.sos;192.11.0.95;test;MP;192.11.0.49;Mahendra;;0;/home/test/data/from_homer/;;/home/test/data/from_homer/SOS-200_22.01
.2015.xls;n.a.;433;n.a.;waiting4transfer;;stdout; ;;22;sftp;;1970-01-01 01:00:00;271f3e8c-f92b-4fc9-b3a2-39e7d715ae4b;SOS;2015-05-22 11:14:33;10040;0;getlist;homer.sos;192.11.0.95;test;MP;192.11.0.49;
Mahendra;;0;/home/test/data/from_homer/;;/home/test/data/from_homer/SOS-200_22.01.2015.xls;n.a.;433;n.a.;waiting4transfer;;stdout; ;;22;sftp;;1970-01-01 01:00:00
6d0fad81-eba6-4954-9a7d-1e2d32fad807;SOS;2015-05-22 11:14:33;10040;0;getlist;homer.sos;192.11.0.95;test;MP;192.11.0.49;Mahendra;;0;/home/test/data/from_homer/;;/home/test/data/from_homer/SOS-100_22.01
.2015.csv;n.a.;433;n.a.;waiting4transfer;;stdout; ;;22;sftp;;1970-01-01 01:00:00;a7c06380-82b4-4888-8d06-e26bc42e157c;SOS;2015-05-22 11:14:33;10040;0;getlist;homer.sos;192.11.0.95;test;MP;192.11.0.49;
Mahendra;;0;/home/test/data/from_homer/;;/home/test/data/from_homer/SOS-100_22.01.2015.csv;n.a.;433;n.a.;waiting4transfer;;stdout; ;;22;sftp;;1970-01-01 01:00:00
4ca4f4d3-346c-4676-91a4-044c97b6b089;SOS;2015-05-22 11:14:33;10040;0;getlist;homer.sos;192.11.0.95;test;MP;192.11.0.49;Mahendra;;0;/home/test/data/from_homer/;;/home/test/data/from_homer/SOS-100_22.01
.2015.xls;n.a.;433;n.a.;waiting4transfer;;stdout; ;;22;sftp;;1970-01-01 01:00:00;2cb00c18-c5fd-4b86-8d72-a726223bb648;SOS;2015-05-22 11:14:33;10040;0;getlist;homer.sos;192.11.0.95;test;MP;192.11.0.49;
Mahendra;;0;/home/test/data/from_homer/;;/home/test/data/from_homer/SOS-100_22.01.2015.xls;n.a.;433;n.a.;waiting4transfer;;stdout; ;;22;sftp;;1970-01-01 01:00:00
*** ResultSet End ***
main INFO  11:14:33,320   (SOSDataExchangeEngine.java:795) ::printState SOSJADE_I_0101: 0 files transferred
main INFO  11:14:33,337   (SOSDataExchangeEngine.java:351) ::showResult
*************************************************************************
 execution status     = success. Without Errors.
 successful transfers = 0
 skipped transfers    = 0
 failed transfers     = 4
 last error           =
*************************************************************************

main INFO  11:14:33,339   (SOSDataExchangeEngineMain.java:77) ::Execute Execute - ended without errorsended without errors
main INFO  11:14:33,340   (SOSVfsTransferBaseClass.java:1161) ::logINFO (SOSVfsSFtpJCraft::disconnect) disconnect OK
main INFO  11:14:33,341   (SOSVfsTransferBaseClass.java:1161) ::logINFO (SOSVfsSFtpJCraft::disconnect) disconnect OK

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+                        END   : JADE.CMD                         +
+                        ----------------                         +
+ DATE     : 22.05.2015 11:14:33,79
+ HOSTNAME : MP
+ USER     : MP
+ CALL     : C:\Program Files\sos-berlin.com\jade\jade_client.1.9.0\bin\jade.cmd -settings=jade_settings.ini -profile=getlist
+ EXIT     : 0
+                                                                 +
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +


C:\Program Files\sos-berlin.com\jade>

YADE getlist operation should not create result file list_of_files.txt.csv

Details

Description

Attachments

Activity

People

Dates

Time Tracking