Uploaded image for project: 'JS - JobScheduler'
  1. JS - JobScheduler
  2. JS-1989

Anonymize JS7 log files

    XMLWordPrintable

Details

    • Feature
    • Status: Released (View Workflow)
    • Medium
    • Resolution: Fixed
    • None
    • 2.3.2, 2.4.0
    • None
    • None

    Description

      Current Situation

      • JS7 JOC Cockpit, Controller and Agents create a number of log files: standard log files and debug log files.
      • Such log files are required for root cause analysis of problems.
      • Log files are forwarded to the SOS Support Team and to the JS7 public forum.

      Desired Behavior

      • Log files should be anonymized before being forwarded to the SOS Support Team or to some public forum.
      • The JS7 should provide a command line utility that is available from the installation of JOC Cockpit, Controller and Agent respectively:
        • anonymize-logs.sh|.cmd --log-file=<log-file>
        • anonymize-logs.sh|.cmd --log-file=<log-file> --output-dir=<directory>
        • anonymize-logs.sh|.cmd --log-file=<directory>/*.log --rules-file=<rules-file>
      • Implementation
        • Log anonymizing is provided by a Java class
          • for use with Windows, Linux and supported platforms,
          • that ships with the respective JOC Cockpit, Controller and Agent installation.
        • For each log file an anonymized output file with the prefix "anonymized-" is created.
        • A <rules-file> is used from a plain text file in YAML format that includes the regular expressions to be searched for and the respective replacements.
          • Built-in rules are used if no <rules-file> is specified.
          • Users can export the built-in rules like this:
            • anonymize-logs.sh|.cmd --export-rules=<rules-file>
          • Users can specify their own <rules-file> to be used like this:
            • anonymize-logs.sh|.cmd --log-files=*.log --rules-file=<rules-file>
          • The <rules-file> is implemented in YAML format and specifies a rule set for regular expressions and replacements:
      rules:
      - item: url-component
        replace:
        - <host>
        - <port>
        search: ://(.*):(\d{3,5})
      - item: ip-address
        replace:
        - <ip-address>
        search: (([01]?\d\d?|2[0-4]\d|25[0-5])\.([01]?\d\d?|2[0-4]\d|25[0-5])\.([01]?\d\d?|2[0-4]\d|25[0-5])\.([01]?\d\d?|2[0-4]\d|25[0-5]))
      

      Attachments

        Issue Links

          Activity

            People

              oh Oliver Haufe
              ap Andreas Püschel
              Andreas Püschel Andreas Püschel
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: