Uploaded image for project: 'JS - JobScheduler'
  1. JS - JobScheduler
  2. JS-1848

Jobs are missing in JOC after deployment of 20.000 Job Configurations

    XMLWordPrintable

    Details

    • Type: Feature
    • Status: Deferred (View Workflow)
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 1.12.9
    • Fix Version/s: None
    • Component/s: None
    • Labels:

      Description

      Current Situation

      Deploy a folder with 20.000 job configuration at once.

      JobScheduler reads, initializes and loads the configurations correctly, but the EventQueue for FileBasedEvents gets "TORN". Therefore a lot of information for these configurations are not transferred to the reporting database.

      • A "TORN" Event is fired by the event queue.
        • {"TYPE":"Torn","eventId":1562932271432001}
      • Tested with PostgreSQL and MySQL
      • There is no information about a torn event queue in the scheduler.log

      Desired Behavior

      A Deployment of a large sum of configuration files should not result in a torn event queue.

      If an event queue is torn, a log entry should be written to the scheduler.log.

       

      Workaround

      Split the deployment of new files into smaller chunks of 3000 items max.

        Attachments

          Activity

            People

            • Assignee:
              jz Joacim Zschimmer
              Reporter:
              sp Santiago Aucejo Petzoldt
            • Votes:
              1 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: