Job Scheduler

​

1. Introduction

A job scheduler in Xtraleap is a tool for automating the execution of tasks, such as data extraction, transformation, loading (ETL), or the generation of reports and visualizations. This documentation provides an in-depth overview of the features and functionalities of a job scheduler, including cron scheduling, logging, error handling, retrying jobs, pausing jobs, force running jobs, and deleting jobs.

​

2. Cron Scheduling

Cron scheduling is a method for specifying the frequency and timing of job executions. It uses a series of fields to define the minute, hour, day of the month, month, and day of the week when a job should run.

The syntax for a cron schedule typically looks like this:

For example, a cron schedule of 0 2 * * * would run the job every day at 2:00 AM.

​

3. Logging

Logging is a crucial feature for tracking the progress and status of jobs, recording information about their execution, such as start and end times, success or failure status, and any errors or warnings encountered during the process. Logs can be stored in files or databases and can be viewed or analyzed to identify issues, optimize performance, or maintain an audit trail for compliance purposes.

​

4. Error Handling

Error handling is the process of detecting and managing errors that occur during job execution. The job scheduler should provide features for handling errors, such as:

• Capturing and logging error messages and stack traces

• Sending notifications or alerts to administrators or stakeholders when errors occur

• Providing options for handling specific error types or conditions, such as retrying the job or aborting the execution

​

5. Retrying Jobs

Retrying jobs is a feature that allows the user to attempt to re-execute a job that has failed due to an error. Currently, this is manual. A user can trigger it manually after a job failure. Automatic retry is under development.

​

6. Pausing Jobs

Pausing jobs is a feature that allows users to temporarily suspend the execution of scheduled jobs, preventing them from running until they are manually resumed. This can be useful for performing maintenance, troubleshooting issues, or temporarily disabling jobs during periods of high system load.

​

7. Force Running Jobs

Force running jobs is a feature that enables users to manually trigger the execution of a job outside of its regular schedule. This can be useful for testing or debugging purposes or for running jobs on-demand in response to specific events or conditions.

​

8. Deleting Jobs

Deleting jobs is a feature that allows users to remove jobs from the job scheduler, permanently stopping their execution and removing their associated configuration and log data. Users should exercise caution when deleting jobs to avoid unintended data loss or disruption of critical processes.

​

9. Best Practices

When using a job scheduler in Xtraleap, consider the following best practices:

• Plan and Organize Jobs: Organize your jobs logically, grouping related tasks together and scheduling them in a manner that optimizes system resources and avoids conflicts or bottlenecks.

• Monitor Job Performance: Regularly monitor and review the performance of your jobs, using log data and performance metrics to identify and address issues or inefficiencies.

• Error Handling and Notifications: Implement robust error handling strategies and configure notifications or alerts to ensure that errors are promptly detected and addressed.

• Test and Validate Jobs: Thoroughly test and validate your jobs before deploying them to production, ensuring that they produce the expected results and perform optimally.

• Document Jobs and Processes: Maintain clear and accurate documentation of your jobs and their associated processes, including their purpose, configuration, dependencies, and schedules.

• Control Access: Implement access controls to restrict the ability to create, modify, or delete jobs to authorized users, reducing the risk of unauthorized changes or errors.

• Backup and Recovery: Establish backup and recovery procedures for your job configurations, log data, and other critical information, ensuring that you can quickly recover from data loss or system failures.