Scheduled runs
What is scheduled run
For users with premium access to Waaila there is the option to evaluate their sets of tests automatically and receive notifications based on the results. Other users have to open the application and manually click on the Run button to see the results.
Scheduled run is set on the level of test sets (for details on settting check the next section). Each time the scheduled time is reached, the tests run same as when you click the Run button. If you set the schedule to send notification always or if at least one test fails, you receive a notification on each of the specified emails. The notification contains the number of failed tests, the test set performance and link into Waaila application for a quick check.
How to set schedule
Both initial setup and editing can be done from an open dataset in Waaila application.
If there is no schedule yet, you’ll see "Type: Manual (not set yet)"". You can create new schedule by clicking on Manual (alternatively you can also get there from editing of the dataset):
If the schedule is already set, you can see in the dataset header "Type: Scheduled" with particular time of the schedule. Clicking on the text Scheduled opens the editing dialog for the schedule (alternatively you can also get there from editing of the dataset):
If you see instead Scheduled (disabled), it means the schedule was already created but is paused (disabled) at the moment.
Inside the editing dialog you can:
- pause or enable again the schedule using the checkpoint at the top
- select days when the schedule should run, or select to run it every day (at the moment Waaila does not allow a single test set to run multiple times a day or less than once a week)
- set the time of the scheduled run (the time is in your local time zone)
- edit emails for notifications (all emails in this list will get a notification with overview of the test successes/failures and a link to the results in Waaila)
- set if the notification email should arrive after every run or only if some test fails