Overview

Workloads automate the distribution and scheduling of quality assurance evaluations across your team. Each workload defines who gets evaluated, by whom, how often, how many tickets are reviewed, and which tickets are selected.

Workloads operate on a recurring schedule — daily, weekly, or monthly — and automatically create a new cycle at the start of each period. The current cycle continues until the next one begins.

Before creating a workload, you'll need your users or groups, sampling rules, and scorecards set up.

Only Admins can manage workloads.

Workloads Page

To view and manage your workloads, go to Workloads > Overview. For each workload, you can see:

• Name — The workload's title

• AutoQA — Whether AI is enabled, and if so, whether it's running as Co-Pilot or Fully Autonomous

• Status — Whether the workload is active, inactive, or archived

• Created At — When the workload was created

• Repeats — The schedule frequency (daily, weekly, or monthly)

• Target — The total number of evaluations targeted per cycle

• Evaluators — The number of evaluators assigned. Fully Autonomous workloads have no human evaluators; Co-Pilot and Manual workloads have one or more.

• Reviewees — The number of agents being evaluated as part of this workload

• Notifications — Subscribe to be notified when cycles are created or updates occur

Managing Workloads

Click the ⋯ menu next to any workload to access the following options:

• Duplicate — Create a copy of an existing workload to save time when setting up similar configurations.

• Deactivate — Stops the workload from generating new cycles. Current cycles remain in progress and all existing evaluation data is kept intact in reports.

• Archive — Hides the workload and all related evaluations from reports. You can restore it at any time by reactivating.

• Delete — Permanently removes a workload. Only available for workloads with no evaluations. This action is irreversible.

Cycles

Each time a workload's schedule triggers, a new cycle is created. Cycles are individual instances of a workload's configuration.

To view cycles, go to Workloads > Cycles, or click a workload's options and select View Cycles. You can filter by specific workloads to see their full cycle history.

Each cycle shows:

• Start Date — When the cycle began

• Status:

  • In Progress for the current cycle

  • Completed or Uncompleted for past cycles depending on whether the target was fully met

  • Cancelled when an assignment is invalidated if the workload's configuration is updated during an active cycle, prompting a new one with the changes.

• Progress — A progress bar showing how many evaluations have been completed against the target

• Skipped — How many evaluations were skipped

Click into any cycle to see more detail, including individual assignments to evaluators (or AutoQA), progress per assignment, and a full history of completed and skipped evaluations.

Assignments

Within each cycle, evaluations are distributed as assignments to evaluators. To view assignments, go to Workloads > Assignments, or open a cycle and view its individual assignments.

You can filter assignments by workload and status (e.g. in progress). For each assignment, you can see the evaluator, their progress, and how many evaluations they've been assigned.

If needed, you can reassign evaluations from one evaluator to another within the same workload — useful when balancing workloads across your team or covering for absence.