Refonte AI

Quality Tab

Overview

The Quality tab allows you to audit a random sample of tasks for quality and view stats for tasks you've audited

overview

Why should you audit tasks?

Auditing tasks allow you to provide feedback directly to our taskers. This will help us identify common errors or clarify edge cases

Auditing Workflow

There are two ways to audit tasks:

  • Audit completed tasks individually
  • Audit all completed tasks within a date range
  • Audit all tasks completed across a specific week

How to audit completed tasks individually:

  • In the Tasks tab, filter on the Completed tasks
  • Search for the task that you want to audit and click on "Audit Task"
overview

How to audit all completed tasks within a date range:

  • In the Quality tab, select the specified task date range, audit or batch status
  • Click on the "Audit Tasks" button - this will allow you to audit a random sample of tasks
overview

Audit all tasks completed across a week:

  • In the Quality tab go to the "Tasks completed last week" tab under "Report"
  • Select Audit for the desired week
overview

Auditing Tasks

If you have multiple people on your team auditing at the same time, we will “lock” each task so that only one person can audit one task at a time. This was designed to prevent conflicted copies.

Audit Feedback

Within the audit workflow, you are able to make the following selections:

  • Approve: Mark that tasks that have been completed according to instructions
  • Make Changes: Fix tasks that have minor or non-critical errors that you can use to update your callback response immediately
  • Reject: Signal that tasks have completed incorrectly. Please provide detailed comments for how our team can fix these mistakes moving forward

Reject vs. Make Changes

  • The Refonte.Ai team will receive feedback regarding the caliber of your work from both Reject and Make Changes.
  • Please Make Changes if you would like a fast or small change; you will receive an updated callback response immediately. Furthermore, not every assignment that is denied will be sent again. In order to talk about re-dos, please get in touch with your engagement manager.
  • If there is a serious or more structural misinterpretation of the instructions, kindly reject the work and give thorough feedback! This will aid in the taskers' improvement.

Audit Reports

  • Using the set of filtered tasks, the quality assurance dashboard will show the total number of reviews, accepts, and rejects. Furthermore, we offer the following reports:
  • Tasks completed last week - allows you to audit tasks that have been tallied by date of completion for the previous four weeks, from Monday at 00:00 to Sunday at 23:59 PST.
  • Task Level Report - gives you a list of tasks together with the auditor and the estimated time of completion
  • Auditor Tracker - shows an audit report for tasks in batches
  • Note: this is only available if you are use batches. To learn more about batches, please see this article
  • Auditor Quality - displays a summary of reviews, accepts, and rejects per auditor

Callback Body

  • When an audit is submitted, several new field will be added to the callback body:
  • Tasks completed last week - lets you audit tasks that have been aggregated by completed date from Monday 00:00 to Sunday 23:59 PST for the last 4 weeks
  • customer_review_status: Reflects the result of the audit as “Accepted”, “Rejected” or “Fixed”
  • customer_review_comments: Shows all comment left during the audit
  • prior_responses: Response before the audit
  • If a task is fixed through multiple audits:
  • response: will be updated with the most recent audit
  • customer_review_status: will reflect the most recent audit
  • customer_review_comments: will append the comment to the array
  • prior_responses: will append previous responses to the array

Updated about 2 months ago