Quality control

IdSurvey provides tools for quality control, review, and validation of interviews.

What you can do with Quality control

  • Fix and edit interviews from the excel file
  • Validate or reject interviews
  • Restore original interviews
  • Listen to background audio recordings of CAPI interviews
  • Verify the GPS location of CAPI interviews (available soon)
  • Perform automatic quality control to discard interviews that do not reflect the criteria set (available soon)
  • Edit and correct individual interviews directly from IdSurvey (available soon)

 

Authorized administrator users can choose to export or analyze in Analysis & Report all completed interviews or only validated ones.

Administrators can create users with permission only to view, export, and analyze validated interviews. This solution is convenient when one wants to share access to IdSurvey with a client by limiting viewing to interviews validated by a manager only.

To create a restricted user see the relevant knowledge base article.
 

The interface

To access the Quality Control section, click on the item in the survey tools menu.

Quality control menu

The Quality control window presents a list of all completed interviews.

For each interview you can check:

  • the interview completion date
  • the status Validated, Rejected, or Unchecked
  • the Edited status, if any (if contact fields or interview responses have been changed from the original interview)
  • the icon for listening to audio recordings in the CAPI background
  • the icon for accessing the interview view
  • a menu of actions on the individual interview

 

In addition, the view system and a filter box with the necessary criteria for interview reviewing are available, as in other sections of IdSurvey.

In the gear menu, you can find tools and actions that you can apply to multiple interviews at once.

Quality control interviews

 

Fix and edit interviews from the excel file

After selecting the desired interviews click on Export from the gear menu.
The excel file is similar to the data export file and includes the contact fields and questionnaire responses from each exported interview.

You can change any value of the contact and answer fields. You can, for example, edit an open-ended answer or the code of a selected answer.
Multiple-choice questions are reported in a single column with comma-separated values.

After making the desired checks and changes, it is possible to mark interviews as validated or as rejected directly in the excel file.
To do this, you must write the values “Validated” or “Rejected” in the Revision Status column.
To set the Revision Status as Unverified, leave the field blank.
You can also do this in another moment from the IdSurvey interface.

When the changes are complete, save the file and click on “Import edits” from the gear menu and drag or select the edited excel file to import the changes.

Notes:

  • When importing, any changes made to the values in the StartingDate, EndingDate, and InterviewerID columns will be ignored. These data are necessary for the proper functioning of the survey activity analysis.
  • The Idcontact column should not be changed. This column is the unique ID used by the system to associate the imported data with the data in the system.
  • Quality control does not allow new interviews to be entered. Any new rows in the excel file will be ignored during import.
  • When importing, any values in the Review Status column other than Validated, Rejected, or blank will be ignored leaving the value present in the system.
  • Modified interviews may not be consistent with display conditions and the questionnaire’s flow. IdSurvey does not perform any consistency checks on changes.

 

Validate or reject interviews

You can mark interviews as validated or as discarded from the GUI. At any time, you can reset interviews as unchecked.

To mark an individual interview click the actions menu then choose the desired status.

Validate or reject interviews

To mark multiple interviews at once, select them then choose the desired status from the gear menu.

Note
Before this, you might find it useful to filter the interviews by setting the desired criteria in the filter drawer and then selecting all the interviews displayed from the gear menu.

Mark multiple interviews at once

 

Revert to original


At any time you can restore the interview to its original state. That is, with the original answers and contact fields saved during the interview. This operation permanently removes any changes made to the interview by reviewers.
When you restore an interview to its original state, the validation status (Validated or Rejected) is also reset to “Unchecked.”

To restore a single interview click the action menu then choose Revert to original.
To restore multiple interviews at once, select them then choose “Revert to original.”

Note
Before this, you might find it useful to filter the interviews by setting the desired criteria in the filter drawer and then selecting all the interviews displayed from the gear menu.
 

Export and analyze validated interviews


Administrators or users with no restrictions can analyze and export all completed interviews or only validated interviews.

In Analysis & Report, the preference can be changed from the menu in the upper right corner. By default, it is set to “All complete interviews.” This preference is automatically stored in the views. Users can then create differentiated views to save reports on all interviews or only validated interviews.

Export and analyze validated interviews

In the Export box, there is a button selector to choose whether to export All Complete Interviews, Only Validated Interviews, or Partial Interviews. Due to the nature of the format, the selector is not present for Access export.

Quality control export

You can create restricted users who are only allowed to export and analyze validated interviews. Refer to the relevant knowledge base article for more information.

Authorizations quality control