Vanderbilt University Logo
Skip to main content

Center for Global Democracy

 

  2. Quality Control

Quality Control

LAPOP Lab applies rigorous quality control procedures at every stage of the AmericasBarometer, from questionnaire development to real-time monitoring during data collection. Our approach is rooted in transparency, innovation, and continuous improvement.

Our Approach

Comprehensible Surveys

We pre-test all questionnaires using cognitive interviews and adapt them linguistically and culturally for each country. Special care is taken to ensure questions are clear and easy to understand, even for respondents with limited formal education.

Digital Data Collection

Since 2016/17, all AmericasBarometer surveys in Latin America and the Caribbean are conducted using connected Android devices (with exceptions in Haiti). In Canada and the U.S., web-based surveys are used. This digital approach:

  • Reduces data entry errors with built-in controls for skips and answer validation
  • Allows real-time updates and monitoring, and syncing of complete interviews
  • Supports seamless switching between multiple languages
Real-Time Monitoring with FALCON©

Our Fieldwork Algorithm for LAPOP Lab Control over survey Operations and Norms (FALCON©) is a suite of tools and protocols that enables centralized tracking of survey implementation. This system allows us to detect and address issues—such as improper locations or poor interview techniques—while surveys are still ongoing.

 

Key Quality Control Innovations

These integrated tools allow LAPOP Lab to monitor survey quality as interviews are happening—not just after fieldwork is complete.

Geo-Fence Module

Ensures interviews are conducted in the assigned locations using GPS-enabled geo-fencing. This ensures data are collected in the correct geographic locations. Supervisors are alerted if interviews occur outside designated areas as follows:

  • The device alerts the interviewer in real time

  • Supervisors receive immediate notifications

  • Interviews completed outside the fence are flagged for follow-up

Distance Audit Module (DAM)

DAM calculates how far an interview was conducted from its assigned location. It flags deviations automatically by comparing the interview’s GPS location to the sample’s geo-fence boundary:

  • A negative value means the interview was within bounds

  • A positive value indicates a location error

This module helps us identify and address location violations quickly and systematically.

Location Consistency Check (LCC)

LCC is a preventative measure that verifies an interviewer’s location before they begin their day’s work. Interviewers are asked to confirm their position relative to the assigned Primary Sampling Unit (PSU). If they select the wrong area:

  • The system notifies them immediately

  • They cannot proceed until the discrepancy is resolved
    This check avoids accidental misplacement of interviews in similarly named or nearby areas.

Multi-Tiered Auditing

Our auditing process includes several layers of review to uphold data integrity:

  • 100% of interviews are reviewed using audio recordings (with respondent consent
  • Errors are logged using our internal Quality Assurance Chapter (QuAC) system
  • Interviews with excessive errors are canceled and replaced
  • A secondary team at LAPOP reviews a random sample of audits to verify the initial assessments
  • Real-time feedback improves interviewer performance during fieldwork.

 

Learn More

For an in-depth look at how these tools improve survey quality, read:

Assessing and Improving Interview Quality in the 2016/17 AmericasBarometer