Home Page Client Login Blog Employee Login The Grand Mean Optimum Blending Solutions Consistent Track Real ID QMetrics Cropduster Email
About us Quality Control Measures Research On Research White Papers Press Releases & Articles Online Data Collection Phone Data Collection Email
   
          
          
Quality Control Measures
Real ID™

Real ID™ gives researchers:
  • Verification of a respondent's identity and uniqueness.
  • Assurance that a real person is answering a survey and that they are appropriately engaged
  • QMetrics®, quality index identifies the 'worst' respondents
  • Micro-behaviorally targeted™ respondents (patent pending)
Click here to view the Real ID™ process

The Grand Mean Project®
A massive global data collection effort that establishes the variability of panels and creates the Grand Mean for each market. The Grand Mean is a new non-probabilistic metric that anchors online data to provide a reference for tracking and blending purposes. So far, more than 200 panels across 35 countries have participated.

Optimum Blending Solutions®
Using the Grand Mean in each market we have established a new metric. By a combination of strategic selection of panels and the frequency by which they are employed we minimize the RMS (Root Mean Square) error from the Grand Mean of the panel sources in a marketplace. The objective is to reduce the variability around the Grand Mean to less than 1% RMS error. In the U.S. alone we have over 250 three panel blending solutions that utilize our unique database of some twenty panel sources.

Consistent Track®
The measurement and certification of panel consistency through a unique audit program. By a sequence of repeat measures output of panel sources is calibrated to the Grand Mean. Using optimization models input panel sources are manipulated so that output is fine tuned.

CPR® (Consistency, Predictability, Reliability)
A unique tracking program that measures the consistency of sample sources to identify the real changes in data and reduce the background error that we experience. When allied with a tracking study CPR independently measures the variability caused by sample source changes helping researchers identify which changes are real.

QMetrics®
A unique method of identifying the worst online respondents. Six separate measures are combined into one metric.

Crop Duster® - What is it?
Crop Duster® provides a unique solution to identifying "bugs"... those individuals who have professionalized the business of being a respondent. It utilizes digital fingerprinting technology with approximately 90 information points used to uniquely identify the respondent's computer. All files are data based; no personal information is gathered in respect to all industry and privacy standards.

Crop Duster® - How does it work?
Crop Duster® works with ISIS (Internet Survey Interview System) our proprietary online software. Like a crop duster, it blankets your research with information points to identify and remove the bugs. Crop Duster™ will immediately tag potential respondents in the pre-screening stage, keeping a real time record of their efforts to participate in research. At any time during a study repeat respondents will be subject to additional scrutiny. As Crop Duster™ functions during the gateway portion of research a decision can be made to automate denial to the site or to allow respondents in for further scrutiny. As Crop Duster™ cannot be detected by potential respondents and does not work by the use of cookies or other customary tactics there is no known way for repeat offenders to beat the system.

Researchers using Crop Duster™ will find that its reporting site is particularly easy to use. There are no added charges for data basing the machine profiles.

Speeders

Tired of getting open-ended responses that don't make sense? Our tool identifies respondents who type in nonsensical answers, and challenges them until they enter a response that contains real words! We don't stop there. Through the power of Quester, we prompt respondents to refine their answers. Quester technology consists of an Interactive Text Box which operates like an instant messaging interface. The Interactive Text Box is presented within the survey software for a seamless respondent experience. The respondent types in a response and receives a follow-up probe. The conversation continues until the desired level of response depth is satisfied. Analytic options are available, using a specialized linguistic analysis.


Attribute Rating Error
To make sure that respondents are paying proper attention to your survey, we include dummy questions within a set of attributes, like… Please select choice 4 for this statement. You can access a list of the respondents incorrectly answering these statements, and decide whether you want them included in your final data!

Straight-Lining
Respondents will sometimes rush through a survey by entering the same answer over-and-over again. We'll challenge these respondents (with a pop-up), making sure that's how they really meant to answer. You can access all this through a user friendly, robust reporting system.

Additional Checks & Balances
Mktg. Inc. performs other quality checks prior to launching a study:
Surveys are tested three times internally prior to the client check
Test data is run and topline pulled to check that quotas are updating/closing when completed
Skip patterns are working accordingly and data is saving properly
Ability for clients to monitor live online interviews