
The online market research panel is the model online research grew up on. It took shape in the early days of the internet and carried over many of the habits of snail-mail and phone panels, with email and text invitations replacing these older outreach methods.
This was a significant step in the evolution of market research, and that evolution hasn’t stopped. Since online panels emerged, the audiences that they were designed to reach have grown and diversified exponentially. So have the online spaces they inhabit.
This article explains how online market research panels have historically found and matched people to research studies, and how that methodology began to fall short of the industry’s expectations. It then looks at the dynamic methods that grew out of the traditional panel, where the panel still has its place, and how both methods inform where research is heading next.
How Online Market Research Panels Are Sourced
An online market research panel is a database of people recruited for one purpose: taking part in research, such as an online survey or a virtual focus group. The panel provider recruits its members, manages them, and pays their incentives, all within that one database.
The panel model has its strengths. Panel members tend to be highly profiled, and their behavior is predictable, which helps providers be clear about research feasibility.
Specialist proprietary panel providers can also give brands reliable access to sought-after audiences. These can include professionals in highly regulated industries like finance or medicine, B2B decision-makers at mid-size or large companies, rare ailment sufferers, or residents in highly specific geographies. Such audiences are more than just low-incidence; they are often reachable only through a provider built specifically to find them.
With online market research panels, recruitment and engagement typically happen via email or text, with an extensive screening questionnaire as the primary tool for curating a qualified audience. But online panels are limited by the same design that creates their benefits.
Where Online Research Outgrew Traditional Panels
Market research seeks to understand audiences by forming and studying a representative sample of the population. Online market research panels may have been sufficient to do this in an earlier era of market research, when email invitations sparked curiosity and had fewer distractions fighting for potential respondents’ attention.
Today, online market research panel recruitment struggles amid an online environment defined by competition for consumers’ attention playing out across social media, streamers, chat platforms, and on and on. To join a panel in the first place, recruits must take gruelingly long and thorough screening questionnaires. When they are eventually invited to participate in a study, possibly at an unpredictable time of day, they often find the study has closed or the quota is full.
Then, if they are let in, they must be screened again to make sure they are eligible for that particular study. At the end of that process, they might find their responses made them ineligible to join.
Panel providers overrely on screening questions because that’s often their only means of matching participants to studies. But the end result is that panelists are asked to do a lot of work for little payoff — or no payoff at all, if they never make it into a study.
Making matters worse, those incentives are often irrelevant to their lives: points towards a future redemption they may never reach, or a generic rewards program with no connection to what they care about.
The average person wouldn’t put up with these conditions. Case in point: most panels generate 80% of their completes from 20% of their members. The people willing to endure all of this make up a fraction of an already statistically small group, as only about 20% of the general population is willing to join a panel in the first place.
How Always-On Data Collection Solves Sourcing Limits
Consider once more the origin of traditional online panel sourcing: mail and phone panels. If a researcher today conducted a study via mail and phone, they would struggle, to say the least, to put together a properly representative group.
Just as mail and phone were supplanted by more advanced, fast-paced communication technologies, more dynamic audience sourcing and research study matching methods were developed to make up for panel’s lost ground.
Research For Good’s own team came to always-on data collection from a panel background. We realized panels are a finite resource and set out to build a system for infinite audience access, reaching people wherever and whenever they’re online while keeping the rigor panels are known for and overcoming the matching limitations at the heart of the online panel model.
Always-on data collection is Research For Good’s methodology for giving researchers access to verified human respondents at any hour of the day. It engages people where they already spend time online, when they’re available, and matches their attentional bandwidth to a client’s study in real time.
We reach people through integrations with the online platforms where they already spend time, such as gaming apps and loyalty programs. A mobile gamer can take part in a study in exchange for powerups or credits without leaving the game. A member of an airline loyalty program can earn more points in that program for taking part.
By meeting people where they are and offering incentives relevant to that context, we make people want to take studies again. And instead of an exhausting questionnaire to assess participant fit, we collect data about each participant over successive, low-barrier research engagements, building individual profiles detailed enough to support high-quality respondent matching, even with low-incidence audiences.
The technology behind this is a proprietary platform for matching participants to research activities called DataForce. It assesses each person against the data points Research For Good collects about them over successive research engagements and routes them to the studies they fit, applying a client’s quotas and targeting rules across every source in Research For Good’s network.
Our quality layer, QuIP, verifies participant legitimacy and fit, using persona definitions drawn from participants’ patterns and behaviors to automatically mitigate data-quality concerns when they are most likely to arise.
These capabilities come together to deliver reliable audiences for researchers at a 4% rejection rate compared to an industry average of 18%.
Panels’ Place In Market Research, Now And In The Future
Online market research panels emerged to serve a need that mail-and-phone panels could no longer meet: finding people where they were. The internet fueled disdain for physical “junkmail” and telemarketing calls, rendering the old model obsolete in most cases.
Always-on data collection was the next step in this evolution of market research, as people’s attention drifted to places where the traditional online panel can’t compete.
Granted, there are jobs traditional online panels can still do. Studying a 90% incidence audience answering at a low incentive rate won’t pose any real reach challenges. On the other end, some panel providers still recruit highly specialized groups, such as people with rare diseases or Fortune 500 decision-makers, whose input is highly valuable.
But specificity has become the norm for most brands, whether they’re serving one niche audience or a broad mix of populations with varying incidence rates. Recruiting highly qualified, low-incidence groups is beyond what a traditional provider can do.
One of our long-standing clients, a consumer insights firm, runs studies across banking, health insurance, travel, and auto. A single study might call for adults 65 and older who have used their regional health insurance plan, spread across five specific brands, with quotas set by website and app usage. Methods like always-on research don’t just meet this expectation; they set it.
Research For Good built always-on data collection in part to overcome panel sourcing’s central limit: a finite pool of willing participants. Over more than 15 years, the same system has built a foundation of real human data, more than 2 billion data points. Every engagement adds to that foundation, which lets researchers target by product and category experience, beyond basic demographics, and reliably fill studies with verified human participants.
But what we built didn’t discard the standard for rigor and depth that panels were meant to achieve. As market research continues to evolve, we’re continuing to uphold that standard by ensuring that human audiences remain at the center of research.
Market research is again evolving as firms experiment with synthetic research to conduct studies at the speed and scale necessary to serve consumers without interruption. Our platform of 15 years and counting will continue to provide researchers with constantly refreshed human data. Even when those researchers are consulting a synthetic panel, they’ll be connected to real people, no matter where they’re found.