August 16, 2023
August 16, 2023
Finding the right UX research platform for your team is a tall order. It requires considering your organization's current needs and budget, as well as looking to the future.
Which processes, tools, and frameworks are necessary for both long-term and short-term solutions?
This shopping list will help you ask the right questions so that you can find a tool that fits your organization's unique specializations, budget, and needs. Plus, we've created a full Buyer's Guide to Experience Research Platforms to make the final decision even easier.
With ever-tightening budgets and uncertain headcount, having a clear idea in mind when shopping for a research and insights tool is critical.
Are you…
Whatever the reason, jot it down and keep it handy as you begin your peruse of the countless options of research tools.
Narrowing in on these key questions not only helps you, the decision-maker, but can also drive buy-in from other stakeholders and leaders that this is a problem worth solving. If you’re not sure where to start, take a week to conduct informal interviews with your collaborators, stakeholders, and team to identify the drivers of tooling.
And if you're stumbling with how to even conceptualize and operationalize "ROI," elements like acquisition, activation, retention, referral, and revenue (termed the "pirate metrics") are a good place to start. Developing business knowledge—how a business "works" and what impacts research can have—is another core skillset when starting shopping.
Having an unclear driver or a lack of a rationale can lead to aimlessly wandering the aisles of research tools, wondering if you are even hungry at all. More seriously, it can lead to poor or undetermined ROI, a loss of trust, and the potential devaluing of research broadly.
Without metrics, it will be very difficult to create a case for securing ongoing funding. You'll likely want to keep using a research tool you and your team find impactful.
So really stop and think—why are you in the market for a tool? What do you hope to achieve once one has been onboarded?
Now you can start perusing those aisles...
This is likely the first item on your list. What exactly does the tool or platform do? Most platforms have an angle or reason for existing. Ideally, that will be spelled out on their homepage. "Usability testing for all" or "The only recruitment tool you'll ever need."
Before you start combing search results or databases, create a list of the kinds of research projects you and your team will need. Don't get too narrow—staying broad and considering the complement of approaches, methods, and features you and your team will eventually need is helpful when evaluating.
Here are some example questions:
Most user research platforms have similar question libraries (e.g., open ends and scales), so note if you need something more specific, such as mobile view or desktop screen recording.
This is a perfect place to start because these elements can usually be intuited from a marketing website or help center, avoiding the need for a sales call just yet.
Equally important to the core research functionality is the operations or ops elements. For scrappy or small teams (or those facing uncertain budget futures), having built-in ops features can maximize time, reduce rework, and improve research output quality.
To build your ops list, think of all the preparatory, setup, design, and admin-related tasks any one research project requires. This list should really help narrow in on the best tool fits.
Questions to suss out operations capabilities:
Depending on the kinds of projects you seek to run (see above) you might also have more specific ops needs, like:
This is a key shopping bucket to consider, because operations misses can grow over time, limiting your team's impact. When ops are considered, a tool can free up more time for those knotty strategic and foundational questions that help make research invaluable to an org.
Despite this being a list of considerations for experience software, not all platforms will leverage design, UI, and engineering power similarly. This shopping item might require a formal demo or signing up for a sandbox account, but will go a LONG way toward helping you determine long-term fit.
As an experience thinker, you'll likely have a list of preferences regarding an experience, but be sure to consider junior and non-research colleagues.
Specifically:
User interface and experience is key for teams who are asked to democratize or who want to loop in stakeholders more actively into the research process. If you find it difficult to intuit and explain, consider the time your product, design, and engineering colleagues might.
As an experience pro, you should have a high bar for your tooling:
After getting a handle on the core elements of a research tool—the what it does—it's time to consider how it does it.
These shopping list items are key for tools you plan to purchase subscriptions for—those that you hope to integrate into your team as extensions of it.
The research tool itself is only half of the story. The other half is how your participants’ data is managed. This might require a message to your security or trust team, but these are critical questions, especially if you work in a regulated industry, on a remote team, or have international aspirations.
Frankly, even if those don't apply to you or your org, privacy and security issues should still be top of mind for you and the providers you partner with.
Some questions to get you going:
An engineering partner might have more specific questions about penetration tests, up/down time, and other specific technical elements, but don't skip questions about your participants’ data—that is your relationship to maintain and sustain.
Some teams may need facial anonymization, per-person data scrubbing, or even client-side invisibility. Any and all of these questions should be fair game. If a sales person hesitates or waffles at all, consider another provider. They should be as serious about it as you are.
With more info on the what and how, it's time to turn to how much—pricing and offerings. There might not be much to evaluate in pricing as much of the industry shifts to subscriptions, but that creates openings for vendors to separate themselves with other items like support and research skills.
In general, research tooling is priced in a few ways
With freemium, access is free, but with certain features gated. Ad-hoc usually offers a complete platform experience on a per-project or engagement basis (although these can be more expensive over the long run). Finally, subscriptions are the most frequent and are typically segmented by tier.
Here is another moment to reflect on your team, both in its current form and how you hope it will grow. Will your team grow in the next 12 months? Will stakeholders want to view projects? Could other teams be interested in running research?
Penciling down these nuances will help you better evaluate the myriad of tiers, terms, and types of subscriptions.
Here are some things to consider:
A good shopping tip is to reflect on the past 12 months of research you ran: What did each project require in terms of access, features, etc.? Now imagine you had to run ALL of those projects with this tool. Could you?
Some platforms gate concurrent studies or limit the number of builders versus viewers. There is no "right," answer, only better or worse fits.
A dollar spent on a tool is not equal across tools, with support being the difference. Regardless of your team's size, having on-hand support (or not) and the kinds of support a platform can provide is a strong predictor in whether or not you see ROI or mis-spend your budget.
Once again, reflect on your team and your own bandwidth: Do you have a principal researcher who folks can route questions to? Are you available to help if/when it's needed?
If not, make sure to dig into the platform's on-staff support. Better yet, ask for a conversation with a support person.
Here are some questions to guide you:
Support can go a long way, especially if you or your team are newer to remote experience research tooling. Not only can they help with bugs, participant problems, and the day-to-day of operations, but some can help mentor junior colleagues and serve as extensions of your team. This further boosts your ROI.
You might have already found your tool of choice, but if you're still debating, here are some other elements and wish list items to consider:
The market for research software has never been as active and diverse as it is now. Experience and insights teams have hundreds of options before them.
The best choice is likely out there, especially for those who stop to consider their needs—both now and in the future—and carefully compare those to what a platform offers.
When it works, a research tool shifts from a platform to a partner. This helps teams scale, speed up, and smooth their research practice—further building empathy and insight impact org-wide.
Ben has a doctorate in communication studies from Arizona State University, studying “nonverbal courtship signals”, a.k.a. flirting. No, he doesn’t have dating advice for you.