October 23, 2023
October 23, 2023
Understanding customer experiences while shopping—or even their general brand sentiments—is a powerful way to gain insight for your company's positioning and growth. Setting up the studies, on the other hand, can be filled with pitfalls that make the study far less effective than it could be.
In this guide, we walk you through what questions retail brands can answer with unmoderated user studies, the specific benefits of remote research, and best practices to make your participant experience as effective as possible.
Lastly, we’ll also provide you with several template examples for how you could conduct your own studies. This information is especially helpful to anyone using dscout's platform, but the knowledge applies regardless of which tools you decide to use.
Let's dive in!
In-the-wild studies capture shopping context and in-the-moment purchase decision factors.
This kind of research can answer a variety of questions that may improve the overall shopper experience, such as:
Scouts can outline the competitive landscape for our clients, and clients can see firsthand from scouts which brands or companies they rely on or prefer shopping at, and why.
Some of the questions your team can answer include:
Explore relationships to your brand. Recruit a mix of acceptors and rejectors (or even brand-unaware shoppers) to understand what inspires shoppers and what turns them away.
Whether it’s in the store, online, or out in the world, let scouts show and tell you why they can’t get enough of—or avoid enough of—a specific brand.
Consider looking for answers to questions like:
Collect the resource inventory participants rely on when they find brands to use or avoid. You can also use this as an opportunity to introduce concept sketches, or present new messaging to ask for unfiltered, qualitative feedback.
As omnichannel shopping blurs the divide between physical and online stores, remote research also allows you to more accurately tell a variety of customer stories.
Sam Masi
Senior Research Advisor, dscout
One of the best ways to get valuable insights is to set the stage for ecological validity. This study design mimics real-world situations as much as possible, as opposed to moderated studies that may feel contrived and unrealistic.
Following participants on their shopping journey remotely allows brands to see their customers “in the wild.” A real shopping trip with a real customer will result in more actionable and accurate findings than a simulated experience with someone outside the target market. Unmoderated methods also preserve ecological validity further, reducing the moderator’s influence on the participant’s journey.
Although you will still be prompting participants to go through certain scenarios, doing so with an unmoderated approach in a real-world setting will get as close to the real deal as possible.
Unmoderated, remote research allows researchers to “follow” participants as they experience a shopping moment. If you ask the right media question prompts, you can see what participants are seeing and how they feel about it in real time through pictures or videos.
This allows researchers to hear from their own customers and learn directly about what their customers experience. As omnichannel shopping blurs the divide between physical and online stores, remote research also allows you to more accurately tell a variety of customer stories.
Don’t rely on, “Would you?” but rather, “Have you?” to find your participants and assess shopping behaviors.
Laurel Hartnett Brown
Senior Research Advisor, dscout
Think carefully about limiting the time a participant spends in a store or department. Some research activities may attract uncomfortable or harmful attention from staff, especially if participants are asked to visit a store without making a purchase. This can disproportionately impact people of color.
Ask yourself: if video is important to your stakeholders, can participants record right before or after their time inside the store? When possible, allow participants to choose video in store or a written alternative. You might still receive many video responses.
Whether in-store video is required or optional, also consider how to reduce awkwardness. For example, if asking for a video of a specific department or display, offer guidance like, “Imagine you’re on a video call with your best friend and want to show them this display. Talk about how it’s helpful, or if it leaves you with any questions.”
Don’t rely on, “Would you?” but rather, “Have you?” to find your participants and assess shopping behaviors. When participants are in store, limit open ended questions as much as possible!
Consider allowing more natural behavior at the beginning of a study—give yourself room to be surprised by themes. If your brand comes up naturally, great! If not, what can you learn from comparisons? After observing natural behavior, hone in on brand-specific questions.
After drafting your question script, check for any brand- or industry-specific wording that might not be clear to all participants. When in doubt, add a quick definition of your terms to set up for success. When participants are self-guiding, definitions can reduce self-doubt.
When fielding and managing unmoderated studies, we cannot emphasize enough the importance of over communicating. Over communicating can and does help set participants up for success as they participate in-store shop-along missions.
This means adding clear and digestible instructions for participants, especially what type of media outputs you want to see from them while they’re in store. For example, that may be something like, “Three photos from the frozen foods aisle and a video of you picking which frozen food to purchase.”
Use checkpoint questions to guide them throughout the research study. Be clear on when scouts should be in-store to complete questions (and if they should be in a specific aisle to complete the questions). Also be clear when scouts can leave the store.
It’s okay to repeat yourself throughout the mission instructions and checkpoints! We recommend it so that we’re minimizing the number of chances for scouts to incorrectly complete an activity. This genuinely sets them up for success the first time they engage with the questions and activity.
Review participant responses as they come through and help coach or guide them, if necessary, before the deadline approaches. Even though this is unmoderated, remember to still utilize communication channels to communicate with your participants.
That includes…
Give participants enough time to make an in-store trip during their busy schedules. This usually means giving them at least five days to complete a study, and those five days should include one full weekend. For example: Instead of running a research study from Monday-Friday, run it from Wednesday-Sunday so participants can get a weekend to complete the study. This helps people who work during the weekdays.
When setting up the reward, make sure you’re compensating scouts accordingly for what you’re asking them to do.
For example: you’ll want to compensate scouts knowing that they need to drive to a specific store, make a purchase, and record their in-store experiences. Take into account the logistical aspects of your research study when setting the reward for your participants.
Lastly, even if a purchase isn’t technically required for the study, consider padding the incentive. For example, you can say something like, “While no purchase is necessary, the reward for this study includes $10 toward the cost of a purchase (in case you’d like to buy anything while you’re in the store).”
"I cannot emphasize the importance of overcommunicating in unmoderated studies enough.
Belinda Nam
Senior Research Advisor, dscout
Conduct an iterative study to assess store layout before and after changes. Mobile, media-rich surveys will help you capture the real-time shopping experience.
Before participants go on their shopping trip, have them answer questions about previous shopping experience and current behaviors relating to the brand.
Questions like…
Have participants take you with them to their store visit. Be sure to prepare them for what they’ll be expected to do during the visit, and when to start answering your questions.
Ask participants to compare their shopalong experiences at your store versus competitors' through unmoderated/evaluative research. See where your store ranks compared to others, and the why behind it.
You’re looking for participants who recently adopted a dog in the last six months, went in-person shopping for their dog in at least two stores (and one of the two stores is yours) in the last six months, and is currently in the market for purchasing a new dog bed.
Entry 1 - Ask participants to share their shopalong journey as they go to their preferred pet store to shop for a dog bed.
Entry 2 - Ask participants to share their shopalong journey as they go to your pet store to shop for a dog bed.
Compare experiences shopping at their preferred store versus your pet store.
Explore what experiences (if any) a participant has with the brand through an unmoderated study. Participants answer these questions while waiting to receive the product.
What are their first impressions of this product?
Ask participants to show how and where they use the product. If possible, allow for natural use. For example: “Show us each time you use this product. If you don’t use it in a given week during this study, check in to tell us why.” This gives you an opportunity to capture delights and pain points during natural use.
Ask participants to get creative! For example, sketch out how they would change the product if they were in charge of the brand.
Suss out the top questions people ask when considering a brand. What information feels most helpful and why?
Ask participants to show where they turn to when researching products or brands over the course of roughly one week.
Ask participants to reflect on their research from the week, and share one brand that stands out.
To wrap up, introduce your brand. Ask participants to write an informal mission statement (in their own words), and their likeliness to shop. Include a stakeholder question as well. For example, “Does new messaging around sustainability resonate?”
Whether you are trying to understand brand sentiment, the competitive landscape, or in-the-wild shopping experiences for customers, well-designed unmoderated studies can bring in a wealth of information to later synthesize and act upon.
Do you have your own experiences around retail research, or questions you'd like to ask fellow peers? Check out People Nerds’ Slack community to continue the discussion!
Laurel, Belinda, and Sam are all senior research advisors on dscout's customer experience and research (CXR) team.
Kris is a content creator and editor based in Chicago.