Welcome!

Welcome to the CMB Blog!  The posts here represent the opinions of CMB employees and guests, not necessarily the company as a whole.

Follow us on Facebook, LinkedIn, and Twitter!

Subscribe by Email

Your email:

CMB Consumer Pulse



ConsumerPulseLogo new resized 244


Download the latest market research reports from our Consumer Pulse series.

Named a Top NGMR Blog

An NGMR Top Blog

All posts by category

Voices of CMB: The Chadwick Martin Bailey Research Blog

Current Articles | RSS Feed RSS Feed

1 Topic, 5 Blogs: Mobile Surveys in Market Research

 

The question posed to the group of 5 Bloggers this month was: "Mobile surveys - For/Against, Pros/Cons, Right Situations/Wrong Situations?" Links to my fellow bloggers Annie Pettit, Joel Rubinson, Bernie Malinoff and Brandon Bertelsen can be found below.

Mobile devices are changing the way people interact with brands, each other, and market research.  From the reduction of land lines among younger consumers to the prevalence of internet usage via smart phones and the proliferation of text messaging as an option.  Below I have laid out some of the factors contributing to the research industry understanding and adopting mobile research as a concept.

1.       "Guys, where are we?" - Charlie on ABC's Lost

Three or four years ago there were a plethora of SMS (text-message) based survey tools developed and launched in the market. Many were self serve but simple, others tried to simulate the full traditional survey experience with skip patterns and longer questionnaires.  Some were connected to panels (e.g., Greenfield and Market Tools) and others were simply opt-in (e.g., Invoke Solutions).   While all of them gathered great initial interest, none really took off for three primary reasons.  1)  The market and use cases were not fully conceived.  2) Client side researchers weren't ready to limit the amount of information they could acquire from respondents and 3) Most of the systems weren't built to connect well with other feedback mechanisms.

In the end, while SMS based surveys received a small amount of adoption (primarily for event feedback), we learned that what was a seemingly simple landscape, one where people were paying to text to vote on American Idol, wasn't exactly what it seemed.

2.       "Right now, hey, it's your tomorrow" - Van Halen

While it pains me to quote the Sammy Hagar version of Van Halen, the truth is that the use mobile technology is changing so rapidly that consumer adoption makes today and tomorrow the same, depending on who you ask.  For iPhone and other smart phone users, the mobile web is about getting the same functionality as a computer with simpler formatting.  For traditional cell phone users, texting is still optimal as mobile browsers are often slow and frustrating.  So, what does that mean for researchers?

  • Be patient. As with all technology adoption, the industry talk is well beyond the average consumers. Most people still do not own the most functional mobile devices and building gen pop. surveys around this functionality would be foolish.
  • Don't try too hard. One of the upshots of great web browsers on mobile devices is that if people choose, they can complete traditional surveys wherever they are. In fact, many of the progressive interactive research techniques discussed last month can be problematic because flash applications are not available in mobile formats.

3.       "The customer is always right" -  Stew Leonard's and other respectable stores

Stew Leonard'sResearchers need to let people participate in the way they desire, not the way we desire.  For example, when I was at Invoke Solutions we ran a test of a mobile survey asking grocery shoppers to opt-in and answer a few simple questions while shopping.  This seemed like a simple, valid idea on paper, however people shopping with kids or carrying groceries had no interest in filling out a survey, even for a small incentive.  It was too much hassle.  Yet, when we ran a program embedded in a promotional event that had on site fulfillment and a number of people prompting people to participate, we saw success.

4.      "We're at the crossroad my dear, where do we go from here?"  - Alicia Keys

With all of the potential downsides of mobile research, there are some great opportunities to grow. 

  • Qualitative research via "self-ethnography" or "diaries." Having a device on your person at all times mean you can always record what you are thinking and doing via text, photos, or recordings. A few years ago I saw my friend Rebecca from Dunkin' Brands speak about a program where they had teens record what they were thinking and doing every time they wanted coffee. The information was incredibly deep and useful. At the time they shipped each participant a digital recorder. In today's world they could have simply given them a number to call or text to.
  • On-site feedback. Promotional events are by their nature participatory experiences and people are willing to give their feedback. In addition, event staff are on site to encourage people to opt-in and handle incentive fulfillment.
  • Everything else. Consider making every questionnaire as mobile friendly as possible. Consumers treat their devices the same as their computers and you don't want to unintentionally block people from participating. That may mean shorter, less interactive questionnaires that include more open ends.

In all cases, we need to continually put ourselves in respondents' shoes and think "would I fill out this survey?"  Just because you can utilize mobile technology doesn't mean that you should.  And just because you haven't in the past doesn't mean you can't.   It is all about asking yourself what the best solution is for the problem you are facing.  

Read the other blogs:

Joel Rubinson of the ARF: post coming shortly at http://blog.joelrubinson.net/

Annie Petit of LoveStats: http://lovestats.wordpress.com/2010/01/15/1topic5blogs-the-only-thing-cell-phone-surveys-are-good-fer/

Bernie Malinoff of Element 54: http://element-54.com/2010/01/1-topic-5-blogs-mobile-surveys/

Brandon Bertelsen: http://www.bertelsen.ca/market-research/1-topic-5-blogs-mobile-surveys

 

Revised Build-Your-Own Digital Camera ACBC design

See how Adaptive Choice Based Conjoint works by building your own digital camera in this demo exercise.

Get started by clicking here.

Posted by Josh Mendelsohn. Josh is our VP of Marketing and loves live music, pugs, tv, great food, market research, New Orleans, marketing, Boston and sports. You can follow him on Twitter @mendelj2 and at The Better Research Blog 

Comments

Interesting thoughts - we've developed a tool to let you substitute an iPhone or iPod Touch for the clipboard for face to face interviews... as people become more familiar with smart phones etc our early adopters are finding it useful for either handing to people to fill in themselves or for the interviewer to use it as a straight clipboard / form substitute.
Posted @ Tuesday, January 19, 2010 2:04 PM by Steve Cohn
Thanks Steve, Interesting tool. Curious to hear any case studies you might have.
Posted @ Tuesday, January 19, 2010 2:34 PM by Josh
We've been working with Angus Associates here in New Zealand (http://www.angusassociates.co.nz/). They have used early releases of iSURVEY for several projects in the tourism space including the Queenstown Winterfest and more recently with a team out gathering feedback from campsites during our summer holiday season all around New Zealand. I can get you some more information / put you in touch with them if that would be useful?
Posted @ Tuesday, January 19, 2010 2:44 PM by Steve Cohn
We have been working with a tool named Mobile Quality Analyzer. It has a survey feature and you can design when do you want the question to pop up on users mobile device, e.g think you want to study users perception about multimedia messages; then you design the survey in a way that the question will pop up only after when the user sends a multimedia message. Our questions were very simple, single response or multiple response, but never open ended as we think users will type just a short sentence. Most of them were related with users end satisfection. As complement it has a web survey feature so you can combine mobile and web survey to get further insights. 
The user has to upload the application on the mobile device, so first you have to recruit participants. 
We have collected useful information about mobile tv. Obviously it is something that has to evolve, but it is very helpful for market research or user experience, I am pretty sure on the future we see more tools like this 
Posted @ Tuesday, January 19, 2010 6:55 PM by Camilo Sabogal
Great post! "Qualitative research via "self-ethnography" or "diaries"" - very interesting project.  
Mobile devices are changing the way of conducting market research. Nowadays you can easily create online<a href:="http://www.dotsurvey.com/">surveys and share them with your customers or employees to get fast results. It takes just a few minutes to complete such survey via smart phone
Posted @ Thursday, January 12, 2012 7:01 AM by Henry
Great post! "Qualitative research via "self-ethnography" or "diaries"" - very interesting project. Mobile devices are changing the way of conducting market research. Nowadays you can easily create online surveys and share them with your customers or employees to get fast results. It takes just a few minutes to complete such survey via smart phone 
Posted @ Thursday, January 12, 2012 7:03 AM by Surveys
Post Comment
Name
 *
Email
 *
Website (optional)
Comment
 *

Allowed tags: <a> link, <b> bold, <i> italics