For the MR industry, the time to capitalize on mobile research is now. According to an eMarketer report, U.S. mobile Internet usage is projected to increase to more than 101.1 million users (32.3% of the population) in 2011, and similar growth is occurring around the world. This group represents a huge and largely untapped respondent pool – and unlike PC-user respondents, they have the ability to provide feedback from virtually anywhere.
Yet even with all of the industry buzz this year, mobile is still a new and unchartered survey platform for most researchers. The challenge for newcomers lies in designing a mobile survey that both meets its research objectives and provides a satisfactory user experience for respondents. Effective mobile survey design requires much more than simply replicating an online survey in mobile format. Certain aspects of the survey design are contingent upon the kinds of mobile phones being utilized by respondents (smartphones vs. feature phones), and other design aspects are the same regardless of mobile device type. Let’s start with a few best practices that should be utilized for every mobile survey.
First, all mobile phone screens offer limited display real estate when compared to PC screens, so in the world of mobile surveys, less is always more. Use minimal branding so that the majority of the viewable area can be devoted to question content (it may be necessary to restrict branding to only the first and last survey pages for feature phones). Then, ensure that questions and response options are written as concisely as possible to optimize the limited display and reduce the need for scrolling or breaking answer lists onto an additional page. The total number of questions contained in the survey must also be limited; mobile devices are intended to be utilized on-the-go, so lengthy surveys that take more than a few minutes to complete are not ideal. Finally, there are some commonly-used online survey elements that are not supported by a majority of mobile phones, and should therefore be avoided. Table structures, Javascript, and even Other: specify questions can be tricky to implement in the mobile world.
Another consideration for all mobile surveys is the invitation delivery method: SMS (text) or email. While text invitations are likely to grab the recipients’ attention faster than email, SMS laws and costs vary greatly by region and must be defined for each mobile project. SMS rates can quickly get expensive for the client – or worse, the target recipients – therefore text expenses must be planned for in advance. Typically email invitations are best if the application permits their use. WAP push is possible in regions such as Europe where a common wireless network standard (GSM) is used.
Shifting gears, there are additional best practices that are determined by mobile device type. Researchers must determine whether their sample will be limited to users of smartphones (with higher functionality) or feature phones (with more limited functionality) or include a mix of both. This decision has several implications. For instance, smartphones offer network speeds that feature phones simply cannot match. Network speed affects how quickly each survey page (and embedded image) loads, and slow load times undoubtedly affect dropout rates. Older mobile devices also have limited color configurations that could result in a distorted visual appearance of the survey and its included elements, and some cannot support images at all. On the other hand, the image capabilities of the latest smartphones rival that of PCs, TVs and digital cameras, and most auto-scale images to fit the screen size. Full-motion video can even be utilized if the sample is limited to smartphones, however its implementation can be challenging because different devices utilize different display formats. Smartphone surveys can also include the use of embedded links (to provide additional product, support, privacy policy, etc. information), whereas most feature phones cannot.
Data entry is another a primary consideration based on device type. Smartphones enable relative ease for data entry because of their full alphanumeric key options, while feature phones have traditional phone-style keypads that make text inputs slower and more prone to typing errors. Touchscreen smartphones have a distinct issue as well – ample space must be provided between response selections so that respondents do not accidentally click the “wrong” response, and thereby invalidate the survey results. This risk can be mitigated by utilizing a mobile survey solution that includes advanced touchscreen support to optimize visibility and interaction.
This list provides a summary of the key mobile survey design considerations, but of course there are others, and every research project has its unique variables. And while much of this blog outlines the limitations of feature phones vs. smartphones, it is imperative to note that feature phones are still very effective in mobile research provided the surveys are optimized for their capabilities. For researchers who are just entering the mobile arena, hands down the number one best practice is to work with a mobile survey solution provider that possesses the software functionality and delivery experience necessary to ensure your project’s success.
Stay tuned for the next Kinesis blog post…it will identify the essential best practices for implementing and managing a mobile panel.