Add new comment

3 Ways to Make Survey Reports Interesting and 3 Tips for Doing It

Every week you can find a new survey report that tells you things that aren’t very interesting: How many recruiters use LinkedIn; that digital advertising continues to overtake print; that an increasing number of companies are using CRM systems.

These reports aren’t interesting because a) they tell us stuff we already know (or can guess), and b) they don’t tell us anything we can do anything about.

If you want to write a survey report that will grab readers’ attention (instead of putting them to sleep), there at least three ways you can go:

  1. Say something counterintuitive. For example, it’s been a given in business for over 20 years that good risk management starts with tone from the top. I’m not giving you this one for free (unless you ask me), but I’ll bet 10 cents to the dollar it isn’t true. I will celebrate the day someone publishes a survey that disproves this ancient canard.   
  2. Describe what distinguishes the leaders from the laggards. That 39% of companies use cloud CRM is of no interest to anyone except CRM vendors. That 80% of the best companies – as rated by their salespeople and, perhaps, their customers – do, versus 20% of the worst, might be of great interest. Unless you take the trouble to find and reveal meaning in the numbers, they’ll be, well, meaningless.
  3. Explain the why. Surveys reliably reveal the what. For example, how many companies use demographic data to target their direct mail (still a powerful marketing channel, by the way). But they rarely tell you why. (Perhaps it’s because today’s databases allow for more precise targeting.) If you add the why, your data will be much more relevant.

All very well, you say, but how can I do these things? Here are three ways:

  1. Start with a hypothesis. Don’t write your survey questions until you are sure of the conventional wisdom you want to dispute. Even if you don’t quite overturn the conventional wisdom (tone at the top, for example, isn’t irrelevant; it’s just not the most important factor), the exercise of thinking about it hard enough will give you enough good questions to get to the heart of the issue and thereby yield a vastly more interesting story.
  2. Ask differentiating questions. These are questions that separate respondents by characteristics other than those for which you are probing. The most revealing queries are those that separate respondents that are successful from those that are not. For instance, if you are examining how well companies manage risk, ask them how much their company has lost by misadventure in the last n years (as well as what the company’s revenue is so you can normalize for size). That’s a numerical differentiator. Also ask them how well they think they manage risk. That’s a qualitative self-assessment, of course, with all the hazards that entails. But it can be a useful double check. If the qualitative varies significantly from the quantitative, it might give you a story about self-delusion among risk managers.
  3. Include interviews about what works and what hasn’t. Design an interview guide to complement your numerical survey. If you anticipate that more and more companies are moving applications to virtual private clouds, make sure that the interview questions ask those who are why they are doing it. You can get a superficial rationale from the survey – assuming you anticipate it – either with multiple choice or open-ended questions. But an interview will give you infinitely more depth, and quite possibly a supporting story or case study you can feature.

Too many companies think a survey report all by itself will be something people will want to read. They’re wrong, especially when their surveys ask questions for which they (and most readers) can predict the answers. Asking those kinds of questions certainly mitigates the risk of coming up empty handed. However, it also almost guarantees that the survey will confirm what everyone already knows, and what good (or fun) is that? However, with a well-designed plan, and a sincere desire to discover something new, you are almost certain to return from survey-land with insights no one else has. That will grab reader attention, as well as inform future business decisions and actions.