A LimeSurvey Survey

June 22nd, 2009 by Jared Bothwell

A while ago (and I really mean a while ago), I wrote a review about the open source online survey tool called LimeSurvey. Part of the review included the ability for readers to complete a LimeSurvey survey in order for readers to give it a try. The focus of the survey was to find out if respondents had heard of LimeSurvey and whether or not they would consider using open source software for their online survey requirements.

Over this time 136 respondents have completed the survey and have provided some useful insights into user perceptions of LimeSurvey.

It should be noted that the respondents to the survey are limited only to individuals who have visited the review on the  blog and who opted to participate the survey. The survey is by no means scientific, still let’s have a look at what people said.

Had you heard of LimeSurvey before answering this survey?

77% of respondents had heard of LimeSurvey before. Given that the survey was placed on a review for LimeSurvey this high level is not terribly surprising and not very telling.

haveyouheardoflimesurvey

Have you ever used any open source survey software before?

Only 46% of respondents to the survey had used open source software before. So it would seem that LimeSurvey is not only attracting the attention of open source software junkies but also those that are interested in survey software first.

Have you ever used open source survey software before

Would you ever consider using open source survey software?

91% of respondents said that they would consider using open source software.

would you ever consider using open source survey software

If no (to the question above), would you, could you with a fox?

In an effort to demonstrate the branching functionality of the survey tool those that answered no to “Would you ever consider using open source survey software?” were asked if they would consider using open source software with a fox. It is interesting to note that 37.5& of those that said they would not consider using open source software would change their mind if a fox was present.

Would you could you with a fox

How likely would you be to use Lime Survey for your online survey requirements?

44% of  respondents were quite likely or very likely to use LimeSurvey. 7% would not use it in a thousand years and 3% would not use it in a million years. 46% said maybe.

how likely would you be to use lime survey

Conclusion

While it is hard to conclude much from this survey, LimeSurvey is an interesting project and I remain interested in watching how it develops. One of the most interesting developments on the horizon is LimeSurvey 2.0 will be a complete rewrite.

Posted in Online Market Research Tools | 3 Comments »

Saving Excel Charts as an Image

June 19th, 2009 by Jared Bothwell

Excel is pretty good at producing charts and shifting them into a MS Word or PowerPoint report is simple as copy and paste. Saving a chart as an image can be a little more tricky. One quick and easy way is to copy and paste the chart into MS paint and then save as a tiff image (or something similar).

I think the most straight forward method I have found is to introduce this quick and easy Excel add-in featured on the  PTS Blog. The add-in can be found as a zip file and follow these instructions so how to install a excel add-in (which is pretty easy). A great solution!

Posted in survey design | 3 Comments »

Survey Questions – Mandatory or Optional

June 11th, 2009 by Jared Bothwell

One of the great things about online surveys is that you can create a world where free will no longer exists. Or in other words you can choose to make your survey questions mandatory or optional. This power should be used wisely though as although you can make your survey questions mandatory it is a far harder exercise to make your survey mandatory and making survey questions mandatory can be a great way of increasing your survey dropout rates. I thought it was worthwhile investigating then when questions should be mandatory and when caution should be applied.

To begin with it is probably useful in determining what a mandatory question actually is. A mandatory question is when the survey respondent is forced to respond to the question.  If no response is received then the respondent is not able to proceed with the survey. Generally this is achieved by a simple piece of javascript which in practive is as simple as ticking a box marked “Mandatory”. So far it sounds pretty good. Mandatory questions mean that all your survey questions will be answered – what could be wrong with that? In practice a lot -the major downside is that making questions mandatory can bug the hell out of your respondents and cause them to simply dropout of your survey.

A good rule of thumb is the more mandatory questions your survey has the higher your survey drop-out rate will be. All that is achieved by a high drop-out rate is a high non-response error, which is something which should be avoided at all costs. It pays then to seriously consider when you should make questions mandatory.

  • Screening Questions

Often when conducting your survey you have a target segment in mind. You may wish to research all females aged  between 18 – 40. It makes sense then that any screening questions are made mandatory. In this example gender and age are required to be mandatory to ensure you get to speak to the right people. i.e. females aged between 18-40

  • Branching Questions

Branching questions are when the respondents answer to a question sends them off in a particular direction whilst a different response will send then in a different direction of the survey and asked another question. It is essential to make branching questions mandatory otherwise the survey will not know where to send them and your survey respondents will be stuck in survey limbo for ever (not a nice place). 

  • Essential Questions

Essential questions are those questions that you really need an answer to. You really need to take a step back on this one. If you wrote the survey you are likely to believe that all questions are essential. Before you make all questions mandatory take a long hard look at the survey questions and ask yourself what if any damage will be done if the respondent chose not to answer the question. If you can live without the data then give the respondent the choice (another note, if you can live without the data ask yourself if the question is required at all).

The three tips above are pretty good guidelines to keep in mind when considering if you should make your questions mandatory. But like most thing there are a couple of mitigating factors that should also be considered when making this decision.

  • Length of Survey

If your survey is short you are more likely to be able to get away with mandatory questions than if your survey is long.

  • Relationship with respondent

If you have a close relationship with your respondent’s i.e. if they are staff members then you are more likely to be able to get away with mandatory questions.

  • Incentives

If you have some generous incentives for respondents the above rules for mandatory questions. The rule of thumb with incentives and respondents is the greater the level of incentive the more your respondents will be willing to put up with.

So while mandatory questions are pretty useful to ensuring you get the data you need they also have the potential to really bug your respondents. In a way mandatory questions are a lot like drinking – moderation is the key!

Posted in Marketing Research, Online Market Research Tools, survey design | Comments Off