Now I am no perfectionist and I will never claim to be one either… I prefer the term Meticulous! I think it suits me! (And before you go looking it up, yes they mean pretty much the same thing one just sounds a little less anal retentive)
With that said I must admit I was a little blindsided by the number of errors that popped into our survey as we began conducting them. I, like most of my group, had made the fatal mistake of assuming (yes we all know what assuming does.. Check out the sixth example) that our survey was pretty much fail proof and ready to be released into the world…. We had written and rewritten, checked and rechecked, pre-tested and retested the survey numerous times. We though we had it down to a science and that our collective “meticulous” qualities had paid off.
So as tiny holes in the survey design began to let water seep through onto our results making them more than a little soggy, we realized maybe it wasn’t as perfect as we thought!
Thus began the list of problems and issues that popped up like weeds in the spring.
- Questions weren’t as clear as they could have been.
- Our prepared script didn’t cover all the pre-buttal and rebuttal areas.
- We didn’t leave an out for people who chose not to answer the income question.
- We never seemed to have enough supplies (surveys or coupons)
Those are just to name a few. I am sure had I the time I could make a longer more in-depth list. But, I think you get the point all the same.
So how could this happen….issue one arose merely because we failed to think outside the box. For example one of our questions was:
Where do you live?
a. Auburn
b. Valley
c. Columbus
d. Montgomery
e. Alexander City/ Lake Martin
f. Other_____________________
Followed by:
What is your zip code _______________________
Normally this wouldn’t be an issue but when you begin to conduct survey’s on a campus with students from all over the country and the world and you don’t include the words “Right Now” to the above question, you would be amazed at what you get back. People put in everything from Florida to California and everything in between. This would have been fine had we not been trying to determine where they traveled from to shop at the Colonial University Village mall. With these results we looked like we had the most highly shopped mall in the South and that everyone from around the nation made trips to shop here “2-5 times a week.” Obviously this wasn’t going to work, so we are going to have to make some adjustments when getting our final data together.
The second issue was the pre-buttal and rebuttal to respondents questions. Although we had in fact discussed what we would say right up front when giving them the survey as well as what we would say to certain questions… we managed to miss one. We didn’t fully discuss what we would say when we were asked by students to explain the following question:
Your average annual household income is:
a. Below $15,000
b. $15,001 – $30,000
c. $31,000 – $60,000
d. $60,001 – $100,000
e. $100,001 and above
This seemed pretty clear to all of us so we had put much thought into the fact that students would be asking, “Do you mean my parents or my part time job?” Some of us answered, “Just put your parents.” Some of us answered, “If they still give you money guesstimate what they give you and what you make.” and other answers varied from those. Basically we have no means of knowing which people were told what and which incomes are accurate. So now we have another problem to sift through.
That problem led directly into another problem, what about the people that didn’t want to answer this question at all? When we were in the mall we ran into a lot of elderly people that didn’t want to divulge this info. Unfortunately, as mentioned above, we didn’t leave an out for these people. We neglected to include the “Prefer not to Answer” choice for those people who felt it was none of our business regardless of what it was for. Had we decided to throw out the surveys that left this question unanswered we would have lost a staggering amount of surveys, so this will definitely be in our upcoming discussions.
Finally, we continually ran into the issue of limited supplies. On more than one occasion we found ourselves having to cancel planned survey times due to no surveys being available and no incentive coupons for Chick-Fil-A. I realize this sounds like an easy to fix problem… however we were completely dependant on our client to furnish both paper copies of the survey and coupons. (Broke college students can’t afford much … especially not hundreds of copies, plus we had no contact with the manager of Chick-Fil-A in the mall to obtain more coupons.) Unfortunately, our client did not work weekends and we were only able to get so many supplies from her during the week. We quickly went through our supplies and found ourselves empty handed by Friday.
So, much to my chagrin (and that of my fellow team mates) our survey did in fact have holes… some of them bigger than others. Ultimately we learned a lot about trial and error. Hopefully as we begin tabulating our information and breaking it into a written format we will be able to fix the errors and make most of our survey into helpful information for our client… Time will tell.