OU blog

Personal Blogs

about questionnaires 2

Visible to anyone in the world
Edited by Arwen Bailey, Friday, 3 Feb 2012, 18:21

So i have decided to follow my instinct and not the advice i have been given. Living dangerously. I reread the interviews I have transcribed so far and that has - maybe - helped me write questions that will give me the info I want. And i have put the Purpose questions right up front. The advice i received said start with the easy factual questions (Like "are you in any other fellowship alumni schemes?") but what i don't like about that is I think it makes your mind start thinking in a certain way. And I want to start with the Big Picture - WHAT IS THIS ALUMNI THING FOR? Not whether or not it will have face-to-face meetings or a blog roll? Starting the questionnaire with reference to other programs, closes down the options. Same thing about multichoice questions. One pilot fellow asked whether it wouldn't be easier if i had multi choice questions (seminars, website, etc.) but what i don't like about that is that if someone says do you want these things you are likely to say "oh yes, that would be great! I'll take the lot" Whereas i want to see what the fellows envisage themselves. When it comes to analysis, it will be more onerous but there are only 30 or them not 3000 so it is doable. (Famous last words?)

I was surprised how little my pilots wrote. it could have been for loads of reasons, but looking at my questionnaire I realized that in order not to make the questionnaire look too long and scary, I had made wee text boxes. Now i have made them adult-sized and hope it will make a difference. I am DYING to send it out. But want the last two pilots (with the Big Picture questions first and the larger text boxes) - or at least one of them - to come back to me first to make sure that the questions do to some extent work.

Must stop piloting now or I will run out of fellows before i send the final version!!

Permalink 1 comment (latest comment by Arwen Bailey, Saturday, 4 Feb 2012, 06:17)
Share post

about questionnaires

Visible to anyone in the world

Questionnaires! How frustrating! I have so enjoyed my conversations with the amazing AWARD Fellows and the way that you can steer the conversation, ask questions, jump to a later question as it becomes relevant now.

Questionnaires on the other hand... trying to second guess how people will interpret your question is awful. I have a question about what fellows see as the purpose of an AWARD alumni community, and my two pilots have filled it in like i am asking about the practice, which is a later question. If that is the answer I get, there must be something about the question which leads fellows to answer this.

I am going to try swapping the order round. Maybe then they will think 'Oh this must be asking something different!'.

Another thing about questionnaires is the lack of 'gloss' in responses. In an interview you can hear when a fellow is enthusiastic and spontaneous, or really scratching her head to come up with an answer for you. In a questionnaire these important differences get ironed out.

Words are not a great tool for questionnaires.

Permalink Add your comment
Share post

questionnaire, ethics and effectiveness

Visible to anyone in the world

After this phase of interviews, i plan to adapt the interview into questionnaire format and send to another 20 willing fellows. I was wondering whether to hide or make explicit my research framework (considering the elements of CoP, being purpose/domain, practice and community; plus reflections on CoP competence, phase of community, and institutional form). Having read Patton (2002) yesterday on interviewing, i feel like the right thing to do is make the framework explicit.

If you make the framework explicit you may be leading the fellows to see and think in a certain way

but

If you attempt to hide the framework it is like treating the respondents condescendingly, like they wouldn't get it.

From the few interviews i have done, i think the benefit of being straight, being co-researchers is greater than the risk of leading the responses.

Permalink Add your comment
Share post

This blog might contain posts that are only visible to logged-in users, or where only logged-in users can comment. If you have an account on the system, please log in for full access.

Total visits to this blog: 93014