Most psychometric questionnaires I've seen have the questions/statements set out in a randomised fashion, but some 360 questionnaires don't. Does anyone know of any research into the effect of having 360 questions/statements randomised or not (i.e. set out under their competency headings - or the heading are obvious to the partricipant even if not stated)? Does randomising impact the quality of the results of a 360 survey or not?
5 Responses
Possible reason …
Hi John, my understanding about the random spread of questions in a psychometric test is to ‘retest’ the candidate’s reaction and ensure they provide consistent answers rather than attempt to select more favourable answers. However if I’m wrong I’d gladly be corrected by other forum contributors but I wonder if the British Psychological Society may be able to supply some points of reference. My knowledge of 360 degree questionnaires is very limited so I’m unable to comment on that subject. 🙂
360 & psychometrics are very different things
Hi John
They are very different things
In psychometrics the user will not know what question links to wnat analysis – and it depends on the construct any way. Where as in a 360 it is helpful to look at contect – ie the heading it is refuring to.
In addition the research & development & testing is a psychometric goes into 1000s hours – in most 360 they are poorly written statements at the best of times.
Will randomising help – no – just confuse people when they are giving feedback on multiple people and take them longer to complete.
360 feedback requires context
Hi John
I strongly agree with Mike and his comments. 360 feedback needs to be placed in a context to be meaningful and catagorizing the statements can help with this thinking and feedback process. This is entirely different to psychometrics, their purpose and construction.
Thanks
Mark
360 questionnaires
Thanks Mike
360 questionnaires
Thanks Mark