« Taiwanese Journal of Political Science No.27Publish: 2006/03

Reliability of Political Attitudes and Behavioral Scales in the Survey of TEDS: Test-Retest Reliability and Internal Consistency Analysis

Author: Yu-Tzung Chang

Abstract / Chinese PDF Download

In  the  last  few  years,  empirical  researches  in  political  science  have  oftenneglected  to  systematically  examine  their  measurement  indices  and  methods.Concerning such a general neglect, this paper uses the large-scale surveys of TEDSconducted  in  2003  and  2004  as  the  bases  for  analyzing  a  number  of  possibleproblems  related  to  the  reliability  of  the  measurements  of  political  attitudes  andbehavioral scales. The degree of reliability can be measured by performing a test-retest  and  then  examining  the  result  for  the  extent  of  internal  consistency.  Test-retest is carried out with the Kappa coefficient and the weighted Kappa coefficientwith  quadratic  weighting.  Internal  consistency  is  tested  with  the  widely  usedCronbach’s  α  coefficient  and  the  Guttman  formula  of  split-half  reliability.  Usingthese four measures to examine the two TEDS surveys in 2003 and 2004, we findthat, on the whole, the two surveys pass our tests for reliability. It is found that anumber  of  previously  considered  very  sensitive  political  topics,  such  as  votersupport,   ethnic   identity,   Taiwan   independence,   and   party   identification,   allrelatively reveal stable conditions of results. We also find that the most importantmeasures  of  political  attitude  display  a  high  degree  of  internal  consistency.  Inaddition  to  the  stability  found  in  the  acquired  results,  our  tests  also  reveal  someunexpected results on a small number of items, which may require further revisionin our future research.

Keywords:behavioral scales、internal consistency、political attitudes、TEDS、test-retest reliability