I am working on a report together with several co-authors. The data concern several performance measures on a set of groups. These measures are scored by external judges. We report findings on several datasets, including several of the 6 ICC's discussed by Shrout & Fleiss (1979). We determine these using the icc function from the irr package. We have also used the ICC function from the psych package.
However, one of the datasets has varying numbers of judges for each group. One group may be rated by 2 judges, whereas others may even have ratings by up to 5 judges. My problem is that I don't see how I can use the icc or ICC functions for determining the icc's these groups, since icc/ICC require that all groups have the same number of judges (as far as I understand). Alternatively, I could report the ICC1 and ICC2 (in the multilevel package), but these are different from the Shrout & Fleiss ones, and we would like to be consistent. (of course, I know that not all 6 icc's apply in every case, but we would like to stay within the Shrout & Fleiss framework and then report the relevant icc). I have searched extensively for a function that would allow to calculate S&F icc's for a varying number of judges, but I can't find one. Are there any there functions that allow me to do this? Or is there a way to still use icc or ICC?
<P><p><font face="Arial, Helvetica, sans-serif" size="2" style="font-size:13.5px">_______________________________________________________________<BR>Care2 makes it easy for everyone to live a healthy, green lifestyleand impact the causes you care about most. Over 12 Million members! http://www.care2.com
Feed a child by searching the web! Learn how http://www.care2.com/toolbar</font>
[[alternative HTML version deleted]]
Archive maintained by Robert King, hosted by
the discipline of
statistics at the
University of Newcastle,
Archive generated by hypermail 2.2.0, at Wed 16 Jun 2010 - 20:40:46 GMT.
Mailing list information is available at https://stat.ethz.ch/mailman/listinfo/r-help. Please read the posting guide before posting to the list.
list of date sections of archive