White Papers

More Than Just the Kappa Coefficient: A Program to Fully Characterize Inter-Rater Reliability Between Two Raters

Category: Data Management, Software and Web Development

Overview The kappa coefficient is a widely used statistic for measuring the degree of reliability between raters. SAS procedures and macros exist for calculating kappa with two or more raters, but none address situations when the kappa coefficient alone does not sufficiently describe the level of reliability. When the prevalence of a rating in the population is very high or low, the value of kappa may indicate poor reliability even with a high observed proportion of agreement. Researchers have recommended reporting several other values in addition to the kappa to address this and another paradox of the kappa statistic.

By downloading you agree to our Terms and Conditions. These include information regarding use of your personal data.

Publisher: University of Pittsburgh
File Format: PDF
Date Published: May 29, 2009
Format: White Papers
Topics: Programming Languages, Data Mining - Analysis

Similiar White Papers

An Extensive Examination of Data Structures Using C# 2.0 - Part 1: An Introduction to Data Structures

Probably the most common and well-known data structure is the array, which contains a contiguous collection of data item

Publisher: Microsoft | Tags: data

Text Mining and PROC KDE to Rank Nominal Data

By definition, nominal data cannot be ranked. However, there are circumstances where it is essential to rank nominal dat

Publisher: SAS Institute | Tags: data, kde

Assigning ROTC Cadets Into Air Force Specialty Codes Using SAS OR's PROC LP Procedure

SAS OR is used to solve a variety of Optimization Problems. This paper describes how SAS OR's Proc LP procedure with the

Publisher: SAS Institute

Workforce Preparation: Equipping Undergraduates With SAS Knowledge

Knowledge of data structures, data quality, data cleaning, SAS programming, data analysis, technical report preparation,

Publisher: SAS Institute | Tags: data, management

Split and Conquer!: Using SAS/QC to Design Quality Into Complex Manufacturing Processes

A complex manufacturing process has many stages, with different factors active at different stages. How can one discover

Publisher: SAS Institute

University of Pittsburgh White Papers

Automatic VPN Client Recovery From IPsec Pass-Through Failures

Featured white papers

The Value of Location Intelligence in the Communications Industry

Pitney Bowes

Public Services are under pressure, the challenge is to do more with less. How do you improve citizen satisfaction, increase cost efficiencies and improve service delivery? The power of location intelligence is helping many local authorities...

Download now »
Best Practices for Translating Customer Satisfaction into Revenue

Citrix Online

Today's support organisations are focused on two top-level metrics: financial results and customer satisfaction. For most, it's easy to track financial performance, but customer satisfaction is akin to speaking a foreign language...

Download now »
HP print solutions and 3M

Hewlett-Packard (HP)

The objective for 3M was to optimize office printing infrastructure at 3M locations worldwide, reduce total cost and environmental footprint. Some of the business benefits acheived by switching to HP print solutions...

Download now »