Testing Reliability and Validity of the Oulu Patient Classification Instrument—The First Step in Evaluating the RAFAELA System in Norway

Objective: To study reliability and validity of the Finnish Oulu Patient Classification instrument in Norway. Background: The Finnish patient classification system RAFAELA consists of three parts: 1) daily patient classification of nursing intensity using the Oulu Patient Classification instrument, 2) calculation of nursing resources providing bed side care per 24 hours, and 3) Professional Assessment of Optimal Nursing Care Intensity Level. The RAFAELA system has not been tested outside of Finland. Methods: A prospective, descriptive study was performed at 5 clinical units at Oslo University Hospital during 2011-2012. The interrater reliability of the Oulu Patient Classification instrument was tested by parallel classification including 100-167 patient classifications pr. unit, and analyzed by consensus in % and using Cohen’s Kappa. Convergent validity was tested by using the average Oulu Patient Classification instrument value to predict the average Professional Assessment of Optimal Nursing Care Intensity Level for the same calendar day by linear regression analysis. Results: The Oulu Patient Classification instrument consensus of parallel classifications varied between 70.1%-89%. Cohen’s Kappa within patient classes varied between 0.57 and 0.81, representing substantial interrater reliability. The Oulu Patient Classification instrument was valid as the instrument in average explained about 38% of the variation of the Professional Assessment of Optimal Nursing Care Intensity Level. Conclusions: Patient classification systems tested for psychometric properties are needed and this study provides evidence of satisfactory reliability and validity of the Oulu Patient Classification instrument as tested outside Finland, demonstrating that this instrument has international relevance within nursing.

A Qualitative Study of Manager Experiences Using the RAFAELA System

Objective: The objective was to explore manager experiences using the RAFAELA system. Background: The RAFAELA system was developed in Finland during the 1990s to create a work situation where patients’ care needs were balanced with personnel resources. The system is used in almost all hospitals in Finland and is implemented in several European countries. However, the system has never been evaluated outside Finland. This study, focusing on the managers’ perspective, represents the second report from a larger Norwegian evaluation project of the RAFAELA system. Methods: An explorative qualitative design was chosen. Data were collected by individual in-depth interviews at a university hospital in Norway during 2012-2013. A total of 10 informants in various management positions were interviewed. The tape-recorded interviews were transcribed verbatim, and the transcripts were analysed using Kvale’s method for content analysis. Results: Four main themes emerged from the qualitative data: making the invisible visible;a common language;a system for prospective planning;and a resource-demanding tool. Conclusions: The study indicated that the RAFAELA system provided useful information about the patients’ care needs and nursing activities. Also the system provided a common reference frame for discussing nursing, staffing and allocation. Although the managers considered the RAFAELA to be time consuming in the implementation phase, they considered the system to be an important tool.