 |
[email protected] |
 |
3275638434 |
 |
 |
| Paper Publishing WeChat |
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License
Wen Pey-Shan, Waid-Ebbs J. Kay, Velozo Craig A.
Full-Text PDF
XML 1619 Views
DOI:10.17265/2159-5542/2015.12.001
Florida International University, Miami, USA
The purpose of the study was to investigate whether rater effect exists between self and informant-ratings on the Behavior Rating Inventory of Executive Function-Adult version (BRIEF-A) in individuals with moderate to severe traumatic brain injury (TBI). We recruited 90 individuals with moderate/severe TBI and 89 associated informants. Participants completed a series of assessments including the BRIEF-A. Self and associated informant ratings of the BRIEF-A were analyzed for rater effect using the Many-Facets Rasch Model. The adequate fit statistics indicated raters were not erratic; informants were more severe raters as indicated by significant fixed Chi-square (P < 0.01) and higher rater measure of informants on both Behavior Regulation Index (BRI) and Metacognition Index (MI). At the item level, seven items showed tendency of rater anditem interactions (P < 0.05), and two out of the seven items reached the significant rater and item interactions (P < 0.01). At these two items, the informants were more lenient; that is, they rated the patients as having less executive dysfunction than the patients’ self-ratings. We suggested when calculating index scores in individuals with moderate to severe TBI, these two items should be excluded. The results of this study offered a guide to clinicians interpreting incongruent results of patient and informant ratings of the BRIEF-A in moderate to severe TBI.
brain injuries, executive function, self report
Wen Pey-Shan, Waid-Ebbs J. Kay, & Velozo Craig A. (2016). Rater Effect on the Behavior Rating Inventory of Executive Function-Adult Version in Traumatic Brain Injury. Psychology Research, 661-671.
Abreu, B. C., Seale, G., Scheibel, R. S., Huddleston, N., Zhang, L., & Ottenbacher, K. J. (2001). Levels of self-awareness after acute brain injury: How patients’ and rehabilitation specialists’ perceptions compare. Archives of Physical Medicine and Rehabilitation, 82(1), 49-56. doi:S0003-9993(01)95199-8 [pii]
Allen, C. C., & Ruff, R. M. (1990).Self-rating versus neuropsychological performance of moderate versus severe head-injured patients. Brain Injury, 4(1), 7-17.
Baker, J. G., Rounds, J. B., & Zevon, M. A. (2000). A comparison of graded response and rasch partial credit models with subjective well-being. Journal of Educational and Behavioral Statistics, 25(3), 253-270.
Chan, R. C., & Bode, R. K. (2008). Analysis of patient and proxy ratings on the dysexecutive questionnaire: An application of rasch analysis. Journal of Neurology, Neurosurgery, and Psychiatry, 79(1), 86-88. doi:jnnp.2007.117184[pii]
Chaytor, N., Schmitter-Edgecombe, M., & Burr, R. (2006). Improving the ecological validity of executive functioning assessment. Archives of Clinical Neuropsychology. The Official Journal of the National Academy of Neuropsychologists, 21(3), 217-227. doi:S0887-6177(06)00018-7[pii]
Cusick, C. P., Gerhart, K. A., & Mellick, D. C. (2000). Participant-proxy reliability in traumatic brain injury outcome research. The Journal of Head Trauma Rehabilitation, 15(1), 739-749.
Fisher, A. G. (1993). The assessment of IADL motor skills: An application of many-faceted rasch analysis. The American Journal of Occupational Therapy: Official Publication of the American Occupational Therapy Association, 47(4), 319-329.
Flashman, L. A., & McAllister, T. W. (2002). Lack of awareness and its impact in traumatic brain injury. NeuroRehabilitation, 17(4), 285-296.
Gioia, G. A., Kenworthy, L., & Isquith, P. K. (2010). Executive function in the real world: BRIEF lessons from mark ylvisaker. The Journal of Head Trauma Rehabilitation, 25(6), 433-439. doi:10.1097/HTR.0b013e3181fbc272[doi]
Godfrey, H. P., Partridge, F. M., Knight, R. G., & Bishara, S. (1993). Course of insight disorder and emotional dysfunction following closed head injury: A controlled cross-sectional follow-up study. Journal of Clinical and Experimental Neuropsychology, 15(4), 503-515. doi:10.1080/01688639308402574 [doi]
Graham, D. (1999). Pathophysiological aspects of injury and mechanisms of recovery. In M. Rosenthal (Ed.), Rehabilitation of the adult and child with trauamtic brain injury (3rd ed., pp. 19-41). Philadelphia, P.A.: FA Davis Company.
Hart, T., Sherer, M., Whyte, J., Polansky, M., & Novack, T. A. (2004). Awareness of behavioral, cognitive, and physical deficits in acute traumatic brain injury. Archives of Physical Medicine and Rehabilitation, 85(9), 1450-1456. doi:S0003999304002941[pii]
Hart, T., Whyte, J., Polansky, M., Millis, S., Hammond, F. M., Sherer, M., … Kreutzer, J. (2003). Concordance of patient and family report of neurobehavioral symptoms at 1 year after traumatic brain injury. Archives of Physical Medicine and Rehabilitation, 84(2), 204-213. doi:10.1053/apmr.2003.50019[doi]
Kelley, E., Sullivan, C., Loughlin, J. K., Hutson, L., Dahdah, M. N., Long, M. K.,…Poole, J. H. (2014). Self-awareness and neurobehavioral outcomes, 5 years or more after moderate to severe brain injury. The Journal of Head Trauma Rehabilitation, 29(2), 147-152. doi:http://dx.doi.org.ezproxy.fiu.edu/10.1097/HTR.0b013e31826db6b9
Leathem, J. M., Murphy, L. J., & Flett, R. A. (1998). Self- and informant-ratings on the patient competency rating scale in patients with traumatic brain injury. Journal of Clinical and Experimental Neuropsychology, 20(5), 694-705. doi:10.1076/jcen.20.5.694.1122[doi]
Linacre, J. M. (1994). Sample size and item calibration stability. Rasch Measurement Transactions, 7(4), 328.
Linacre, J. M. (2014). A user’s guide to FACETS rasch-model computer programs. Retrieved from www.winsteps.com
Linacre, J. M. (2015). Facets software (version 3.71)[computer software]. Beaverton, Oregon: Winsteps.com.
Malec, J. F. (2004). Comparability of mayo-portland adaptability inventory ratings by staff, significant others and people with acquired brain injury. Brain Injury, 18(6), 563-575. doi:10.1080/02699050310001646134 [doi]
Malec, J. F., Machulda, M. M., & Moessner, A. M. (1997). Differing problem perceptions of staff, survivors, and significant others after brain injury. Journal of Head Trauma Rehabilitation, 12(3), 1-13.
Myford, C. M., & Wolfe, E. W. (2004). Detecting and measuring rater effects using many-facet rasch measurement: Part 2. Journal of Applied Measurement, 5(2), 189-227.
Myford, C. M., & Wolfe, E. W. (2003). Detecting and measuring rater effects using many-facet rasch measurement: Part I. Journal of Applied Measurement, 4(4), 386-422.
National
Institute of Neurological Disorder and Stroke. (2012). Retrieved from https://commondataelements.ninds.nih.gov/#page
=Default
Povlishock, J. T. (1993). Pathobiology of traumatically induced axonal injury in animals and man. Annals of Emergency Medicine, 22(6), 980-986. doi:S0196-0644(05)82738-6 [pii]
Rabin, L. A., Roth, R. M., Isquith, P. K., Wishart, H. A., Nutter-Upham, K. E., Pare, N., …Saykin, A. J. (2006). Self- and informant reports of executive function on the BRIEF-A in MCI and older adults with cognitive complaints. Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists, 21(7), 721-732. doi:S0887-6177(06)00107-7[pii]
Roth, R., Isquith, P., & Gioia, G. (2005). Behavior rating inventory of executive function-adult version. Lutz, FL: PAR.
Schiehser, D. M., Delis, D. C., Filoteo, J. V., Delano-Wood, L., Han, S. D., Jak, A. J., …Bondi, M. W. (2011). Are self-reported symptoms of executive dysfunction associated with objective executive function performance following mild to moderate traumatic brain injury? Journal of Clinical and Experimental Neuropsychology, 33(6), 704-714. doi:10.1080/13803395.2011.553587[doi]
Scullen, S. E., Mount, M. K., & Goff, M. (2000). Understanding the latent structure of job performance ratings. The Journal of Applied Psychology, 85(6), 956-970.
Seel, R. T., Kreutzer, J. S., & Sander, A. M. (1997). Concordance of patients' and family members’ ratings of neurobehavioral functioning after traumatic brain injury. Archives of Physical Medicine and Rehabilitation, 78(11), 1254-1259. doi:http://dx.doi.org/10.1016/S0003-9993(97)90340-3
Sherer, M. (1998). Characteristics of impaired awareness after traumatic brain injury. Journal of the International Neuropsychological Society, 4(04), 380.
Vriezen, E. R., & Pigott, S. E. (2002). The relationship between parental report on the BRIEF and performance-based measures of executive function in children with moderate to severe traumatic brain injury. Child Neuropsychology: A Journal on Normal and Abnormal Development in Childhood and Adolescence, 8(4), 296-303. doi:10.1076/chin.8.4.296.13505[doi]
Waid-Ebbs, J. K., Wen, P. S., Heaton, S. C., Donovan, N. J., & Velozo, C. (2012). The item level psychometrics of the behaviour rating inventory of executive function-adult (BRIEF-A) in a TBI sample. Brain Injury, 26(13-14), 1646-1657. doi:10.3109/02699052.2012.700087[doi]
Wilson, K. R., Donders, J., & Nguyen, L. (2011). Self and parent ratings of executive functioning after adolescent traumatic brain injury. Rehabilitation Psychology, 56(2), 100-106. doi:10.1037/a0023446[doi]
Wolfson, A. M., Doctor, J. N., & Burns, S. P. (2000). Clinician judgments of functional outcomes: How bias and perceived accuracy affect rating. Archives of Physical Medicine & Rehabilitation, 81(12), 1567-1574.
Wright, B. D., & Linacre, J. M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8(3), 370.