Thursday, April 4, 2019
Determining Cognitive Functioning of Individual
Determining cognitive Functioning of IndividualSerial assessment in neuropsychology is necessary to make inferences regarding an respective(prenominal)s level of functioning, i.e. to determine whether there has been real improvement or decline, outside of measure illusion, normal variety and clinically insignifi do- nonhingt compound 1. A number of psychometric methods have been developed in rewrite to interpret changes in turn out haemorrhoid over repeated cause of assessment. The associated problems and processes that are involved in delineating notice grades into their subcomponents of cadence flaw and true accounts are complex and problematic 1.acquiring knowledge and understanding of issues pertaining to measurement error, such as the measure error of measurement (SEM,) is crucial to veracious interpretation of neuropsychological rise results and change scores. The SEM refers to the total error variance of a set of obtained scores, where the obtained scores are a n unbiased estimate of an individuals true score 2. It is the standard deviation (SD) of an individuals test scores had the specified test been under payoffn multiple times, and is calculated by multiplying the baseline SD of a measure by the square root of one minus the reliability coefficient of the measure 3. The SEM is inversely link to a tests reliability, such that bigger SEMs reflect less bona fide tests, and consequently foretell diminished accuracy with the measure taken and the scores obtained 1. This leads to greater variability inside a test battery and thus each interpretation of results in such a case should be undertaken with a enormous degree of caution 4.SEMs are useful in preventing the unwarranted attachment of significant nitty-gritty to between-score disagreements. That is, SEMs and their corresponding confidence intervals may overlap, indicating that some of the observed score variance may actually be attributable to error in measurement 1. However, wh ilst the SEM is useful for estimating the degree of measurement error, it is not a fitting predictive measure as it is based on a distribution that presumes true score knowledge, which testament always be unknown as tests do not have perfect reliability. As such, utilising the standard error of estimate (SEE) for such purposes may be the more appropriate method 2. The SEE is a method which utilises a regression-based approach and measures the dispersion of predicted scores 5. The SEE reflects the SD of true scores when the observed score is held constant, and is the statistic from which confidence intervals should be constructed 2.The construction of confidence intervals is closely related to a tests reliability. more(prenominal) reliable tests, in terms of internal consistency, represent homogeneity within the test itself. Thus, the associated confidence intervals provide encompass a more narrow range of scores, with the resulting estimate existence more precise 2. It is there fore necessary to consider a tests reliability coefficient, as be execrable a plastered site, the utility of a test is compromised 2. Furthermore, as the reliability of a test is the single largest factor in determining the degree of change needed to occur over time from which the observed difference can be deemed to reflect actual change, using tests with proud reliability coefficients is of paramount importance 6.The consideration of measurement error in neuropsychological test results may also incorporate the assessment of observed score differences in terms of clinical significance. Clinically significant change can be taken on the basis of whether an individuals change in test performance over two occasions reflects sufficient improvement, so that the individual has shifted classification categories, for example from impaired to normal 6. Therefore, if a change is to be considered clinically significant, the tests being used to assess observed score differences need to be r eliable.However, interpreting clinically significant change may also be problematic. Whilst there may be a considerable observed change in test scores from one measurement occasion to the next, if the starting point is at the extreme low end of a category, and the end point is at the extreme high end of a category, then an individuals classification will not change and clinically significant improvement will not be deemed to have occurred 6. This is a problematic interpretation as these changes may well have had important functional consequences for the individual that underwent assessment, and thus it is important to employ raw clinical judgement 6.Caution also needs to be applied to the interpretation of statistically reliable change, to avoid the implication that it represents real change. In reality, the observed change may instead reflect measurement error 6. Statistically implicationful differences may also be a common occurrence within a particular population 7, but these a re not necessarily clinically significant differences. Whilst neuropsychological test interpretation must consider, amongst other things, base rates of expected differences and abnormalities, the number of measures in a battery must also be taken into account, as abnormal performance on a proportion of subtests within a battery should be regarded as psychometrically normal 4.A number of methods for numeration of reliable change have been proposed, adopted and further modified. These methods are usually given the designation of trustworthy Change Index (RCI), and are used to estimate the effect of error variance on test score accuracy 6. The value of the RCI is used to indicate the probability of the difference between two observed scores being the result of measurement error, and thus if the resulting probability is low, the difference is likely due to factors outside to the test itself 1.The notion of reliable change originated in classical test theory, with the standard error o f the difference used as the criterion for determining whether an observed difference is credible under the null possibility of no real change 8. However, the original, unmodified classical approach assumes that there are no practice effects. Certain subsequent variations of this approach have aimed to account for practice effects, in one of two ways. either by a simple adaptation of the Jacobson and Truax approach (a widely used, simplified version of the classical approach, called the JT index), or via estimation of true change by using a regression equation, with the latter method being the favoured choice in this context 8. This regression-based approach does not require the test scores at from each one of the time points to have equal variance, and thus practice effects can occur 6.There are many further approaches to calculation of RCIs, with no real consensus about which method is superior and should represent the florid standard approach 8. Furthermore, whilst RCI metho ds do have a number of advantageous features, there are quench inherent limitations when considering factors such as real change that remains undetected if it falls below the RCI wand 6. Additionally, whilst reliable change methodology adjusted for practice effects has the potential to reduce measurement error and improve clinical judgement, it utilises a constant value the group mean and so does not take into account the full range of possible practise effects, nor does it traditionally account for regression to the mean, so that error estimates are not proportional to the extremities of observed changes 1. However, this methodology does at least provide a domineering and potentially empirically valid approach to assessment of real change 6. In contrast, whilst regression methods do also have their own inherent limitations, such as greater utility in larger sample sizes, these are considered less extensive than RCI methodology 1.The methods discussed thus far are primarily dis tribution-based approaches, meaning that they express observed change in a standardised format. A primary disadvantage of this theatrical role of approach is that they are purely statistical measurements which do not reveal the clinical significance of any observed change 9. Alternative approaches include the use of reference states to estimate the minimal important difference or change, which refers to the smallest change in health quality that the patient is able to perceive and that is considered clinically relevant change 3. However, these approaches have their own inherent limitations, with direct and subjective patient involvement in the change assessment process increasing the complexity of the measurement 3.As the determination of an individuals authorized cognitive functioning, as well as whether this functioning has improved or declined since prior assessment, is fundamental to the force of clinical neuropsychology, the ability to reliably determine change via compariso n of test scores is crucial 6. However, as has been outlined above, the approaches involved in this determination are varied in their efficacy, and come with inherent limitations. As such, when considering the clinical significance of test results, a patients performance needs to be interpreted contextually, taking into account relevant behavioural, medical and historical information, as psychometric variability alone is not sufficient 4. Furthermore, examination of the functional outcomes of any measured change is crucial, as this is of at least eq importance in determining whether improvement or decline has taken place 6.References1. Brooks, B.L., et al., Developments in neuropsychological assessment Refining psychometric and clinical interpretive methods. Canadian Psychology/Psychologie canadienne, 2009. 50(3) p. 196.2. Charter, R.A., Revisiting the standard errors of measurement, estimate, and prediction and their industry to test scores. Perceptual and Motor Skills, 1996. 82( 3c) p. 1139-1144.3. Rejas, J., A. Pardo, and M.. Ruiz, banner error of measurement as a valid alternative to minimally important difference for evaluating the magnitude of changes in patient-reported outcomes measures. daybook of clinical epidemiology, 2008. 61(4) p. 350-356.4. Binder, L.M., G.L. Iverson, and B.L. Brooks, To err is human unnatural neuropsychological scores and variability are common in healthy adults. Archives of Clinical Neuropsychology, 2009. 24(1) p. 31-46.5. McHugh, M.L., Standard error meaning and interpretation. Biochemia Medica, 2008. 18(1) p. 7-13.6. Perdices, M., How do you know whether your patient is getting better (or worse)? A users guide. Brain Impairment, 2005. 6(03) p. 219-226.7. Crawford, J.R., P.H. Garthwaite, and C.B. Gault, Estimating the percent of the population with abnormally low scores (or abnormally large score differences) on standardized neuropsychological test batteries a generic method with applications. Neuropsychology, 2007. 21(4) p. 419.8. Maassen, G.H., E. Bossema, and N. Brand, Reliable change and practice effects Outcomes of various indices compared. Journal of clinical and experimental neuropsychology, 2009. 31(3) p. 339-352.9. Ostelo, R.W., et al., Interpreting change scores for pain and functional status in low back pain towards international consensus regarding minimal important change. Spine, 2008. 33(1) p. 90-94.
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment