Issues in developing valid assessments of speech pathology students' performance in the workplace

dc.contributor.author McAllister, Sue Margery
dc.contributor.author Ferguson, Alison
dc.contributor.author Lincoln, Michelle
dc.contributor.author McAllister, Lindy
dc.date.accessioned 2014-09-30T06:12:36Z
dc.date.available 2014-09-30T06:12:36Z
dc.date.issued 2010 en_US
dc.description This is the peer reviewed version of the following article: [McAllister, S.M., Lincoln, M., Ferguson, A. and McAllister, L. (2010). Issues in developing valid assessments of speech pathology students' performance in the workplace. International Journal of Language and Communication Disorders, 45(1) pp. 1-14.], which has been published in final form at DOI:10.3109/13682820902745461. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Self-Archiving (http://olabout.wiley.com/WileyCDA/Section/id-820227.html#terms) en
dc.description.abstract Abstract Background Workplace based learning is a critical component of professional preparation in speech pathology. A validated assessment of this learning is seen to be ‘the gold standard’ but it is difficult to develop because of design and validation issues. These issues include the role and nature of judgement in assessment, challenges in measuring quality, and the relationship between assessment and learning. Valid assessment of workplace based performance needs to capture the development of competence over time and account for both occupation specific and generic competencies. Aims This paper reviews important conceptual issues in the design of valid and reliable workplace based assessments of competence including assessment content, process, impact on learning, measurement issues and validation strategies. The paper then goes on to share what has been learned about quality assessment and validation of a workplace based performance assessment using competency based ratings. The outcomes of a 4 year national development and validation of an assessment tool are described. Methods A literature review of issues in conceptualising, designing and validating workplace based assessments was conducted. Key factors to consider in the design of a new tool were identified and built into the cycle of design, trialling and data analysis in the validation stages of the development process. Main contribution This paper provides an accessible overview of factors to consider in the design and validation of workplace based assessment tools. It presents strategies used in the development and national validation of a tool COMPASS™, used in every speech pathology program in Australia, New Zealand and Singapore. The paper also describes Rasch analysis, a model based statistical approach which is useful for establishing validity and reliability of assessment tools. Conclusions Through careful attention to conceptual and design issues in the development and trialling of workplace based assessments, it has been possible to develop the world’s first valid and reliable national assessment tool for assessment of performance in speech pathology. en
dc.identifier.citation McAllister, S.M., Lincoln, M., Ferguson, A. and McAllister, L. (2010). Issues in developing valid assessments of speech pathology students' performance in the workplace. International Journal of Language and Communication Disorders, 45(1) pp. 1-14. en
dc.identifier.doi https://doi.org/10.3109/13682820902745461 en
dc.identifier.issn 1368-2822
dc.identifier.rmid 2006016117
dc.identifier.uri http://hdl.handle.net/2328/33351
dc.identifier.uri http://informahealthcare.com/doi/abs/10.3109/13682820902745461
dc.language.iso en
dc.publisher Wiley en
dc.rights © 2010 Royal College of Speech & Language Therapists en
dc.rights.holder Royal College of Speech & Language Therapists en
dc.rights.license In Copyright
dc.subject.forgroup 1199 Other Medical and Health Sciences en
dc.title Issues in developing valid assessments of speech pathology students' performance in the workplace en
dc.type Article en
local.contributor.authorOrcidLookup McAllister, Sue Margery: https://orcid.org/0000-0003-1597-0563 en_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
McAllister_Issues_AM2010.pdf
Size:
702.38 KB
Format:
Adobe Portable Document Format
Description:
Author Version