Reliability testing of a portfolio assessment tool for postgraduate family medicine training in South Africa

Simple item page
dc.contributor.authorJenkins, Louisen_ZA
dc.contributor.authorMash, Boben_ZA
dc.contributor.authorDerese, Anselmeen_ZA
dc.date.accessioned2015-03-11T10:43:33Z
dc.date.available2015-03-11T10:43:33Z
dc.date.issued2013-11
dc.descriptionCITATION: Jenkins, L., Mash, B. & Derese, A. 2013. Reliability testing of a portfolio assessment tool for postgraduate family medicine training in South Africa. African Journal of Primary Health Care & Family Medicine, 5(1): 1-9, doi: 10.4102/phcfm.v5i1.577.
dc.descriptionThe original publication is available at http://www.phcfm.org
dc.description.abstractBackground: Competency-based education and the validity and reliability of workplacebased assessment of postgraduate trainees have received increasing attention worldwide. Family medicine was recognised as a speciality in South Africa six years ago and a satisfactory portfolio of learning is a prerequisite to sit the national exit exam. A massive scaling up of the number of family physicians is needed in order to meet the health needs of the country. Aim: The aim of this study was to develop a reliable, robust and feasible portfolio assessment tool (PAT) for South Africa. Methods: Six raters each rated nine portfolios from the Stellenbosch University programme, using the PAT, to test for inter-rater reliability. This rating was repeated three months later to determine test–retest reliability. Following initial analysis and feedback the PAT was modified and the inter-rater reliability again assessed on nine new portfolios. An acceptable intra-class correlation was considered to be > 0.80. Results: The total score was found to be reliable, with a coefficient of 0.92. For test–retest reliability, the difference in mean total score was 1.7%, which was not statistically significant. Amongst the subsections, only assessment of the educational meetings and the logbook showed reliability coefficients > 0.80. Conclusion: This was the first attempt to develop a reliable, robust and feasible national portfolio assessment tool to assess postgraduate family medicine training in the South African context. The tool was reliable for the total score, but the low reliability of several sections in the PAT helped us to develop 12 recommendations regarding the use of the portfolio, the design of the PAT and the training of raters.en_ZA
dc.description.urihttp://www.phcfm.org/index.php/phcfm/article/view/577
dc.format.extent9 pages
dc.identifier.citationJenkins, L., Mash, B. & Derese, A. 2013. Reliability testing of a portfolio assessment tool for postgraduate family medicine training in South Africa. African Journal of Primary Health Care & Family Medicine, 5(1): 1-9, doi: 10.4102/phcfm.v5i1.577
dc.identifier.issn2071-2936 (online)
dc.identifier.issn2071-2928 (print)
dc.identifier.otherdoi: 10.4102/phcfm.v5i1.577
dc.identifier.urihttp://hdl.handle.net/10019.1/96262
dc.language.isoen_ZAen
dc.publisherAOSIS Publishing
dc.rights.holderAuthors retain copyright
dc.subjectAccelerated life testing -- South Africaen_ZA
dc.subjectPortfolios in education -- Evaluation -- South Africaen_ZA
dc.subjectPortfolio assessment tool -- Evaluation -- South Africaen_ZA
dc.subjectFamily medicine -- Study and teaching -- South Africaen_ZA
dc.titleReliability testing of a portfolio assessment tool for postgraduate family medicine training in South Africaen_ZA
dc.typeArticleen
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
jenkins_reliability_2013.pdf
Size:
468.54 KB
Format:
Adobe Portable Document Format
Description:
Download article
Download
License bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
license.txt
Size:
1.95 KB
Format:
Item-specific license agreed upon to submission
Description:
Download
Collections
Research Articles (Family Medicine and Primary Care)