Browsing by Author "Derese, Anselme"

Now showing 1 - 5 of 5
  • Thumbnail Image
    Item
    Development of a portfolio of learning for postgraduate family medicine training in South Africa : a Delphi study
    (BioMed Central, 2012-03) Jenkins, Louis; Mash, Bob; Derese, Anselme
    Background Within the 52 health districts in South Africa, the family physician is seen as the clinical leader within a multi-professional district health team. Family physicians must be competent to meet 90% of the health needs of the communities in their districts. The eight university departments of Family Medicine have identified five unit standards, broken down into 85 training outcomes, for postgraduate training. The family medicine registrar must prove at the end of training that all the required training outcomes have been attained. District health managers must be assured that the family physician is competent to deliver the expected service. The Colleges of Medicine of South Africa (CMSA) require a portfolio to be submitted as part of the uniform assessment of all registrars applying to write the national fellowship examinations. This study aimed to achieve a consensus on the contents and principles of the first national portfolio for use in family medicine training in South Africa. Methods A workshop held at the WONCA Africa Regional Conference in 2009 explored the purpose and broad contents of the portfolio. The 85 training outcomes, ideas from the WONCA workshop, the literature, and existing portfolios in the various universities were used to develop a questionnaire that was tested for content validity by a panel of 31 experts in family medicine in South Africa, via the Delphi technique in four rounds. Eighty five content items (national learning outcomes) and 27 principles were tested. Consensus was defined as 70% agreement. For those items that the panel thought should be included, they were also asked how to provide evidence for the specific item in the portfolio, and how to assess that evidence. Results Consensus was reached on 61 of the 85 national learning outcomes. The panel recommended that 50 be assessed by the portfolio and 11 should not be. No consensus could be reached on the remaining 24 outcomes and these were also omitted from the portfolio. The panel recommended that various types of evidence be included in the portfolio. The panel supported 26 of the 27 principles, but could not reach consensus on whether the portfolio should reflect on the relationship between the supervisor and registrar. Conclusion A portfolio was developed and distributed to the eight departments of Family Medicine in South Africa, and the CMSA, to be further tested in implementation.
  • Thumbnail Image
    Item
    The national portfolio for postgraduate family medicine training in South Africa : a descriptive study of acceptability, educational impact, and usefulness for assessment
    (BioMed Central, 2013-07) Jenkins, Louis; Mash, Bob; Derese, Anselme
    Background: Since 2007 a portfolio of learning has become a requirement for assessment of postgraduate family medicine training by the Colleges of Medicine of South Africa. A uniform portfolio of learning has been developed and content validity established among the eight postgraduate programmes. The aim of this study was to investigate the portfolio’s acceptability, educational impact, and perceived usefulness for assessment of competence. Methods: Two structured questionnaires of 35 closed and open-ended questions were delivered to 53 family physician supervisors and 48 registrars who had used the portfolio. Categorical and nominal/ordinal data were analysed using simple descriptive statistics. The open-ended questions were analysed with ATLAS.ti software. Results: Half of registrars did not find the portfolio clear, practical or feasible. Workshops on portfolio use, learning, and supervision were supported, and brief dedicated time daily for reflection and writing. Most supervisors felt the portfolio reflected an accurate picture of learning, but just over half of registrars agreed. While the portfolio helped with reflection on learning, participants were less convinced about how it helped them plan further learning. Supervisors graded most rotations, suggesting understanding the summative aspect, while only 61% of registrars reflected on rotations, suggesting the formative aspects are not yet optimally utilised. Poor feedback, the need for protected academic time, and pressure of service delivery impacting negatively on learning. Conclusion: This first introduction of a national portfolio for postgraduate training in family medicine in South Africa faces challenges similar to those in other countries. Acceptability of the portfolio relates to a clear purpose and guide, flexible format with tools available in the workplace, and appreciating the changing educational environment from university-based to national assessments. The role of the supervisor in direct observations of the registrar and dedicated educational meetings, giving feedback and support, cannot be overemphasized.
  • Thumbnail Image
    Item
    The national portfolio of learning for postgraduate family medicine training in South Africa : experiences of registrars and supervisors in clinical practice
    (BioMed Central, 2013-11) Jenkins, Louis; Mash, Bob; Derese, Anselme
    Background: In South Africa the submission of a portfolio of learning has become a national requirement for assessment of family medicine training. A national portfolio has been developed, validated and implemented. The aim of this study was to explore registrars’ and supervisors’ experience regarding the portfolio’s educational impact, acceptability, and perceived usefulness for assessment of competence. Methods: Semi-structured interviews were conducted with 17 purposively selected registrars and supervisors from all eight South African training programmes. Results: The portfolio primarily had an educational impact through making explicit the expectations of registrars and supervisors in the workplace. This impact was tempered by a lack of engagement in the process by registrars and supervisors who also lacked essential skills in reflection, feedback and assessment. The acceptability of the portfolio was limited by service delivery demands, incongruence between the clinical context and educational requirements, design of the logbook and easy availability of the associated tools. The use of the portfolio for formative assessment was strongly supported and appreciated, but was not always happening and in some cases registrars had even organised peer assessment. Respondents were unclear as to how the portfolio would be used for summative assessment. Conclusions: The learning portfolio had a significant educational impact in shaping work-place based supervision and training and providing formative assessment. Its acceptability and usefulness as a learning tool should increase over time as supervisors and registrars become more competent in its use. There is a need to clarify how it will be used in summative assessment.
  • Thumbnail Image
    Item
    Reliability testing of a portfolio assessment tool for postgraduate family medicine training in South Africa
    (AOSIS Publishing, 2013-11) Jenkins, Louis; Mash, Bob; Derese, Anselme
    Background: Competency-based education and the validity and reliability of workplacebased assessment of postgraduate trainees have received increasing attention worldwide. Family medicine was recognised as a speciality in South Africa six years ago and a satisfactory portfolio of learning is a prerequisite to sit the national exit exam. A massive scaling up of the number of family physicians is needed in order to meet the health needs of the country. Aim: The aim of this study was to develop a reliable, robust and feasible portfolio assessment tool (PAT) for South Africa. Methods: Six raters each rated nine portfolios from the Stellenbosch University programme, using the PAT, to test for inter-rater reliability. This rating was repeated three months later to determine test–retest reliability. Following initial analysis and feedback the PAT was modified and the inter-rater reliability again assessed on nine new portfolios. An acceptable intra-class correlation was considered to be > 0.80. Results: The total score was found to be reliable, with a coefficient of 0.92. For test–retest reliability, the difference in mean total score was 1.7%, which was not statistically significant. Amongst the subsections, only assessment of the educational meetings and the logbook showed reliability coefficients > 0.80. Conclusion: This was the first attempt to develop a reliable, robust and feasible national portfolio assessment tool to assess postgraduate family medicine training in the South African context. The tool was reliable for the total score, but the low reliability of several sections in the PAT helped us to develop 12 recommendations regarding the use of the portfolio, the design of the PAT and the training of raters.
  • Thumbnail Image
    Item
    The views of key leaders in South Africa on implementation of family medicine : critical role in the district health system
    (BioMed Central, 2014-06) Moosa, Shabir; Mash, Bob; Derese, Anselme; Peersman, Wim
    Background: Integrated team-based primary care is an international imperative. This is required more so in Africa, where fragmented verticalised care dominates. South Africa is trying to address this with health reforms, including Primary Health Care Re-engineering. Family physicians are already contributing to primary care despite family medicine being only fully registered as a full specialty in South Africa in 2008. However the views of leaders on family medicine and the role of family physicians is not clear, especially with recent health reforms. The aim of this study was to understand the views of key government and academic leaders in South Africa on family medicine, roles of family physicians and human resource issues. Methods This was a qualitative study with academic and government leaders across South Africa. In-depth interviews were conducted with sixteen purposively selected leaders using an interview guide. Thematic content analysis was based on the framework method. Results Whilst family physicians were seen as critical to the district health system there was ambivalence on their leadership role and ‘specialist’ status. National health reforms were creating both threats and opportunities for family medicine. Three key roles for family physicians emerged: supporting referrals; clinical governance/quality improvement; and providing support to community-oriented care. Respondents’ urged family physicians to consolidate the development and training of family physicians, and shape human resource policy to include family physicians. Conclusions Family physicians were seen as critical to the district health system in South Africa despite difficulties around their precise role. Whilst their role was dominated by filling gaps at district hospitals to reduce referrals it extended to clinical governance and developing community-oriented primary care - a tall order, requiring strong teamwork. Innovative team-based service delivery is possible despite human resource challenges, but requires family physicians to proactively develop team-based models of care, reform education and advocate for clearer policy, based on the views of these respondents.