Primary Care Research Team Assessment (PCRTA): development and evaluation.
Carter YH., Shaw S., Macfarlane F.
BACKGROUND: Since the early 1990s the United Kingdom (UK) Department of Health has explicitly promoted a research and development (R&D) strategy for the National Health Service (NHS). General practitioners (GPs) and other members of the primary care team are in a unique position to undertake research activity that will complement and inform the research undertaken by basic scientists and hospital-based colleagues and lead directly to a better evidence base for decision making by primary care professionals. Opportunities to engage in R&D in primary care are growing and the scope for those wishing to become involved is finally widening. Infrastructure funding for research-active practices and the establishment of a range of support networks have helped to improve the research capacity and blur some of the boundaries between academic departments and clinical practice. This is leading to a supportive environment for primary care research. There is thus a need to develop and validate nationally accepted quality standards and accreditation of performance to ensure that funders, collaborators and primary care professionals can deliver high quality primary care research. Several strategies have been described in national policy documents in order to achieve an improvement in teaching and clinical care, as well as enhancing research capacity in primary care. The development of both research practices and primary care research networks has been recognised as having an important contribution to make in enabling health professionals to devote more protected time to undertake research methods training and to undertake research in a service setting. The recognition and development of primary care research has also brought with it an emphasis on quality and standards, including an approach to the new research governance framework. PRIMARY CARE RESEARCH TEAM ASSESSMENT: In 1998, the NHS Executive South and West, and later the London Research and Development Directorate, provided funding for a pilot project based at the Royal College of General Practitioners (RCGP) to develop a scheme to accredit UK general practices undertaking primary care R&D. The pilot began with initial consultation on the development of the process, as well as the standards and criteria for assessment. The resulting assessment schedule allowed for assessment at one of two levels: Collaborative Research Practice (Level I), with little direct experience of gaining project or infrastructure funding Established Research Practice (Level II), with more experience of research funding and activity and a sound infrastructure to allow for growth in capacity. The process for assessment of practices involved the assessment of written documentation, followed by a half-day assessment visit by a multidisciplinary team of three assessors. IMPLEMENTATION--THE PILOT PROJECT: Pilot practices were sampled in two regions. Firstly, in the NHS Executive South West Region, where over 150 practices expressed an interest in participating. From these a purposive sample of 21 practices was selected, providing a range of research and service activity. A further seven practices were identified and included within the project through the East London and Essex Network of Researchers (ELENoR). Many in this latter group received funding and administrative support and advice from ELENoR in order to prepare written submissions for assessment. Some sample loss was encountered within the pilot project, which was attributable largely to conflicting demands on participants' time. Indeed, the preparation of written submissions within the South West coincided with the introduction of primary care groups (PCGs) in April 1999, which several practices cited as having a major impact on their participation in the pilot project. A final sample of 15 practices (nine in the South West and six through ELENoR) underwent assessment through the pilot project. EVALUATION: A formal evaluation of the Primary Care Research Team Assessment (PCRTA) pilot was undertaken by an independent researcher (FM). This was supplemented with feedback from the assessment team members. The qualitative aspect of the evaluation, which included face-to-face and telephone interviews with assessors, lead researchers and other practice staff within the pilot research practices, as well as members of the project management group, demonstrated a positive view of the pilot scheme. Several key areas were identified in relation to particular strengths of research practices and areas for development including: Strengths Level II practices were found to have a strong primary care team ethos in research. Level II practices tended to have a greater degree of strategic thinking in relation to research. Development areas Level I practices were found to lack a clear and explicit research strategy. Practices at both levels had scope to develop their communication processes for dissemination of research and also for patient involvement. Practices at both levels needed mechanisms for supporting professional development in research methodology. The evaluation demonstrated that practices felt that they had gained from their participation and assessors felt that the scheme had worked well. Some specific issues were raised by different respondents within the qualitative evaluation relating to consistency of interpretation of standards and also the possible overlap of the assessment scheme with other RCGP quality initiatives. NATIONAL IMPLEMENTATION OF THE PRIMARY CARE RESEARCH TEAM ASSESSMENT: The pilot project has been very successful and recommendations have been made to progress to a UK scheme. Management and review of the scheme will remain largely the same, with a few changes focusing on the assessment process and support for practices entering the scheme. Specific changes include: development of the support and mentoring role of the primary care research networks increased peer and external support and mentoring for research practices undergoing assessment development of assessor training in line with other schemes within the RCGP Assessment Network work to ensure consistency across RCGP accreditation schemes in relation to key criteria, thereby facilitating comparable assessment processes refinement of the definition of the two groups, with Level I practices referred to as Collaborators and Level II practices as Investigator-Led. The project has continued to generate much enthusiasm and support and continues to reflect current policy. Indeed, recent developments include the proposed new funding arrangements for primary care R&D, which refer to the RCGP assessment scheme and recognise it as a key component in the future R&D agenda. The assessment scheme will help primary care trusts (PCTs) and individual practices to prepare and demonstrate their approach to research governance in a systematic way. It will also provide a more explicit avenue for primary care trusts to explore local service and development priorities identified within health improvement programmes and the research priorities set nationally for the NHS.