toggle menu
toggle menu
MSF/360°
Groundbreaking research projects for recognized authorities
MSF/360 Research
Our engagement in MSF programs began in 1999 with the ground-breaking PAR program created by the College of Physicians and Surgeons of Alberta (CPSA). The tools (instruments or questionnaires) were developed by research staff from the University of Calgary (UofC), while day-to-day administration was contracted to Pivotal Research.
Today, Pivotal Research administers MSF projects for several Colleges of Physicians and Surgeons; the Royal College of Physicians and Surgeons of Canada, and member hospitals of the Council of Academic Hospitals of Ontario, who opted to participate in the program. In addition, we work with regulatory authorities and professional member associations in nursing and dentistry.
And aside from the administration of MSF programs, we are engaged in several research and development (R&D) projects to enhance our clients' programs.
Researchers from other universities, such as the University of Calgary, University of British Columbia and Dalhousie University also contributed to the research pool following the adoption of PAR tools in their corresponding province.
Resources
Academic Papers
- Factors influencing the effectiveness of multisource feedback in improving the professional practice of medical doctors: a systematic review. BMC Medical Education 2014
- Assessment of physician performance in Alberta: the physician achievement review. Hall W, et al CMAJ 1999 Jul 13;161(1):52-7
- Changing physicians’ practices: the effect of individual feedback. Fidler H, et al. Academic Medicine 74: 702-714 (1999)
- Violato C, Marini A, Toews J, Lockyer J, and Fidler H, Feasibility and Psychometric Properties of Using Peers, Consulting Physicians, Co-workers, and Patients to Assess Physicians, Academic Medicine, 1997 (supplement); 72 S82-S84
- Fidler H, Lockyer J, Toews J, and Violato C, Changing Physicians’ Practices: The Effect of Individual Feedback, Academic Medicine, 1999; 74: 702-714.
- Hall W, Violato C, Lewkonia, R, Lockyer J, Fidler H, Toews J, Jennett P, Donoff M, Moores D, Assessment of physician performance in Alberta: the Physician Achievement Review Project, Canadian Medical Association Journal, 1999; 161:52-57. Abstract Full text
- Dissertation Lockyer J, Ph.D. Dissertation: Role of Socio Demographic Variables and Continuing Medical Education in Explaining Multi Source Feedback Ratings and Use of Feedback by Physicians. University of Calgary, 2002.
- Violato, C, Lockyer, JM, Fidler H, Multi source feedback: A method of assessing surgical practice, British Medical Journal, 2003; 326: 546-548.
- Lockyer, J, Violato C, Fidler H, Likelihood of Change: A study assessing surgeon use of multi source feedback data. Teaching and Learning in Medicine, 2003; 15: 168-174.
- Lockyer J, Multi source feedback in the assessment of physician competencies. Journal of Continuing Education in the Health Professions, 2003; 23(1): 23: 4-12.
- Lockyer J, Violato C, An examination of the appropriateness of using a common peer assessment instrument to assess physician skills across specialties, Academic Medicine 2004; 10 (suppl): In Press.
- Nova Scotia PAR Sargeant JM, Mann KV, Ferrier SN, Langille DB, Muirhead PD, Sinclair DE. Responses of rural family physicians and their colleagues and coworker raters to a multi-source feedback process: a pilot study. Academic Medicine, 2003: 78 (S10): S42-S44.
- Lockyer J, Violato C, An examination of the appropriateness of using a common peer assessment instrument to assess physician skills across specialties, Academic Medicine 2004; 10 (supplement): S5 – 8. Due to copyright issues, the article cannot be copied.
- Lockyer JM, Violato C, Fidler H, A multisource feedback program for anesthesiologists, Can J of Anesthesia, 2006, 53:33-39
- Violato C, Lockyer JM, Fidler H, the Assessment of pediatricians by a regulatory authority, Pediatrics, 2006, 117: 796 – 802
- Violato C, Lockyer J, Self and peer assessment of pediatricians, psychiatrists and medicine specialists: Implications for self-directed learning, Advances in Health Science Education, 2006, 11:235-244
- Lockyer J, Blackmore D, Fidler H, Crutcher R, Salte B, Shaw K, Ward B, Wolfish N, A study of a multi source feedback system for international medical graduates holding defined licenses, Medical Education 2006; 40: 340-347.
- Lockyer JM, Violato C, Fidler H, The assessment of emergency physicians by a regulatory authority. Academic Emergency Medicine, 2006. 13(12):1296-303
- Lockyer J, Violato C, Fidler H, What multi source feedback factors influence physician self assessments? A five year longitudinal study, Acad Med 2007, 82(10S): 77 – 80
- Lockyer J, Violato C, Fidler H, The assessment of radiologists through a multi source feedback tool, Radiology 2008, In Press.
- Sargeant J, Mann K, Ferrier S. Understanding family physicians reactions to MSF performance assessment: perceptions of credibility and usefulness. Med Educ, 2005. 39:497-504
- Sargeant J, Mann K, Sinclair D, Ferrier S, Muirhead P, van der Vleuten C, Metsemakers J Learning in practice: Experiences and perceptions of high scoring physicians, Acad Med 2006, 81(7):655-660
- Sargeant J, Mann K, Sinclair D, van der Vleuten C, Metsemakers J, Understanding the influence of emotions and reflection upon multi-source feedback acceptance and use, Adv in Health Sci Educ 2006, 10.1007/s10459-006-9039-x
- Sargeant J, Mann K, Sinclair D, van der Vleuten C, Metsemakers J,Challenges in multi source feedback: Intended and unintended consequences, Medical Education 2007, 41(6):581-596
- Violato C, Lockyer J, Fidler H, The assessment of psychiatrists in practice through multi source feedback, Canadian Journal of Psychiatry 2008, In Press.
- Lockyer J, Violato C, Wright B, Fidler H, Chan R, Long-term outcomes for surgeons from 3- and 4- year medical school curricula, Can J Surg, Vol. 55, (4 Suppl.2) August 2012.
Citations by Other Researchers
- Evans R, Elwyn G, Edwards A, Review of instruments for peer assessment of physicians, BMJ 2004; 328: 1240-1245
- Finucane, Paul M, Bourgeoise-Law, Gisèle A, Ineson, Sue L, and Kaigas, Tina M, A Comparison of Performance Assessment Programs for Medical Practitioners in Canada, Australia, New Zealand, and the United Kingdom. Academic Medicine 2003; 78(8):837-842.
- Melnick, D.E., Asch, D.A., Blackmore, D.E., Klass, D.J., and Norcini, J.J., Conceptual challenges in tailoring physician performance assessment to individual practice. Medical Education 2002; 36:931-935.
- Cohen, R, Amiel, G.E., Tann, M., Schechter, A., Weingarten, M., and Reis, S., Performance Assessment of Community-based Physicians: Evaluating the Reliability and Validity of a Tool for Determining CME Needs. Academic Medicine, 2002; 77(12): 1247-1254.
- Dauphinee, W.D., Revalidation of Doctors in Canada. British Medical Journal, 1999; 319(7218): 1188-119
Background on Peer Review and Support
- Physician-assessment and physician-enhancement programs in Canada. Page G et al CMAJ. 1995 ,153:1723-
- A longitudinal study of performance of physicians’ office practices: data from the Peer Assessment Program in Ontario, Canada. Norton PG et al Jt Comm J Qual Improv. 1999 25:252-8
- Feasibility of Physician Peer Assessment in an Academic Health Sciences Centre
- Family physician practice visits arising from the Alberta Physician Achievement Review. Ray Lewkonia et al BMC Medical Education 2013, 13:121