MENUCLOSE

 

Connect with us

Author: Brian S McGowan, PhD

“How Great is The Impact of ArcheMedX-Powered Education?”

Answer: ArcheMedX-powered education has consistently and repeatedly allowed our Educational Partners (AcademicCME, Elsevier, ACEhp and others) to achieve the learning outcomes that they planned to achieve – and, in the process, they are learning far more about their content and learners.

Level 1 = Participation:

ArcheMedX-powered education and the Learning Actions Model drive learners to participate at significantly higher rates and to complete lessons powered by ArcheMedX at three times the national average for online learning.

Learner Completion Rate Samples_Med

We also track much more than traditional lesson starts and completions, and the new types of data captured through the ArcheViewer allow partners to explore deeper layers of learner participation as measured by the notes taken, reminders set, questions asked, and resources viewed, downloaded, or shared. Partners can then rapidly apply these insights to drive increased  ‘real’ participation in both primary and secondary educational content.

  • Within 6 weeks of launching one recent initiative, learners had taken and set hundreds of notes and reminders and reviewed and downloaded nearly 500 key resources (i.e., journal articles, clinical studies, patient education tools) that Faculty and Planners had collated and connected to the primary learning experience.

 Learning Actions Case Study 1

Level 2 = Satisfaction:

By engaging learners in new models of learning, ArcheMedX-powered education shifts the expectation from a passive to active mindset. No longer are learners left to passively absorb online content – even content traditionally viewed as being didactic. Instead learners are supported by Faculty-engineered learning moments (Educator Notes, Cue Points, and In-Lesson Polling) and the learner-centric tools provided through the architecture simplify the act of learning and produce overwhelmingly positive learner sentiment.

  • Nearly 100% of participants in one recent large initiative found the new educational model to be “Effective” or “Extremely Effective” despite it being their first time participating in ‘active’ online learning. And, nearly 100% of participants believed that ArcheMedX-powered education would be a more efficient way for their colleagues to learn!
  • And it is not just learners who express their satisfaction, as one Educational Partner said, “Having seen what ArcheMedX-powered education can do, I will never go back to producing online education any other way!

Please Rate Following Elements of Initiative

Level 3 = Learning:

By “structuring” the learning experience using the ArcheViewer, Faculty and Planners have far greater and more dynamic control over learning, learning moments, and retention. This allows for lesson plans to have robust and sustained effects and allows for activities themselves to be refined to ensure they have the desired impact over time.

  • When compared to a control group of demographically matched learners, participants of ArcheMedX-powered lessons answered a range of questions across a variety of key learning objectives with 3-fold, 4-fold and even 7-fold greater accuracy.
  • In another initiative designed to better assess learning change over time, learning was meaningful and significant (p = 5.39 x 10-12) in paired analysis inclusive of both declarative and procedural domains. Additional studies are ongoing to explore just how sustained these learning changes are and what educational design variables positively impact these changes.

Average Grade at Assessment with Pvalues

Level 4 = Competence:

The In-Lesson Polling functionality of ArcheMedX-powered education, along with the integration of sophisticated case-based content types, allows Faculty and Planners to assess changes in competence (and learning…and even performance) in near real-time.

  • After participating in a series of ArcheMedX-powered CE activities nearly 50% of learners reported that they were now more comfortable applying the content matter in practice, or were expressly ready to make a change in practice.

 Change in Competence

Level 5: Performance:

In an evaluation of learner behavior (performance) timed for several weeks after learners participated in a series of ArcheMedX-powered CE activities, learners were nearly twice as likely to report having applied changes in practice!

 How Often Have You Applied Changes

Level 6 and 7: Patient- and Population-level Health Outcomes:

While changes seen in learner participation (and how it’s defined), satisfaction, learning, competence, and performance are consistently meaningful and significant for our Partners, these are just the beginning. We are now working with Partners through the US to leverage our learning models and e-learning solutions to drive AND measure changes in patient and population health outcomes.

Over the coming months we will be exploring the impact of ArcheMedX-powered education on a variety of chronic disease conditions that are largely under-managed and overlooked in the primary care setting – and therefore lead to significant and unnecessary burden on our nation’s emergency room system. These studies are intended to fundamentally transform how we describe and explore the value of CE and the CE profession in healthcare improvement.

 —

6-pager figure screen shot

In short (and to answer the question I get asked all the time), ArcheMedX-powered education has consistently and repeatedly allowed our Educational Partners to achieve, and even exceed, the learning outcomes that they planned to achieve – and, in the process, they are learning far more about their content and learners.

Having found such great success supporting our existing Partners our goal is to share these lessons with the broader medical education community and to begin to leverage these models and solutions to accelerate change in training and lifelong learning in the health professions – to do so we have designed a downloadable report that you may want to explore with your internal teams or colleagues. In the end, we believe that this 5-page overview might support your educational planning or grant proposals.

If we can answer any additional questions about these data, please do not hesitate to ask!

Best wishes,

Brian

ABSTRACT: Identification of knowledge gaps in neurosurgery using a validated self-assessment examination

OBJECTIVE:
The practice of neurosurgery requires fundamental knowledge base. Residency training programs and continuing medical education courses are designed to teach relevant neurosurgical principles. Nevertheless, knowledge gaps exist for neurosurgeons and may be different between cohorts of neurosurgeons. The Self-Assessment in Neurological Surgery (SANS) General Examination and Spine Examination are online educational tools for lifelong learning and maintenance of certification. This study examines the gaps in knowledge of spinal neurosurgeons and general neurosurgeons taking SANS.
METHODS:
From 2008 to 2010, a total of 165 spinal neurosurgeons completed the 243 available questions of the SANS Spine Examination. Over that same time frame, 993 general neurosurgeons completed the SANS General Spine Examination. Mean scores were calculated and assessed according to 18 major neurosurgical knowledge disciplines. Statistical analysis was carried out to evaluate for significant knowledge gaps among all users and significant differences in performance between spinal neurosurgeons and their general neurosurgeon counterparts.
RESULTS:
The mean overall examination score was 87.4% ± 7.5% for spinal neurosurgeons and 71.5% ± 8.9% for general neurosurgeons (P < 0.001). Of the 18 major knowledge categories in SANS, spinal neurosurgeons (n = 165) answered questions incorrectly 15% or greater of the time in five of the categories. The categories of lower performance for spinal neurosurgeons were cerebrovascular, anesthesia and critical care, general clinical, tumor, and trauma. For general neurosurgeons (n = 993), the five knowledge categories with lowest performance were cerebrovascular, epilepsy, peripheral nerve, trauma, and radiosurgery. Although spinal neurosurgeons and general neurosurgeons shared some areas of decreased performance including trauma and cerebrovascular, spine neurosurgeons relatively underperformed in general clinical, anesthesia and critical care, and tumor.
CONCLUSIONS:
The SANS Spine Examination demonstrated knowledge gaps in specific categories for spinal surgeons. The knowledge areas of diminished performance differed between spinal and general neurosurgeons. Identification of specific areas of deficiency could prove useful in the design and implementation of educational programs and maintenance of certification.

via Identification of knowledge gaps in neurosur… [World Neurosurg. 2013] – PubMed – NCBI.

ABSTRACT: A scoping review of undergraduate ambulatory care education

BACKGROUND:
Since a disproportionate amount of medical education still occurs in hospitals, there are concerns that medical school graduates are not fully prepared to deliver efficient and effective care in ambulatory settings to increasingly complex patients.
AIMS:
To understand the current extent of scholarship in this area.
METHOD:
A scoping review was conducted by searching electronic databases and grey literature sources for articles published between 2001 and 2011 that identified key challenges and models of practice for undergraduate teaching of ambulatory care. Relevant articles were charted and assigned key descriptors, which were mapped onto Canadian recommendations for the future of undergraduate medical education.
RESULTS:
Most of the relevant articles originated in the United States, Australia, or the United Kingdom. Recommendations related to faculty development, learning contexts and addressing community needs had numerous areas of scholarly activity while scholarly activity was lacking for recommendations related to inter-professional practice, the use of technology, preventive medicine, and medical leadership.
CONCLUSIONS:
Systems should be established to support education and research collaboration between medical schools to develop best practices and build capacity for change. This method of scoping the field can be applied using best practices and recommendations in other countries.

via A scoping review of undergraduate ambulatory care … [Med Teach. 2013] – PubMed – NCBI.

ABSTRACT: A global model for effective use and evaluation of e-learning in health

Healthcare systems worldwide face a wide range of challenges, including demographic change, rising drug and medical technology costs, and persistent and widening health inequalities both within and between countries. Simultaneously, issues such as professional silos, static medical curricula, and perceptions of “information overload” have made it difficult for medical training and continued professional development (CPD) to adapt to the changing needs of healthcare professionals in increasingly patient-centered, collaborative, and/or remote delivery contexts. In response to these challenges, increasing numbers of medical education and CPD programs have adopted e-learning approaches, which have been shown to provide flexible, low-cost, user-centered, and easily updated learning. The effectiveness of e-learning varies from context to context, however, and has also been shown to make considerable demands on users’ motivation and “digital literacy” and on providing institutions. Consequently, there is a need to evaluate the effectiveness of e-learning in healthcare as part of ongoing quality improvement efforts. This article outlines the key issues for developing successful models for analyzing e-health learning.

via A global model for effective use and eval… [Telemed J E Health. 2013] – PubMed – NCBI.

ABSTRACT: Promoting health behaviours in medical education

BACKGROUND:
In light of the global trends of increasing obesity, the education of doctors and other health professionals warrants greater attention to promoting effective weight management through health behaviours related to eating and exercise.
CONTEXT:
Gaps in training in these areas have been identified related to weight management and wellness. Diverse benefits of healthy lifestyle interventions have been noted.
INNOVATION:
Recommendation for developing immersion programmes for medical students and other health professionals involving practical experience in weight management through lifestyle modification, addressing nutritional and caloric intake and energy expenditure through exercise.
IMPLICATIONS:
Integrating healthy lifestyle programmes into medical and health professional education could yield several benefits. Enhancing curriculum and educational processes by promoting medical and health professional students’ awareness of, participation and immersion in, healthy lifestyle interventions may ultimately lead to better health outcomes for health professionals and their patients.

via Promoting health behaviours in medical education. [Clin Teach. 2013] – PubMed – NCBI.

ABSTRACT: Faculty development activities in family medicine: in search of innovation

OBJECTIVE:
To describe the Accreditation Council for Graduate Medical Education’s (ACGME) faculty development requirements, explore the range of faculty development activities and support currently used by family medicine residencies to meet these requirements, and describe one innovative approach to satisfy this need.
METHOD:
An electronic survey of faculty development activities and support offered to faculty by residency programs was sent to a random sample of 40 medical school and community based family medicine residency programs across the United States. Data were examined using t-tests, Fisher’s exact tests, and Analysis of Variance.
RESULTS:
Faculty development, beyond traditional clinical CME, was strongly encouraged or required by a large proportion of the sample (73%). Only 58% of programs reported having discussed the ACGME’s faculty development component areas (clinical, educational, administrative, leadership, research, and behavioral). In each component area except the “clinical” area, the absence of discussing the ACGME component areas with residency faculty was associated with fewer faculty development activities and support being offered by the program.
CONCLUSIONS:
These results, although preliminary, suggest that family medicine residency programs may value and encourage faculty development. The majority of programs use traditional activities and strategies such as CME, faculty meetings, faculty conferences and workshops; and a smaller number of programs are exploring the utility of mentoring programs, faculty discussion groups, and technology based learning systems. The challenge is to develop faculty development activities tailored to individual program and faculty needs and resources

via Faculty development activities in famil… [Int J Psychiatry Med. 2013] – PubMed – NCBI.

MANUSCRIPT: Transparency in medical error disclosure: the need for formal teaching in undergraduate medical education curriculum

As ‘practice makes perfect’, we believe that the incorporation of formal teaching of transparent medical error disclosure in medical curricula is greatly needed. Medical schools play central roles in cultivating the significance and developing the communication skills needed for proficient and effective medical error disclosure. Moreover, they play key roles in resolving all barriers that may hinder transparency and full disclosure of medical errors. Such an approach is expected to educate a safe physician workforce where intrinsic drives and capabilities to remain transparent at all times – regardless of consequences – will serve as the basis for enhancing patient–doctor relationships, limiting further harm and improving overall healthcare safety

via Transparency in medical error disclosure: the need for formal teaching in undergraduate medical education curriculum.

MANUSCRIPT: New frontiers in medical education: simulation technology at Campbell University School of Osteopathic Medicine

Campbell University School of Osteopathic Medicine is using a variety of medical simulation systems in the training of its medical students. The simulators allow students to learn and practice skills in a controlled environment, and they enable faculty to challenge students with a broader range of conditions than might ordinarily be encountered during medical training.

via New frontiers in medical education: simula… [N C Med J. 2014 Jan-Feb] – PubMed – NCBI.

ABSTRACT: A novel approach to needs assessment in curriculum development: Going beyond consensus methods

Background: Needs assessment should be the starting point for curriculum development. In medical education, expert opinion and consensus methods are commonly employed. Aim: This paper showcases a more practice-grounded needs assessment approach. Methods: A mixed-methods approach, incorporating a national survey, practice audit, and expert consensus, was developed and piloted in thrombosis medicine; Phase 1: National survey of practicing consultants, Phase 2: Practice audit of consult service at a large academic centre and Phase 3: Focus group and modified Delphi techniques vetting Phase 1 and 2 findings. Results: Phase 1 provided information on active curricula, training and practice patterns of consultants, and volume and variety of thrombosis consults. Phase 2’s practice audit provided empirical data on the characteristics of thrombosis consults and their associated learning issues. Phase 3 generated consensus on a final curricular topic list and explored issues regarding curriculum delivery and accreditation. Conclusions: This approach offered a means of validating expert and consensus derived curricular content by incorporating a novel practice audit. By using this approach we were able to identify gaps in training programs and barriers to curriculum development. This approach to curriculum development can be applied to other postgraduate programs.

via A novel approach to needs assessment in curriculum… [Med Teach. 2014] – PubMed – NCBI.

ABSTRACT: Internal medicine rounding practices and the accreditation council for graduate medical education core competencies

BACKGROUND:
The Accreditation Council for Graduate Medical Education (ACGME) has established the requirement for residency programs to assess trainees’ competencies in 6 core domains (patient care, medical knowledge, practice-based learning, interpersonal skills, professionalism, and systems-based practice). As attending rounds serve as a primary means for educating trainees at academic medical centers, our study aimed to identify current rounding practices and attending physician perceived capacity of different rounding models to promote teaching within the ACGME core competencies.
METHODS:
We disseminated a 24-question survey electronically using educational and hospital medicine leadership mailing lists. We assessed attending physician demographics and the frequency with which they used various rounding models, as defined by the location of the discussion of the patient and care plan: bedside rounds (BR), hallway rounds (HR), and card-flipping rounds (CFR). Using the ACGME framework, we assessed the perceived educational value of each model.
RESULTS:
We received 153 completed surveys from attending physicians representing 34 institutions. HR was used most frequently for both new and established patients (61% and 43%), followed by CFR for established patients (36%) and BR for new patients (22%). Most attending physicians indicated that BR and HR were superior to CFR in promoting the following ACGME competencies: patient care, systems-based practice, professionalism, and interpersonal skills.
CONCLUSIONS:
HR is the most commonly employed rounding model. BR and HR are perceived to be valuable for teaching patient care, systems-based practice, professionalism, and interpersonal skills. CFR remains prevalent despite its perceived inferiority in promoting teaching across most of the ACGME core competencies

via Internal medicine rounding practices and the accr… [J Hosp Med. 2014] – PubMed – NCBI.