United States

Abstract Title:
Image Quality Assessment in Point of Care Ultrasound Education
Background
Our aim was to provide a high-quality POCUS education program for hospitalists at the Jesse Brown VA hospital. That entailed providing a valid and consistent way of tracking the progress of our learners throughout the program, for which image quality assessment was one of the main metrics. Literature review demonstrated a gap in evidence-based methods for doing so, which is why we believe our findings are invaluable for the advancement of POCUS education.
Methods
A group of 25 ultrasound images was shared with our 3 educators for quality measurement on a numerical scale. First, each educator independently scored the images based on clinical gestalt. A second round of image scoring was done where the educators were provided a rubric to independently score images based on orientation, gain, plane, depth, and visible structures. A debriefing session was then done to clarify how each of the educators perceived and utilized the rubric after which a third and final round of image scoring was done. The educators were blinded to their colleagues’ grading submissions until the end of the 3 rounds.
Results
The intraclass correlation coefficient (ICC) was 0.589 for the first round of scoring. After adding the rubric, the ICC rose to 0.752 (28% increase). The ICC further increased to 0.862 after the debriefing session was done on using the rubric. The calculated Conbrach’s alpha for internal consistency was 0.811.

Conclusion
There is a significant improvement in the ICC after implementing the rubric, and again after the debriefing session was conducted. This implies a higher consistency in the feedback learners receive on their images from the different educators when using an agreed-upon rubric to track their progress. 
The rubric was also successful in grounding the educators to focus on the innate image quality attributes first, and then to provide feedback on the clinical utility of the entire study of images a learner has submitted for a given patient. We were thus able to independently score technical skills for image acquisition while fostering the learner’s clinical skills of interpreting such images to guide their use of ultrasonography in clinical practice.

2022 AMA Research Challenge

Image Quality Assessment in Point of Care Ultrasound Education

poster

Welcome to the largest national, multi-specialty research event **featuring research from 750 medical students, residents and fellows, and international medical graduates.**


#### Event Details
The 2022 American Medical Association Research Challenge includes a poster symposium hall and a semifinals hall with the top scored research. Log in at any time throughout the event to:
* **View posters and presentations** on a variety of topics and specialties
* **Score posters in the semifinals** to help decide the top five finalists (AMA member exclusive opportunity)
* **Connect with participants** and provide feedback to help advance their research

At the conclusion of this event, the AMA will announce the top five finalists who will advance to the AMA Research Challenge finals, present their research to an elite panel of judges and compete to win a $10,000 grand prize sponsored by Laurel Road.
 

#### Attend Live Forums
**Oct. 20, 6 — 7 p.m. Central**
 **How to plan a career in academic medicine** 
 Learn how to plan a career in academic medicine and get your questions answered. [Access Here](https://underline.io/events/363/lounge)
 
 **Speakers**
![](https://assets.underline.io/uploads/markdown_image/1/image/d5adb133dfc58eb0a6d469e9cedcd5d4.jpg)
Ricardo Correa, MD, EdD
![](https://assets.underline.io/uploads/markdown_image/1/image/5f9437ab87861538bf02b9ca7c0d926e.jpg)
Stuart M. Greenstein, MD
![](https://assets.underline.io/uploads/markdown_image/1/image/05b1b637c99286d558c371f8e8b185ce.jpg)
Stephanie Strohbeen, MD
 
 **Oct. 22, 11 a.m. — Noon Central**
 **How to get published**
 Learn tips to get your research published and get your questions answered. [Access Here](https://underline.io/events/363/lounge)
 
 **Speakers**
![](https://assets.underline.io/uploads/markdown_image/1/image/8ce6235e957d31cb5e6f9097cc6f6972.jpg)
Jessica Li, MD/PhD Candidate
![](https://assets.underline.io/uploads/markdown_image/1/image/9950ef2e0237f54cb3d8280334d42491.jpg)
Charles Lopresto, DO

### Sponsor
AMA would like to thank Laurel Road for sponsoring a $10,000 grand prize for the winner of the AMA Research Challenge. Laurel Road is not involved in the judging or scoring process to select the winner. The winner will be announced on Dec. 7 during the AMA Research Challenge finals. Payment of the grand prize will be directly from Laurel Road. See the AMA Research Challenge Official Rules for terms and conditions.

![](https://assets.underline.io/uploads/markdown_image/1/image/611e331d4a0eba0920f240cfc04b4d77.png)

**There is no registration fee for this event! **

Register to explore research in a variety of topics. AMA members get exclusive access to score posters in the semifinals.

**Please use the link below to register for free if you have not already done so:**

https://www.ama-assn.org/about/events/ama-research-challenge

Registration Is Required

Welcome to the largest national, multi-specialty research event featuring research from 750 medical students, residents and fellows, and international medical graduates.


Abstract Title:
Impact of Medical School Longitudinal Research Program in Post-Graduate Research Productivity

Background
In 2004, the University of Pittsburgh School of Medicine (UPSOM) implemented a novel, mandatory research curriculum for medical students titled the Longitudinal Research Project (LRP). Under faculty mentorship, medical students construct an individualized scholarly research project that must be completed prior to graduation. This study evaluates the long-term implications of the LRP by analyzing post-graduate research productivity following the implementation of this unique research curriculum.

Methods
This retrospective study analyzed publication data from 2007-2020 on UPSOM graduates before and after LRP implementation in 2004. Each graduate’s respective publication(s) were identified via PubMed’s Advanced Search Builder with a time frame that began from one-year to seven-years post-graduation. Confounders were identified using bivariate analyses and incorporated into final multivariate regression models. The cross-sectional time series cohort was analyzed using multivariate linear mixed effects modeling with significance set to 0.05 via STATA 16 statistical software.

Results
1,022 medical school graduates met inclusion criteria. Of which, 278 graduated prior to 2008 (pre-LRP), while 744 graduated in 2008 or later (post-LRP). The average rate of publications annually was 0.47 + 1.43 pre-LRP & 0.57 + 1.40 post-LRP. According to multivariate linear-mixed effects results, post-LRP medical school graduates exhibited a greater average annual publication rate than pre-LRP medical student graduates (ß = 0.10, 95%CI: 0.03 – 0.17, p = 0.008). The average probability of at least one publication in a given year was 22% (95%CI: 0.21 – 0.23) pre-LRP & 27% (95%CI:0.25 – 0.28) post-LRP. The average probability of at least one first author publication in a given year was 12.2% (95% CI: 0.12 – 0.13) pre-LRP & 15% (95% CI:0.14 – 0.16) post-LRP.

Conclusion
Medical school graduates who partook in a mandatory, longitudinal research program in a medical school curriculum exhibited a greater average annual publication rate than pre-LRP medical graduates early on in their post-graduate careers. This study suggests that implementing a mandatory LRP within a medical school’s curriculum may increase meaningful research productivity and progression of clinical science for young physicians beyond the curriculum.



Impact of Medical School Longitudinal Research Program in Post-Graduate Research Productivity

Medical law is a subset of the legal system that dictates appropriate medical practice, regulations, and the rights and responsibilities of healthcare professionals and their patients. As the relationship between medicine and law becomes increasingly complex, many medical students report negative perceptions of the legal field and feel unprepared to handle medical-legal issues upon entering their clinical rotations and residencies. The aim of this literature review was to provide an overview of medical student understanding of medical law as well as the current status of medical-legal education in the United States. 

A PubMed search revealed 3,483 papers that were sorted for relevance and the citations of relevant papers were also reviewed. A total of 38 studies were included and evaluation yielded three main themes that were explored in depth. The first theme was that medical students and residents report feeling unprepared to handle legal aspects of healthcare. Surveys regarding medical student perceptions of the legal field unveiled the second theme which describes students as having generally negative feelings and attitudes toward law, although students acknowledged the importance of medical law in healthcare. The last theme was described by studies determining that introducing medical-legal courses to current medical school curricula would benefit students and have a positive impact on their perceptions of the legal field. 

More must be done to evaluate and reform current medical curricula to produce legally competent and confident physicians. The Liaison Committee on Medical Education in the United States should take the lead and add medical-legal education to their standards for accreditation that are annually released.

Incorporating Medical Law into Medical Education Curricula: A Literature Review

Background Traditionally, hands-on procedural training during pre-clerkship education has been limited. Students transition from the classroom to the wards with limited procedural skills. As a result, students navigate their first clerkships with anxiety about being unprepared. In response, we hosted an in-person event, the Medical School Convention (MSC), to help the first-year medical students acclimate to procedural skills they will use shortly in their core clerkship training. 

Methods An in-person targeted simulation curriculum was launched at a large, private allopathic medical school to help improve medical students' self-perceived efficacy before starting clerkships. The objective was to provide medical students with a small group, hands-on clinical and procedural skills practice to better prepare them for clinical clerkships. Six relevant skills often not included in the traditional medical school curriculum were selected for the training, each being taught at a separate station. The stations were: oral presentations, suturing, venipuncture, intubation, ultrasound, and trauma assessment. A curriculum and training course was created for each of the skills. Following the skills training, students were offered an anonymous post-survey assessing comfort and self-perceived competency with the skills taught at the stations they attended. This study was deemed exempt by the Institutional Review Board. 
Descriptive statistics were obtained for all variables. Survey responses were analyzed using paired t-tests to compare pre-training and post-training responses. A p-value of < 0.05 was considered statistically significant. 

Results In the posttest survey, 95.1% of students reported that this workshop helped them feel more confident in clinical scenarios. Additionally, 100% of students reported that they would recommend this workshop to other medical students. Although not statistically significant, there are appreciable differences in students’ perceived confidence (2.8 vs. 3.2, p=0.537) and clinical self-efficacy (5.3 vs. 6.3, p=0.998) pre-and post-training, respectively. 

Conclusion The Medical School Convention provided valuable insights regarding medical students' self-reported preparedness for the wards. Through our brief one-day course, we identified some knowledge gaps regarding procedural skills and ways to address them. We conclude that more hands-on skills training should be integrated into all medical school curricula before students begin clerkships to help increase their self-confidence.

Medical School Convention: An Innovative Model to Prepare Medical Students for Clerkships

Medical Specialty Speed Dating: Does It Work?

Background: There is a paucity of research regarding the perceptions and potential behavioral changes of the medical students that will be taking the USMLE as a pass/fail examination. We sought to assess medical student perceptions of the USMLE Step 1 transition to pass/fail and evaluate differences in extracurricular participation between pass/fail Step 1 students and scored Step 1 students.

Methods: Sixty-eight US medical schools were invited to participate in an anonymous survey. Self-reported extracurricular activities during the first year of medical school were compared between Step 1 pass/fail students (S1PF) and Step 1 scored students (S1S) with a chi square test.

Results: Between 8/25/2021-11/16/2021, 341 students started the survey and 277 (81.2%) completed the survey. One hundred two (36.8%) were S1S and 175 (63.2%) were S1PF, of which 87 (49.7%) had completed at least one year of medical school. We found mixed results on whether students would prefer Step 1 to be pass/fail or scored. The majority felt the transition would disadvantage students from “lower ranking” medical schools. Regarding the transition, the majority of S1PF reported more anxiety related to Step 2, extracurricular activities, and the
residency application process. There were no significant differences between S1S and S1PF students for participation in volunteering, teaching, and research, but a significant increase was observed in how many leadership positions S1PF students applied to and obtained during their first year of medical school (p < 0.001 and p = 0.011, respectively).

Conclusion: To our knowledge, this is the first study analyzing the perceptions and possible behavioral changes of medical students who will be taking Step 1 as a pass/fail examination. The reported increase in anxiety among pass/fail students should be addressed by medical education professionals and merits discussion of curricular remodeling. The transition creates an opportunity to redefine the residency application process allowing holistic evaluation of students which can confer advantage to those from “lower ranking” schools.

Medical Student Perceptions of the USMLE Step 1 Transition to Pass/FailScoring

Native Hawaiian and Pacific Islanders Fail to Match Previous 15-Years of Underrepresented in Medicine Growth in Graduate Medical Education Residency Training Programs

According to the National Residency Matching Program in 2022, 631 pathology positions were offered. In total, 248 MD seniors applied and filled 36.6% of these positions. To bolster medical students' interest in pathology, a medical school pathology interest group organized a multi-day activity to introduce rising second-year medical students to pathology as a career. Five students completed both pre- and post-activity surveys assessing their knowledge of pathology as a specialty. All five students had a BA/BS degree as their highest level of education. Only one student indicated that they had previously shadowed a pathologist as a medical laboratory scientist for a duration of four years. Two students indicated that they were interested in internal medicine, one indicated radiology, one forensic pathology or radiology, and one was undecided. During the activity, students biopsied tissue from cadavers in the gross anatomy lab. Following the biopsies, students participated in the standard tissue processing by shadowing a histotechnologist. Under the guidance of a pathologist, students microscopically examined slides and discussed the clinical findings. Post-activity survey results indicated that participation increased their knowledge of pathology as a career with a median increase of 0.8 points (range: 0.2 to 1.6) on a 5-point Likert scale. Students also indicated that their participation increased their knowledge of pathology skills and techniques – median increase of 1.2 (range: 0.8 to 1.8). This activity can be implemented by medical educators to increase exposure of medical students to pathology as a career with the benefit of increasing student knowledge in the specialty.

Pathology Education Project: A Pilot Program to Spark Student Interest in Pathology as a Career

Background
Effective patient education can help achieve better clinical outcomes. A patient who is active and engaged in their care can better manage their condition at home, especially when monitoring a chronic illness. Meaningful patient education is an important skill in the professional formation of physicians, yet little is known about medical students’ perceptions and implementations of best strategies for effective patient education.
Methods
All second-year Wayne State University School of Medicine students (n = 298) were invited to complete an online survey regarding their opinion on the most important strategies for successful patient education. The survey asked participants to rank the following strategies from most (1) to least (8) effective: providing written patient education materials in numerous languages, patient teach-back, provider empathy, patient motivation, education follow-up, patient health literacy levels, social determinants of health barriers, and other.
Students then completed a patient education module, which involved groups of 5-6 students creating a visual education tool for a specific chronic illness and target patient population. Groups first attended a faculty presentation on their chosen chronic illness, then wrote an abstract and designed a final product under the guidance of a senior medical student or physician mentor. After this module, all second-year students were invited to complete a post-survey regarding the patient education strategies they felt accurately characterized their project. 111 students completed the pre-survey, and 67 students completed the post-survey.
Results
Before completing the module, students ranked patient teach-back (mean score of 3.07), provider empathy (3.11), and patient motivation (3.49) as the top strategies for effective patient education. After the module, students identified social determinants of health barriers (mean score of 3.36), patient health literacy levels (3.54), and patient motivation (3.55) as the three strategies that best characterized their chronic illness project.
Conclusion
In a course assignment, undergraduate medical students utilized different patient education strategies from those they initially identified as most effective, indicating a dissociation between their mental framework and application of practices in patient education. These results reveal the need for more comprehensive pre-clinical medical education in implementing effective patient education strategies.

Perceptions and Implementations of Best Practices in Patient Education among Second-Year Medical Students 

Background: Orthopaedic surgery remains one of the most competitive residencies in the Match, with 1,470 applicants and only 875 positions in 2022. With the novel change in the USMLE Step 1 to pass/fail, other metrics may be emphasized more in the applicant selection process. Social media and professionalism on aways (auditions) are possibly even more important now when screening which medical students are invited to interview. This study provides an assessment of which metrics could potentially be used by program directors (PDs) and assistant program directors (APDs) in the orthopaedic residency selection process. It compares PD/APD, resident, and medical student views on social media and professionalism.

Methods: Three REDCap surveys were created and sent to orthopaedic surgery residency PDs/APDs across the U.S., residents of all postgraduate years, and more than 600 diverse medical students. Two-sample t-test, Wilcoxon rank-sum test and ANOVA were conducted to test the hypothesis that there would be one or more mean differences between PD/APD, resident, and medical student views on social media and professionalism.

Results: A total of 182 responses were recorded, including from 24 PDs/APDs (n=24 programs), 12 residents (n=7 programs) and 146 medical students (n=1 program), with 16 U.S. states represented. Residents (83.3%) thought professionalism should be an even more important selection metric utilized by PDs/APDs with the novel change in Step 1 going to pass/fail. One hundred percent of residents and 70% of medical students thought professionalism issues on aways were reasons for applicants not to be selected compared to professionalism on social media and interviews. The similarity between PD/APD and resident views was significant regarding social media being used as a selection factor (P=.03).

Conclusion: Medical students’ professionalism on aways will potentially be more emphasized in the orthopaedic residency selection process now with the change in the USMLE Step 1 to pass/fail. A prospective medical student’s social media is utilized by some PDs/APDs and residents in the applicant selection process. Care should be taken to maintain exemplary professionalism on all accounts.


Social Media and Professionalism in the Orthopaedic Residency Selection Process

Background: Sex- and gender-based medicine (SGBM) aims to understand how sex and gender affect
human disease. Despite efforts since the 1990s, fewer than 20% of medical schools have an integrated
SGBM curriculum (Jenkins et al, 2016). The Sex and Gender Health Collaborative (SGHC), part of
AMWA, aims to mobilize trainees to create a publicly available resource of educational material that will
help to expand awareness of SGBM and to bridge the gap in traditional medical education curricula.

Methods: The pilot phase involved 9 students who designed innovative educational materials to

highlight sex and gender differences not traditionally emphasized in medical education. Post-
surveys were administered, evaluating the effect of participating in the initiative. In the second

phase, we recruited 205 trainees and paired them with physician experts to produce factsheets, slide sets,
and videos to highlight sex and gender differences for 64 common medical conditions. We have
completed a pre-survey of these students to evaluate their awareness of and attitudes around SGBM and
will administer another survey after project completion to evaluate if the project achieved its aim. The
efficacy of the educational material created will also be evaluated.

Results: Pilot data show that all students strongly agreed participating in the project increased their
knowledge of sex and gender differences in medicine and created connections to others with similar
interests. Preliminary data from the second phase show that while 96.5% of trainees agree that

individualizing medical care according to sex and gender is important for patient care, only 66% self-
reported they were knowledgeable about sex and gender differences in medicine. 52.5% of 122 medical

student participants do not have a SGBM curriculum in their medical schools.

Conclusion: Overall, results from the first phase indicate that this project is a feasible and effective
way for students to increase their knowledge of SGBM and form a network of like-minded trainees and
physicians. Preliminary data from the second phase highlight that students recognize this gap in medical
care and education. Ultimately, we hope this student-led initiative will advance SGBM education
nationally to improve awareness and promote change in clinical practice.

Premium content

Image Quality Assessment in Point of Care Ultrasound Education

Next from 2022 AMA Research Challenge

Impact of Medical School Longitudinal Research Program in Post-Graduate Research Productivity

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES