United States

Students’ sense of belonging and academic self-efficacy are important factors in their college success. In this study, we examine the relationship between a first year intervention, NxtGEN, with STEM students and their reported sense of belonging and academic self-efficacy. Moreover, we explore a mechanism for explaining differences in sense of belonging and academic self-efficacy among NxtGEN participants and a comparison group. Specifically, we describe the characteristics of students’ academic and social support networks and ways these networks differ by participation in the intervention. This study relies on longitudinal survey data in which students listed people to whom they are connected in academic and social settings and provided details about the frequency and nexus of their connection to these people. Students also completed scales to measure sense of belonging and academic self-efficacy on this survey. We also surveyed a similar group of first year students who did not receive the NxtGEN intervention in order to better examine the effects of program participation. 

Using these data, we find that, on average, students who did not participate in NxtGEN had slightly larger academic and social networks in both the fall and winter terms of their first year. In addition, NxtGEN students in the spring term reported a higher sense of STEM self-efficacy but a lower sense of social belonging relative to their non-NxtGEN counterparts. Average NxtGEN student STEM self-efficacy scores remained stable across the fall and spring terms, while non-NxtGEN student STEM self-efficacy scores decreased over time. At the same time, scores for a sense of social belonging decreased over time for NxtGEN students while it increased for non-NxtGEN students.


13th Conference on Understanding Interventions 2021

Academic and Social Networks among First Year STEM Students

first year

belonging

network

AAPT® is a strong professional physics science society dedicated to the pursuit of excellence in physical science education.

Winter and Summer National Meetings:
These National Meetings, held each winter and summer, are opportunities for members, colleagues, and future physicists from around the world to:

- participate in physics workshops
- meet and greet other physics educators
- form networks nationally and locally
- engage exhibitors and learn about the latest physics resources
- discuss innovations in teaching methods
- share the results of research about teaching and learning.

If you're not able to log in, you're most likely using **incorrect login credentials**. Double-check that you are using the same email and password that you used to register for the conference, submit your abstract or access your AAPT membership. There may also be **an issue with your AAPT meeting registration**. Please email aapt2021@underline.io and programs@aapt.org and we will work quickly to resolve this issue.

AAPT WM 21

symposium

The annual UI conference has grown from a meeting to a community of more than 6,000 researchers, program officers, evaluators, program directors, training faculty, and others within STEM, and now operates with a mission to mutually inform scholarship and practice, develop and enhance the community interested in educational interventions, and provide professional development for all STEM persons. UI held its first Virtual conference in December of 2020 in response to Covid-19 restrictions that forced the cancellation of the original March 2020 in person meeting. Born out of necessity, the virtual conference introduced a format that provided pre conference availability of symposia, Deeper Dives and Poster presentations. The 13th Annual Understanding Interventions Conference will continue with that design and we foresee future conferences adopting aspects of that format in reaching a virtual audience as well as those who attend the conferences in-person.

Attendees will experience plenaries, workshops, symposia, and poster presentations on hypothesis-based research on interventions and initiatives that broaden participation in STEM careers. The conference will continue to facilitate the dialogue among education, behavioral, and social science researchers, evaluators, and faculty in STEM fields who participate in intervention programs. Graduate students in these fields are strongly encouraged to attend. Workshops, sessions, and posters will communicate effective strategies from successful STEM intervention programs, present results from empirical research studies, and synthesize the translation of research findings into practice on STEM learning, undergraduate research, graduate education, and student retention.

The cost to attend the conference is $150. There are special rates for post-doctoral fellows and graduate students, as well as conference grants that can be provided for those with need. Registration for the conference is open, with additional information to come.

The annual UI conference has grown from a meeting to a community of more than 6,000 researchers, program officers, evaluators, program directors, training faculty, and others within STEM, and now operates with a mission to mutually inform scholarship and practice, develop and enhance the community interested in educational interventions, and provide professional development for all STEM persons. 

Background: Minorities make up almost 28% of the US population with 13% being African American and 16.6% being Latino/Hispanic. This is projected to rise to 50% in two decades. Physicians from these backgrounds barely make up 10% of practicing medical doctors in the US. The same is true for scientists and educators. Several initiatives have been launched at national, state and regional levels but have yet to produce significant change. While academic institutions bring in students from these backgrounds, there is considerable leakage from the pipelines. A study from the University of California system highlights the problem (Alexander et al 2009). The authors of the study found that even though the under-represented minority (URM) students, on average, did not perform on par with white students, they were nearly as likely as white students to persist in completing at least four gateway courses. The authors concluded that URM students experienced academic challenges, but many persist in their prehealth courses despite these challenges if offered encouragement and opportunity. Therefore, interventions designed to support URM student performance in undergraduate and gateway courses are considered to be particularly important for increasing the diversity of health related professional and graduate schools (Estrada et al 2016 and McGee et al. 2012). Many medical schools have programs in place that prepare URM students for admission, however the number of qualified candidates remain far short of the desired goal. Finding meritorious URM students who can compete and qualify for admission to health related professions and graduate schools remains the biggest challenge. 
Hypothesis: A summer immersion program for disadvantaged students (including URM students) will prepare them for a rigorous preparatory Masters program and matriculation into a health or science professional school.
Design: We have initiated a four week intensive academic enhancement in the summer (ACES) program for students who were just below the cutoff for admission to our master’s program in biomedical sciences with the understanding that students who achieve a B or above grade in four relevant gateway courses (Cell Biology, Biochemistry, Physiology and Microbiology) will be offered admission to the main master’s program at the end of the ACES program. 
Results: Over the past five years we have admitted 63 students into our summer ACES program. Of the 63 students, 38 are women; and 30 are URMs; the rest are Asian or Caucasian. A few of them are self-declared economically disadvantaged and some are first in family to go to college. Sixty of these students qualified for the main Masters program after completing ACES. We have followed their performance in the Masters program and find that these students are indistinguishable from students who had been admitted to the Masters program in the regular track. The ACES graduates are integrating well with their peers and they are in various different programs including medical schools. 
Conclusions: Interventions at the gateway program level designed to attract and nurture disadvantaged students including URMs can be successful in increasing the number of qualified aspirants to health related professional schools and graduate schools. By opening up the opportunity to all disadvantaged students, we have been able to encourage URM students to pursue their goals. Our five-year data on a small number of students lead us to believe that programs such as ours will go a long way in recruiting qualified candidates to health- related professional schools and graduate schools and will be effective in increasing the number of URMs in these areas. 


Five-year assessment of summer academic enhancement program motivates URM students to pursue gateway programs and entry into health professional schools 

Time has long passed for Black and Latinx elementary youth to be seen as scientists, designers, community planners, and activists. The opportunity for them to be seen as such is rare and when it is afforded to Black and Latinx youth, it is almost exclusively for high school youth. At STEM to the Future, we start this process with elementary youth showing them that age isn’t a prerequisite for creating change. In the summer of 2020, we piloted our Brick by Brick programs, which are student-led initiatives where the students work together to decide on and execute their own projects in the community. They are guided through the process of (1) creating a clear vision for the world they want and deserve and (2) using STEAM to develop projects that support their vision, and (3) connecting with the community and grassroots organizations to implement the projects.Brick by Brick creates a space for students to collaborate with each other and with the community to use STEAM to solve real problems, which they identify themselves in collaboration with the community. Our assumption is students will be more likely to be invested in their communities as they mature if they see the meaningful change they are able to create in their neighborhoods at a young age. We’re cultivating our youth so that are able to appropriate technology and use in the fight for their freedom. You’ll see how girls and non-binary youth in our Build’Em Up Robotics program used coding and robotics to deliver PPE to elders in their communities and see how students in our Building Healthy Communities program are trsting different ways to bring food justice to South Central, Los Angeles. 
Education should be reflective of the world that you live in and seeks to support you in addressing injustice 


Creating STEAM Student Led Learning Experiences Rooted in Justice and Identity

Working Title: You’ve had your first diversity and inclusion meeting – Now what? : A model for sustaining meaningful conversations on diversity and inclusion within STEM training environments

Short Summary of Presentation: In the wake of nationwide movements for racial and social justice, scientists are more aware than ever of the problem of building and sustaining diverse research and training environments. In this presentation, we report on an intervention intended to foster ongoing dialogue about diversity and marginalization in biomedical research science. The data come from the intervention arm of a randomized-controlled trial of a novel coaching intervention consisting of small groups of trainees and faculty coaches. The data reveal how this model was effective in sustaining meaningful dialogue on diversity and building capacity for inclusion practices in biomedical research science. 

Abstract: The events of 2020, including the growing visibility of the Black Lives Matter movement following the murder of George Floyd, catalyzed a movement for racial justice unlike any since the Civil Rights Movement. Across academia, students, faculty, and leaders are increasingly engaging with issues of racial equity and justice. Within the context of STEM training, there has been a dramatic shift in awareness of these issues. Questions like, “Should we talk about race, gender and other differences within mentoring relationships?” evolved into more actionable questions, like: “How do we make these conversations possible?” “How do we accomplish something we have failed to do for decades? “What is the most effective way to build and sustain dialogue about diversity?” Interventions targeting these questions of diversity and inclusion have developed over the past few years. For example, the Culturally Aware Mentoring program (CAM) is a workshop-based approach for teaching faculty and trainees to engage in diversity dialogues in academic science. Studies of CAM have demonstrated its immediate impacts on faculty and administrators, as well as longer-lived impacts on some (1,2). As comprehensive and effective as CAM is in the short-term, it is unlikely that a single-event intervention will be sufficient to initiate the ongoing dialogue required to foster sustainable changes in inclusive insights and practices to eradicate barriers to equity and inclusion in academic science. 

Beginning in 2011, our research team at Northwestern University Feinberg School of Medicine began an experiment involving faculty-led coaching groups, with the long-term goal of increasing and sustaining diversity in biomedical faculty ranks (3,4). The Academy for Future Science Faculty (the Academy) paired groups of ten PhD students with trained faculty coaches from outside of the students’ home institutions. Annual in-person meetings occurred over a period of two to three years and coaching groups continued to meet virtually for about three years following the initial meetings. Coaching groups were heterogeneous, and equally balanced by gender and race/ethnicity to foster conversations across identity groups. The intervention employed a novel, intensive introduction to: 1) social science theories that underpin progression and barriers within social systems, including STEM; and 2) the history of and ongoing realities of how racism and privilege result in differential treatment of racial and ethnic minorities, women, and other minoritized groups. The frameworks introduced to students, and activities of the Academy, allowed them to engage in deep and meaningful discussions of diversity. The study team continues to follow participants through annual in-depth interviews; these interviews have revealed how the Academy affected their perceptions of diversity, discrimination, and the importance of building and sustaining diverse research environments. 

This presentation draws on interviews with Academy participants conducted at least four years after the end of the coaching group virtual meetings. The interviews have captured participants’ lasting memories of and reactions to group-based exposure and dialogue related to diversity and inclusion. In particular, the data reveal how participants continue to apply the social theories introduced in the intervention, such as microaggressions, imposter syndrome, and cultural capital, to make sense of and navigate science as a social system. Similarly, participants continue to recall the group discussions on the meaning and importance of diversity and inclusion. The data reveal strong and lasting impacts for many participants. Some participants reported drawing on their experiences in the Academy to engage in or lead diversity efforts in their current positions. Others have reflected on perspective changes and the importance of sustaining diverse research environments. These impacts occurred among participants from across gender and racial/ethnic groups, and were notable among traditionally well-represented students. Among the many examples of transformative perspective changes are new strategies for navigating and responding to racism, increased engagement in proactive diversity and inclusion efforts, and the ability to observe and name instances of marginalization. For those who elected to continue in academic research science, the impacts of the intervention are likely to be felt in the long-term and allow increased capacity to build and sustain diverse research environments. 

As part of the Deeper Dive discussions, we will explore a number of different designs and approaches groups could adopt, and offer guidance on how to facilitate these groups. Done effectively, such efforts could be effective in reshaping the norms and expectations for cross-cultural understanding so essential for effective mentoring.

References:

1. Byars-Winston, A., Womack, V., Butz, A., McGee, R., Quinn, S., Utzerath, E., Thomas, S. (2018). Pilot study of an intervention to increase cultural awareness in research mentoring: Implications for diversifying the scientific workforce. Journal of Clinical and Translational Science, 2(2), 86-94. PMCID: PMC6191051
2. Womack VY, Wood CV, House SC, Quinn SC, Thomas SB, McGee R, et al. (2020) Culturally aware mentorship: Lasting impacts of a novel intervention on academic administrators and faculty. PLoS ONE 15(8): e0236983. https://doi.org/10.1371/journal.pone.0236983 PMCID: PMC7413486
3. Thakore BK, Naffziger-Hirsch ME, Richardson JL, Williams SN, McGee R Jr. The Academy for Future Science Faculty: randomized controlled trial of theory-driven coaching to shape development and diversity of early-career scientists. BMC Med Educ. 2014 Aug 2;14:160. doi: 10.1186/1472-6920-14-160. PMCID: PMC4121509.
4. Williams SN, Thakore BK, McGee R. Coaching to Augment Mentoring to Achieve Faculty Diversity: A Randomized Controlled Trial. Acad Med. 2016 Aug;91(8):1128-1135. PMCID: PMC4909583



So you've had your first diversity and inclusion event...Now What?

Introduction. The COVID-19 pandemic that began in Spring 2020 and the subsequent period of social unrest due to police brutality against Black Americans and racial injustice have posed profound challenges to college students and academic programs across the U.S. Summer research experiences (SREs) were challenged to quickly pivot research training curricula and activities to a virtual format while ramping up activities that would bolster support and safety networks for student trainees, many of whom were socially isolated, fearful of the health and safety of themselves and their loved ones, while worried about the uncertainty of their academic future. This study investigates the nature of the concerns and worries that undergraduate trainees experienced during the tumultuous summer of 2020 and what program factors, if any, were able to potentially mitigate the impact of COVID-19 and racial injustice on these concerns. Specifically, this study evaluates basic needs, mental health, and academic concerns in the context of a National Institutes of Health (NIH) funded SRE, examining how student concerns and their relationship to program factors vary by demographic and academic characteristics. 

Methods. Forty-five undergraduate trainees participated in a NIH-funded 8-week summer research training program in 2020 (64% female; 67% Under-Represented Minority [URM] students) and completed an online post-survey. Items assessed student perceptions of the virtual SRE, program activities, student experiences related to COVID-19 (Latkin & Dayton, 2020), and impacts of the racial strife and related social justice activism. Closed-ended, Likert scale-type items assessed students’ time management skills and sense of belonging. Exploratory factor analysis (EFA) established four outcome domains: students’ personal needs concerns (α=.90), stress and mental health concerns (α=.89), academic concerns (α=.83) and impacts of anti-Black racism (single item measure). Independent t-tests (correlations) assessed differences (relationships) of student concerns by demographics and key variables of interest. Due to the paucity of research on these topics and exploratory nature of our questions, an alpha of .10 was selected. 

Results. Intercorrelations revealed that the outcomes were moderately related, yet distinct (rs = .24, -.56). Students were somewhat concerned about their personal needs (M = 2.05, SD = 0.81), very concerned about their stress and mental health (M = 2.79, SD = 0.80), and extremely concerned about their academics (M = 3.90, SD = 0.88). In addition, anti-Black racism, and society’s response to it, impacted students to a moderate extent (M = 3.60, SD = 1.10). Students who received financial aid and transferred from a two-year institution had higher personal concerns than those who did not (ps = .001, .030, ds = 0.86, 0.71). Additionally, URM students indicated higher personal needs concerns than non-URM students (p = .093; d = 0.54). Mental health concerns differed by gender such that women reported greater mental health concerns than men (p = .098, d = 0.52). Biomedical majors had higher academic concerns than behavioral majors (p = .056; d = 0.58). Students indicating poverty experienced higher anti-Black racism impacts than those that did not (p = .099, d = 0.62). 

Students who felt stronger relationships with research group members indicated lower stress/mental health concerns and academic concerns (rs = -.29, -.45; ps = .089, .007 respectively). Additionally, positive working relationships with training director(s) were negatively related to academic concerns (r = -.32, p = .040) such that higher quality of relationship was related to lower academic concerns. Feeling part of the SRE community was inversely related to personal needs concerns, academic concerns, and anti-Black racism impacts (rs =-.29,-.50,-.27; ps = .059, .001, .068), and feeling connected to members of the SRE community was also inversely related to both personal needs and academic concerns (rs = -.25,-.55; ps = .097, <.001). With respect to time management, meeting deadlines was inversely related to all outcomes. Students who were highly likely to meet deadlines and hand work in on time had lower personal needs concerns, stress/mental health concerns, academic concerns, and anti-Black racism impacts (rs = -.43, -.31, -.57, -.30; ps = .003, .042, <.001, .045). Students who indicated they were able to balance responsibilities (e.g., research, classes, school, home, family, friends) also indicated lower stress/mental health concerns and academic concerns (rs = -.34, -.63; ps = .022, < .001). On the other hand, students with lower prioritization skills and self-awareness of study habits had higher academic concerns (rs = -.37, -.26; ps = .013, .084). 

Discussions and Conclusions. This study provides a snapshot of worries and concerns of undergraduate students who participated in a SRE during the summer of COVID-19 and racial unrest. As expected, SRE students experienced a wide range of concerns related to COVID and racial injustice, similar to students at other U.S institutions (e.g., Nelson et al., 2020). Results reinforce the need for academic programs like SREs to help mitigate student concerns across domains (basic needs, mental health and academic). SRE students who felt connected to their research groups and SRE program directors, as well as to the SRE community, fared better both personally and academically. While the cross-sectional nature renders the directional causality inconclusive, the associations underscore the importance of programs fostering a safe and supportive academic research environment to undergraduate trainees (e.g., Urlaub, 2020). As many programmatic modifications were made instantaneously in reaction to the societal factors such as the pandemic and social unrest, understanding the value of academic based support, as evidenced by this study, is critical. Future research in this area should focus on investigating the impact and effectiveness of specific program modifications.

Psychosocial Impacts of COVID-19 and Racial Injustice on Undergraduate Summer Research Experience Trainees

Promoting Academic Success of Economically Disadvantaged, STEM-Interested, First- and Second-Year Undergraduate Students via the ACCESS in STEM Program at University of Washington Tacoma 

Erica Cline1, Elin Bjӧrling2, Emily Cilli-Turner3, Joyce Dinglasan-Panlilio1, Jutta Heller1, Edward Kolodziej1, Annie Camey Kuo4, Marc Nahmani1, Amanda Sesko1, Mary Pat Wenderoth5, Ka Yee Yeung6

1Interdisciplinary Arts and Sciences, University of Washington Tacoma, Tacoma WA 98402, 
2Human Centered Design and Engineering, University of Washington, Seattle WA 98195, 3Mathematics, University of La Verne, La Verne CA, 91750, 
4Education, Stanford University, Stanford CA 94305, 
5Biology, University of Washington, Seattle WA 98195,
6Engineering and Technology, University of Washington Tacoma, Tacoma WA 98402

Email: ecline@uw.edu
Keywords: S-STEM, mentoring, course-based undergraduate research, learning communities

Introduction

We are facing a national challenge of low retention rates for STEM-interested students. At the University of Washington Tacoma (UWT), a public, predominantly undergraduate, minority-serving institution (Asian-American, Native American, Pacific Islander, AANAPISI), only 28% of high achieving (high school GPA>3.0), STEM-interested at entry, Pell-eligible, first-time-in-college (FTIC) students undergraduates have entered a STEM major by the beginning of their 2nd yr, and the proportion is significantly lower for PEERs (persons excluded from STEM due to ethnicity or race [Asai, 2020]) at only 16%, representing a substantial equity gap. To address this problem, we developed the Achieving Change in our Communities for Equity and Student Success (ACCESS) in STEM Program. Supported by an NSF S-STEM grant since 2018, the program supports low-income, STEM-interested students by providing focused mentoring, a living learning community, a course-based research experience in their first year, and scholarships in their first two years of college. Based on the Student Persistence model of Graham et al. (2013), we hypothesized that these interventions would increase retention, academic performance, and progress into and through STEM majors. Our approach builds upon existing research demonstrating the importance of early research experiences (Thiry et al., 2012) and intensive mentoring and community building, particularly in the context of AANAPISI institutions (Nguyen et al., 2018). 

Methods

Quarterly and cumulative GPA and enrollment status were obtained from registrar data for program participants (N=22) and a comparison group of students who met eligibility requirements (e.g., FTIC, STEM interest at entry, Pell-eligible, and high school GPA > 3.0) but did not participate in the program (N=96). We assessed course grades in individual STEM courses for program participants and for students from the comparison group who consented to be part of the research study (N=16) and were closely matched to participant demographics.

Results

In the first three years, the program supported 44 students. Of these, 59% were female, 74% First Gen, 8% dependents of veterans, and 33% identified as PEERs. In all, 90% held at least one minoritized identity in addition to low-income status. First year cumulative GPA was significantly higher for ACCESS scholars than the comparison group, at 3.44 vs. 3.07 (p=0.027); likewise, second year cumulative GPA was significantly higher at 3.57 for ACCESS scholars vs. 3.09 for the comparison group (p=0.032). At the start of their 2nd year, 35% of program participants had entered a STEM major, vs. 27% of other eligible students. The program did not have a significant effect on first year retention, which was 78% for program participants vs. 82% for other eligible students, but most of the participants who left UWT did so to pursue STEM degrees not available at UWT and were retained in college; in some cases, they reported that mentoring greatly helped them to pursue their new discipline.

Conclusions and Discussion

These results suggest that programs that provide scholarship support and intensive mentoring coupled with opportunities for a living learning community and early research experiences may promote academic performance and entry into STEM majors for economically disadvantaged, first- and second-year STEM-interested students. This may be of particular interest to other AANAPISI institutions, as there are relatively few published studies within this particular context (Nguyen et al. 2018). In future work, we will analyze student responses to on-going longitudinal surveys and focus group interviews to gain greater insight into how the program impacts our students. We will also explore how the ACCESS program contributes synergistically to ongoing institutional change initiatives on our campus promoting faculty development to build capacity for creating equitable and inclusive environments for our students.

Acknowledgments

This program was supported by NSF S-STEM, DUE, Award #1741595. KYY has equity interest in and is employed by Biodepot LLC. This has been reviewed and approved by UW in accordance with its policies governing outside work and financial conflicts of interest.

References

Asai D. (2020). Excluded. Journal of Microbiology & Biology Education, 21(2):1-2. 
Graham, M.J., Frederick, J., Byars-Winston, A., Hunter, A.-B., Handelsman, J. (2013). Increasing persistence of college students in STEM. Science, 341:1455–1456.
Nguyen, T., Nguyen, M.H., Nguyen, B.M.D., Gasman, M., & Conrad, C. (2018). From Marginalized to Validated: An In-depth Case Study of an Asian American, Native American and Pacific Islander Serving Institution. The Review of Higher Education 41(3), 327-363.
Thiry, H., Weston, T. J., Laursen, S. L., & Hunter, A. B. (2012). The benefits of multi-year research experiences: differences in novice and experienced students’ reported gains from undergraduate research. CBE—Life Sciences Education, 11(3), 260-272. 


Promoting Academic Success of Economically Disadvantaged, STEM-Interested, First- and Second-Year Undergraduate Students via the ACCESS in STEM Program at University of Washington Tacoma

Introduction: The proportions of African and Black and Hispanic and Latino Americans grew from 24.8 to 30.6% between the years 2000 and 2014 alone. This proportion is projected to increase further in the coming decades. Despite this population growth and urgent known and projected needs in biomedical research and healthcare workforce diversity, presently, under-represented students (UR) comprise only 11.5% of enrollees in PhD programs. Moreover, although UR medical school graduates comprised 11.8% of the total in 2010, alarmingly this already low percentage dropped to 10.3% in 2015. Lastly, of all MD-PhD program matriculants in 2017, only 9.9% were UR. To address this crisis, in 2016, University of Maryland Baltimore developed STAR-PREP (Science Training for Advancing Biomedical Research ((STAR)-PREP) to provide a year-long rigorous, immersive and supportive experience designed to build students in academic and research rigor and to both individually and holistically to engage in good emotional and mental health practices that will help them to thrive once they enroll in PhD and MD-PhD programs. 

Methods: STAR-PREP was built on a cohort model whose premise was that providing support and intense academic and research preparation, built on an individualized student development plan (IDP) would prepare STAR-PREP Scholars who would be highly competitive to rise to high quality graduate programs. UR participant scholars were diverse and were competitively recruited from geographically diverse US locations and institutions. Institutional and familial resources were varied as well and scholars were selected based on assessed passion for research and demonstration of research commitment and potential. Incoming Scholars each received an individualized development plan (IDP), prepared collaboratively between each Scholar and mentor and STAR-PREP Leadership. In addition to sharpening lab and research skills and experiences (75% of program time), Scholars interacted with near peers and diverse mentors and mentees across the UMB campus and engaged in rigorous graduate courses, critical thinking, writing and presentation workshops, and were both presenters and attenders in research conferences (25% of program time). These intentional and rigorous writing and communication modules prepared the students for communication in their presentations, publications and ensuing graduate school applications and interviews. Furthermore, STAR-PREP Scholars added to and benefitted from UMB’s innovatively developed pipeline and continuum and ecosystem of mentored research education programs and outreach activities on campus and with our partners, creating a strong sense of belonging. Moreover, outreach service as mentors in the pipelines and ecosystem and in the local community enhanced their sense of value in the form of giving back. 

Results: In just 4 full academic years, 14 of 18 (77.8%) of STAR-PREP scholars engaging in the program have ascended to enrollment in strong PhD and MD-PhD programs. One (1) remains in training and 3 (16.7%) ascended to MD and MD-MS programs. 

Conclusion: UM SOM’s I3 approach: intensity, immersion and integration which underpin its STAR-PREP program, demonstrates a highly effective training model and approach to address the urgent and growing need for UR biomedical scientists and physician-scientists. This success was further enhanced by the Scholars’ sense of belonging to UMB and its academic environment and, networking and service in the local and pipeline communities. 

References: 
National Institutes of Health data and statistics (https://www.edi.nih.gov/data/demographics) 

National Science Foundation (https://www.nsf.gov/statistics/) 
Acknowledgements Funding Sources 
NIH/NIGMS R25GM113262; PIs Carey and Antalis 
Grant Title: UMB Post baccalaureate Research Education Program (STAR-PREP) 

NIH/NCI P30CA134274 PI Kevin Cullen, MD Director Greenebaum Comprehensive Cancer Center 
Grant Title: UMB CURE Scholars Program. P30 supplement to Greenebaum Cancer Center Grant

STAR-PREP: An Innovative Holistic and Research-based Immersion Program to Increase Under-represented minority Representation in Science and Medicine


Introduction. Disparities in STEM undergraduate degree achievement has been a prevalent topic of concern in the current higher education landscape, particularly across race, gender and socio-economic status (Griffith, 2010; NCES, 2018). Despite shifts in population demographics, and an increase in the need for STEM workforce diversity to maintain the nation’s economic and technological prominence across the globe, minority student representation in STEM fields still falls far behind current population demographics (Eagan et al., 2013; Lane, 2016). In recent years, STEM enrichment programs have been implemented across higher education institutions in an effort to improve the student success outcomes of under-represented minority students in STEM (Carpi et al., 2017; Jackson & Winfield, 2014). Several studies have found positive outcomes associated with program participation, specifically in graduation, persistence, and math academic preparation across under-represented minority students (e.g., Chang et al., 2014; Lee & Harmon, 2013). Despite these promising results, few results investigate the effects of program participation after accounting for confounding variables that may cause bias in interpreting results (Gonyea & Miller, 2007). For this reason, this study aims to expand research on the long-term effects of participation in STEM intervention programs, in particular the University of Houston’s Scholar Enrichment Program (SEP) a program funded by the National Science Foundation as part of the broader Houston-Louis Stokes Alliance Minority Participation (H-LSAMP). Considering the significance of STEM intervention programs at increasing the completion and persistence rates of URM students enrolled in STEM fields, this study examined the extent to which participation in the UH-SEP program impacts the graduation and persistence rates of minority students after controlling for socio-demographic and pre-college baseline characteristics. The study posed the following questions:
1) To what degree does program participation in the UH-SEP program have an effect on degree completion and persistence?
2) To what degree does program participation in the UH-SEP program have an effect on long-term student dropout and persistence trends over time? 
Methods. This study examined the 2013 and 2014 SEP freshman student cohorts (n=102), as well as a matched sample of non-SEP freshmen students enrolled in STEM fields across the same cohort years (n = 1,459). Student records contained information concerning academic progress, major, GPA, and demographics, allowing the in-depth analysis of persistence, drop-out and graduation rates over time. 
The first step of the analysis involved propensity score matching techniques that matched similar students across a series of baseline covariates that are related to persistence in STEM fields, specifically pre-college standardized math scores, race, gender and major (Ashford et al., 2016; Murphy, Murphy, Gaughan, Hume & Moore; 2010). The resulting sample contained an equal number of SEP and non-SEP participants (n=131). The second step of the analysis involved logistic regression techniques to estimate program participation effects on graduation and persistence rates, using the propensity score matched sample. 
Finally, to estimate program participation effects on dropout and completion rates over-time, discrete-time survival analysis was conducted using a competing risks model to analyze patterns of student dropout while controlling for program participation and the competing risk of STEM persistence. 

Results. Tables 1 and 2 present results of the logistic regression models estimating the effect of program participation and retention in a STEM field. Logistic regression results demonstrated that participation in the UH-SEP program had a significant positive effect on graduation and retention in a STEM field. After controlling for estimated propensity scores, participants of the UH-SEP program were 3.46 times more likely to graduate and 2.55 times more likely to persist in a STEM field, compared to non-SEP students (p<0.05). 

Table 1. Logistic Regression: UH-SEP Participation Effects on Graduation 
Variables Matched Students (n = 238)
Exp (B) 95% C.I for Exp (B)
Estimated Propensity Scores 28.53 .33 2500.65
Program Participation (SEP1) 2.51* 1.08 5.82

Cumulative GPA 4.81** 1.86 12.47
Accumulated Credit Hours 1.06** 1.04 1.08
Model Summary
N 248
% of cases predicted correctly 86.6%
Nagelkerke R2 .707
-2 Log likelihood (df) 154.447
Source: Ghazzawi, D., Pattison, D.L., Horn, C., Hardy, J. and Brown, B. (2021). Impact of an intensive multi-disciplinary STEM enrichment program on underrepresented minority student success. Journal of Applied Research in Higher Education. https://doi.org/10.1108/JARHE-12-2020-0452

Table 2. Logistic Regression: UH-SEP Participation Effects on STEM Retention

Variables Matched Students (n = 238)
Exp (B) 95% C.I for Exp (B)
Estimated Propensity Scores 5.61 0.13 235.46
Program Participation (SEP1) 1.49 0.74 2.99
Cumulative GPA 2.07 0.96 4.46
Accumulated Credit Hours 1.05** 1.03 1.06
Model Summary
N 248
% of cases predicted correctly 80.9%
Nagelkerke R2 .577
-2 Log likelihood (df) 201.204
Source: Ghazzawi, D., Pattison, D.L., Horn, C., Hardy, J. and Brown, B. (2021). Impact of an intensive multi-disciplinary STEM enrichment program on underrepresented minority student success. Journal of Applied Research in Higher Education. https://doi.org/10.1108/JARHE-12-2020-0452
Results of the competing risks model indicated that compared to non-SEP students, SEP participants had a decreased likelihood of dropout and increased likelihood of persistence in a STEM field, evident through the significant sub-hazard ratios for dropout. Table 3 presents the findings of the competing risks regression model. 


Table 3. Competing Risks Regression: UH-SEP Program Participation

Variable Sub hazard Ratios SE 95% Confidence Interval
Program Participation 0.541* 0.129 0.337 0.866
Calculus I Year Taken (Reference: never taken) 
First Year 1.04 0.321 0.567 1.90
Second Year 0.97 0.331 0.503 1.90
Cumulative GPA 0.992 0.216 0.647 1.52
Total Credits Accumulated 0.952** 0.005 0.941 0.963
Source: Ghazzawi, D., Pattison, D., & Horn, C.L. (2020). Persistence of Under-represented minorities in STEM fields: Are summer bridge programs sufficient? Unpublished manuscript.

Conclusions and Discussion. Findings from this study highlight the significant role that STEM intervention programs play in addressing inadequate academic preparation and barriers to the success of under-represented minority students in STEM (Chang et al., 2014; Crisp et al., 2009). Results add to the existing body of literature concerning racial disparities in STEM degree achievement by presenting program participation effects after controlling for pre-college and socio-demographic variables significantly associated with success in a STEM field. In addition, results from this study demonstrate the long-term significant effects of intervention programs on reducing the likelihood of dropout and increasing persistence among minority students. These findings support continuous calls for intervention programs that specifically target minority students from disadvantaged backgrounds. Given that findings from this study were limited to data from a single institution, recommendations for future studies include conducting similar analyses on a broader set of institutions within the H-LSAMP alliance as well as similar national intervention programs to gain a more comprehensive view of intervention effects on minority student success. 

Acknowledgments. Funding for this work is provided by the National Science Foundation: NSF Award HRD-1911310, 1407736, and 0903948. Additional funding was provided by Halliburton, Conoco Phillips, private donors, and the University of Houston’s Provost’s Office. 
References. 

Eagan Jr, M. K., Hurtado, S., Chang, M. J., Garcia, G. A., Herrera, F. A., & Garibay, J. C. (2013). Making a difference in science education: the impact of undergraduate research programs. American educational research journal, 50(4), 683-713.
Carpi, A., Ronan, D. M., Falconer, H. M., & Lents, N. H. (2017). Cultivating minority scientists: Undergraduate research increases self‐efficacy and career ambitions for underrepresented students in STEM. Journal of Research in Science Teaching, 54(2), 169-194.
Chang, M. J., Sharkness, J., Hurtado, S., & Newman, C. B. (2014). What matters in college for retaining aspiring scientists and engineers from underrepresented racial groups. Journal of Research in Science Teaching, 51(5), 555-580.
Crisp, G., Nora, A., & Taggart, A. (2009). Student characteristics, pre-college, college, and environmental factors as predictors of majoring in and earning a STEM degree: An analysis of students attending a Hispanic serving institution.
Ghazzawi, D., Pattison, D.L., Horn, C., Hardy, J. and Brown, B. (2021). Impact of an intensive multi-disciplinary STEM enrichment program on underrepresented minority student success. Journal of Applied Research in Higher Education. https://doi.org/10.1108/JARHE-12-2020-0452
Ghazzawi, D., Pattison, D., & Horn, C.L. (2021). Persistence of Under-represented minorities in STEM fields: Are summer bridge programs sufficient? Unpublished manuscript.
Gonyea, R. M., & Miller, A. (2011). Clearing the AIR about the use of self‐reported gains in institutional research. New Directions for Institutional Research, 2011(150), 99-111.
Griffith, A. L. (2010). Persistence of women and minorities in STEM field majors: Is it the school that matters? Economics of Education Review, 29(6), 911-922.
Jackson, K. M., & Winfield, L. L. (2014). Realigning the crooked room: Spelman claims a space for African American women in STEM. Peer review: emerging trends and key debates in undergraduate education, 16(2), 9.
Lane, T. B. (2016). Beyond academic and social integration: Understanding the impact of a STEM enrichment program on the retention and degree attainment of underrepresented students. CBE—Life Sciences Education, 15(3), ar39.
Lee, D. M., & Harmon, K. (2013). The Meyerhoff Scholars Program: Changing Minds, Transforming a Campus. Metropolitan Universities, 24(2), 55-70.
National Center for Science and Engineering Statistics. 2018. “Science and Engineering Degrees, by Race and Ethnicity of Recipients.” https://www.nsf.gov/statistics/degreerecipients/.


Long-term Impacts of STEM Enrichment Programs on Under-represented Minority Students

The two-semester sequence of General Chemistry is a challenging course too many first-year students. One goal I have is for students to become better problem solvers, able to apply material they learn to synthesize solutions to new and challenging problems. To help develop problem solving skills I have restructured class time to allow for collaborative problem-solving sessions. I have also restructured weekly one-hour recitations associated with the course to include collaborative problem-solving sessions. I have trained a cohort of Learning Assistants (LAs) to help facilitate these in both lecture and recitations. Students who have successfully completed the General Chemistry sequence, return to the class to help as near-peer mentors. 
I want students to leave General Chemistry as better problem solvers, as this skill goes beyond just General Chemistry, this is a skill that will help students in any course or any career. During my first year of teaching, I observed that many students who struggle in General Chemistry, struggle because of the math-based problem solving. This was clear from the assessments that were done throughout the semester. This was also a compounding problem because students who struggled with math-based problem solving within the first semester of General Chemistry, but passed first semester, and struggled even more the subsequent semester. 
To help students become better problem solvers, and to help students solve math-based problems, I restructured class time to allow for mini-problem sessions. Sessions where students are presented with a problem and allowed to work on the problem with students in their area for 4-6 minutes. The LAs circulate through the room, with me, helping to facilitate the group work. Students are then polled on their response to the problem, and we review the problem with a methodical, step-by-step approach. 
Associated with the General Chemistry lecture is a weekly, one-hour recitation section that is run by a Teaching Assistant (TA). To give students extra practice with problem solving, I redesigned the entire structure of recitation. Recitation became a mandatory part of the course that counted toward the overall course grade. I designed structured problem sets for each weekly recitation section to reinforce the content that was covered in lecture. These problem sets were designed in the structure of Process Oriented Guided Inquiry Learning (POGIL) to help create a structure for group work. Each TA is given the same module for the week, ensuring that content is uniform across all recitation sections.

Developing and Implementing a Learning Assistant Program for Introductory General Chemistry

"Introduction

The Biology Scholars Program (""BSP"") is an equity and inclusion program at UC Berkeley that aims to support the success of historically underrepresented undergraduates in STEM. BSP has documented student success for over 28 years and continues to cultivate student growth and inclusivity at UC Berkeley for PEER and first-generation science students (Estrada et al., 2019). While UC Berkeley is highly renowned for its prestigious and rigorous academic programs, there still exists institutional barriers that disproportionately negatively affect historically underrepresented students' persistence (Ballen & Mason, 2017). We therefore sought to understand the impact and influence of the Biology Scholars Program on UC Berkeley. In particular, we wanted to understand its influence on members of the campus community (i.e., faculty, staff, and administrators) and its effect on the larger institution. 

Methods

Data were collected via a brief one-time online survey in fall of 2020, which was distributed to participants using Qualtrics, a survey website. Participants were selected based on past attendance to BSP workshops and conferences between 2015 through 2020. Of 172 participants, 38% were staff, 35% faculty, 14% graduate students, 4% administrators and 9% ""others"" (i.e. alumni, postdocs, program directors). Over half of the sample self-reported as white (57%), hispanic/latinx (12%), black/african american (9%), filipino (3%), asian (3%), chinese (3%), vietnamese (2%), asian indian (2%), japanese (2%), american indian (1%), korean (1%), and declined to state (5%). Respondents self-identified as female (54%), male (34%), transgender (1%), nonbinary (2%), declined to state (1%), and did not answer (8%). The majority of respondents were between 30 - 50 years old. 

Results

The results from the one-time survey provides robust descriptive data to increase understanding of how BSP has impacted UC Berkeley. The first set of questions assessed participants' familiarity with BSP. The data show that over half of participants had experience interacting with members of the BSP community (e.g., BSP faculty and staff [68%] or BSP students [83%]). A subset of questions was dedicated to understanding participants' knowledge of BSP. In terms of correct responses, participants scored relatively high on 5 sections: selection of students (86%), treatment of students (73%), goals of BSP (85%), who participates in the program (65%) and criteria for student success (85%). These data show that participants understand how BSP functions or ""works."" With respect to BSP's influence on UC Berkeley members, the category most frequently selected by faculty, staff, and administrators was ""mentoring"" in relation to 1) influence in their own work (28%) and 2) student persistence in STEM (16%). Importantly, 81% of participants agreed that BSP has influenced the minds of UC Berkeley faculty, staff and administrations about growing student talent instead of selecting for it; a key principle of BSP. 

The Biology Scholars Program was also reported to provide a model of how to create a safe and positive environment for UC Berkeley students. In fact, 97% of participants agreed that BSP's scholars created positive ""ripple"" effects into UC Berkeley and 90% agreed that BSP's Inclusive Excellence Communities of Practice also created positive ""ripple"" effects into UC Berkeley. A number of questions were also asked about BSP's influence. Seventy-seven percent of participants reported that BSP's presence on campus changed UC Berkeley. More to this point, the program was also reported to have positively influenced perceptions of equity (75%), inclusion (81%) and bias reduction (77%). Lastly, an open-ended question asked participants to describe BSP's greatest impact on UC Berkeley and the top two most frequent descriptions were modeling how to be supportive (19%) and creating a sense of belonging or community (17%) for students.

Conclusions and Discussion

The results of this study provide insight into the experiences and perceptions of faculty, staff and administrators with BSP and its impact on UC Berkeley. Overall, results showed that the Biology Scholars Program has had a positive effect on the members of the UC Berkeley community by modelling successful mentorship, and creation of contexts that provide support, inclusivity and equity for students who develop (rather than arrive with) the skills and preparation necessary to thrive in scientific disciplines. On a larger scale, BSP has had a ""ripple"" like effect on UC Berkeley, influencing not only individual members of the university, but other programs on campus, that seek to adapt the BSP model to other disciplines. How these ""ripples"" might extend to other universities is a topic of interest and future research. 

Acknowledgments

The present research was supported by a grant from Howard Hughes Medical Institute (""HHMI"") (Internal ID: 25087). We thank Missy Soto and Brook Yu for their contributions to this research."

Understanding the Biology Scholars Program's Impact on UC Berkeley

"STEM, medicine, and other STEM-intensive health professions are disciplinary areas (referred to here as STEM+) that lack diversity, undoubtedly reflecting many underlying issues in these disciplines as well as in society. Perhaps most important are disparities in access to high quality pre-college STEM education, since they lead to deep and persistent societal inequities. These disparities are especially evident in the STEM+ disciplines and are exacerbated by the strongly hierarchical organization of knowledge and practice in these fields. A strong foundation in pre-collegiate education provides a significant advantage, enabling strong performance in undergraduate programs, which in turn facilitates successful application into highly competitive graduate and professional STEM+ programs. There are many shortfalls in every stage of this pathway that impact the success of minority and socioeconomically disadvantaged students. 

The consequences of the lack of diversity in the STEM+ fields are wide-ranging and significant. Students who are educated in low-resource, underperforming K-12 environments often cannot access STEM curricula that are based on best pedagogical practices and face extraordinary challenges during the early years of their undergraduate education trying to catch up to their peers who had stronger pre-college STEM educational experiences. Students who come from under-resourced backgrounds often have few opportunities to glimpse the transformative advantages of a STEM+ career, leading to the perpetuation of significant societal inequities. The lack of diversity also directly impacts the STEM+ disciplines in several negative ways. The STEM+ practitioner community in the workforce is affected by an insufficient variety of lived experiences and is unable to draw upon the wealth and breadth of knowledge possessed by people who identify as having different cultural, racial, linguistic, religious, gender and sexual identity, and socioeconomic backgrounds. As a result, the perspectives brought to bear on problems may be too narrow in scope. There is ample evidence that suggests that scientific productivity is negatively impacted when a research team lacks diversity, as measured by publication data (Freeman & Huang, 2015). In addition, outreach to disadvantaged communities and efforts to provide assistance to them may not be optimally designed, or even appropriately prioritized (Page, 2008). 

Here, we focus on the mechanisms that assist STEM+ students to overcome socioeconomic and educational disadvantages. We emphasize the importance of mentoring in diverse and inclusive learning communities since our underlying rationale is that diverse populations of successful undergraduates are essential for creating professional diversity in the future STEM+ workforce. 
"

Academic and Social Networks among First Year STEM Students

Downloads

Next from 13th Conference on Understanding Interventions 2021

Five-year assessment of summer academic enhancement program motivates URM students to pursue gateway programs and entry into health professional schools

Similar lecture

Network Analysis of the FCI and the FMCE

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES

Academic and Social Networks among First Year STEM Students

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from 13th Conference on Understanding Interventions 2021

Five-year assessment of summer academic enhancement program motivates URM students to pursue gateway programs and entry into health professional schools

Similar lecture

Network Analysis of the FCI and the FMCE

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES

Downloads