Best Practices

Free Interstate College Access Evaluation Project Teleconference

The College and Career Readiness Evaluation Consortium

Please join the free teleconference on Thursday, March 20th, 2014 at 10:00 am (Central) To register, subscribe to our group mailings here.  You will receive an invitation for the event that includes the telephone number (not toll free) and your unique registration code.  If you would like to receive automatic calendar invites to our group calls, please email us at CollegeAccessAffinityGroup@ed.gov with the address where you would like to receive the notifications.

NOTE: Due to the high volume of calls please dial in 10 minutes prior to the scheduled call time to ensure that you are on the line by 10:00 am (Central).

Join us to learn about an interstate college access evaluation project that is using multi-state data to effectively enhance our work. This effort grew out of project directors wanting to conduct a self-evaluation of the GEAR UP program nationally, partnerships with the National Council for Community and Education Partnerships, ACT, Inc., and the National Student Clearinghouse Research Center that have proven invaluable to the project, and a desire to conduct the first large-scale longitudinal GEAR UP evaluation. The first deliverable that the Consortium has accomplished is common definitions for services in GEAR UP/college access programs. Ultimately, this research and evaluation will strengthen the GEAR UP project, as well as inform college access programming in local education agencies outside of GEAR UP—all while working to meet the President’s 2020 goal.

Please cut and paste the link below into your browser to down load the power point presentation for this Affinity Group Call. There you will also find updated information on news and events within the US Department of Education, White House, and much more.   http://www2.ed.gov/news/av/audio/college-access/index.html

Kentucky Model for College-Readiness of High School Students

<Click on this link to download the entire 62-page report.>

The purpose of this study was to examine Kentucky high school students’ participation and pass rates in college preparatory transition courses, which are voluntary remedial courses in math and reading offered to grade 12 students in the state. Three groups of students were compared using the population of grade 12 students in Kentucky public schools in school year 2011/12 (n=33,928): students meeting state benchmarks, students approaching state benchmarks (1 to 3 points below), and students performing below state benchmarks (4 or more points below). The courses targeted students who were approaching state benchmarks, but all students were eligible to take them. Results were examined for member school districts of the Southeast/South-Central Educational Cooperative (a research partner with Regional Educational Laboratory Appalachia), a matched comparison group of districts with similar characteristics identified through propensity score matching, and the state as a whole. The study found that most students, even those targeted for the intervention, did not participate in the college preparatory transition courses. Among students who were approaching state benchmarks in math, fewer than one-third (28.1 percent) took transition courses, and among students approaching state benchmarks in reading, fewer than one-tenth (8.0 percent) enrolled in transition courses. Despite the intention of the policy, students from all three groups (meeting, approaching, and below state benchmarks) enrolled in the courses. Statewide pass rates for students who did enroll in transition courses in math or reading were more than 90 percent. Examining participation and pass rates can help schools and districts understand how college preparatory transition courses are used and may be adapted to meet the needs of students targeted for intervention.

<Click on this link to download the entire 62-page report.>

New Publication: Understanding the Peer Assisted Learning Model

Since 2006, the PAL program at the University of Minnesopta has contributed to improved academic performance of participating PAL students in rigorous introductory-level college courses.The program is built upon best practices from previous international peer learning models like Supplemental Instruction, Peer-led Team Learning, Emerging Scholars Program, and others.  PAL is also guided by learning theories such as Universal Design for Learning to make the model more culturally-sensitive and embedded within the courses to increase its effectiveness for all students.  Both quantitative and qualitative studies of PAL validate its effectiveness for increasing academic success of participating students and fostering development of personal and social skills.  In addition to benefits for the participants, the PAL experience benefits PAL facilitators through deeper mastery of rigorous course material, increased confidence in public speaking and small group management skills, and encouragement to pursue a teaching career.  While the PAL program was started to address the achievement gap in courses, it has bloomed into one that also enhances personal and professional skills for all that are involved.Built upon principles identified by other academic support programs and innovations of its own creation, PAL is an integral part of UMN’s overall academic support efforts.

Arendale, D. R. (2014). Understanding the Peer Assistance Learning model: Student study groups in challenging college courses. International Journal of Higher Education, 3(2), 1-12. doi:10.5430/ijhe.v3n2p  Retrieved from http://www.sciedu.ca/journal/index.php/ijhe/article/view/4151/2498

<Click on this link to download the article>

Postsecondary Peer Cooperative Learning 2014 Annotated Bibliography

Postsecondcary Peer Cooperative Learning 2014 Annotated Bibliography. Compiled by David Arendale.

<Click on this web link to download the document.>

I just updated my annotated bibliography on peer learning programs.  The bibliography is 160,000 words and 340 pages in length.  It features every article or report published on six of the major peer learning programs in higher education:  Accelerated Learning Groups (developed by Sydney Stansbury at University of Southern California), Emerging Scholars Program (developed by Uri Treisman at UC-Berkeley), Peer-led Team Learning (developed at City Univeristy of New York), Structured Learning Assistance (developed at Ferris State University), Supplemental Instruction (developed at the University of Missouri-Kansas City), and Video-based Supplemental Instruction (developed at UMKC as well).

Peer collaborative learning has been popular in education for decades. As both pedagogy and learning strategy, it has been frequently adopted and adapted for a wide range of academic content areas throughout education at the elementary, secondary, and postsecondary levels due to its benefits. The professional literature is filled with reports of individual professors integrating this approach into postsecondary classrooms in diverse ways. Increased attention has been placed on this practice due to claims by some programs that carefully coordinated and managed learning programs with specific protocols can increase student persistence rates towards graduation, supporting both student goal aspirations as well as bolstering institutional revenues..

This annotated bibliography does not attempt to be inclusive of this broad field of literature concerning peer collaborative learning. Instead, it is focused intentionally on a subset of the educational practice that share a common focus with increasing student persistence towards graduation. At the end of this overview, several suggestions are made for differentiating the models from each other and the level of institutional resources and resolve with implementing them.

The six student peer learning programs included in this bibliography meet the following characteristics: (a) the program must have been implemented at the postsecondary or tertiary level; (b) the program has a clear set of systematic procedures for its implementation that could be replicated by another institution; (c) program evaluation studies have been conducted and are available for review; (d) the program intentionally embeds learning strategy practice along with review of the academic content material; (e) the program outcomes include increased content knowledge, higher final course grades, higher pass rates, and higher college persistence rates; and (f) the program has been replicated at another institution with similar positive student outcomes. From a review of the professional literature six programs emerged: Accelerated Learning Groups (ALGs), Emerging Scholars Program (ESP), Peer-Led Team Learning (PLTL), Structured Learning Assistance (SLA), Supplemental Instruction (SI), and Video-based Supplemental Instruction (VSI). Some of the programs share common history and seek to improve upon previous practices. Other programs were developed independently.

<Click on this web link to download the document.>

An Hour Makes a Difference By Scott Jaschik

For years, studies have found that first-generation college students -- those who do not have a parent with a college degree -- lag other students on a range of education achievement factors. Their grades are lower and their dropout rates are higher. But since such students are most likely to advance economically if they succeed in higher education, colleges and universities have pushed for decades to recruit more of them. This has created "a paradox" in that recruiting first-generation students, but then watching many of them fail, means that higher education has "continued to reproduce and widen, rather than close" an achievement gap based on social class, according to the depressing beginning of a paper forthcoming in the journal Psychological Science. But the article is actually quite optimistic, as it outlines a potential solution to this problem, suggesting that this approach (which involves a one-hour, next-to-no-cost program) can close 63 percent of the achievement gap (measured by such factors as grades) between first-generation and other students.

What is the solution? A one-hour program for new students that is called a "difference-education intervention."
In the program, college juniors and seniors from a range of backgrounds talk about how they adjusted to college, and how they sought out resources and people to help them with decisions, issues they didn't understand and so forth.

First-generation students talked about their specific challenges. For example, one student said something like this: “Because my parents didn’t go to college, they weren’t always able to provide me the advice I needed. So it was sometimes hard to figure out what classes to take and what I wanted to do in the future. But there are other people who can provide that advice, and I learned that I needed to rely on my adviser more than other students.”  To avoid stigmatizing the first-generation students, the programs were described as being for all students, with a range of backgrounds, and the panelists speaking were from a range of backgrounds. And in a control group (which did not see the same results when first-generation students reported on their experiences and success at the end of the academic year), panelists did not relate their adjustments to their own backgrounds.

Among the areas where they found a notable impact from participants in the program: higher grade-point averages and significant increase in the odds of using various campus resources that help students with a range of issues.  The authors of the paper are Nicole M. Stephens, associate professor of management and organizations at the Kellogg School of Management at Northwestern University; MarYam G. Hamedani, associate director of the Center for Comparative Studies in Race and Ethnicity at Stanford University; and Mesmin Destin, assistant professor of psychology at Northwestern University. Their findings are based on a study involving 147 students (who completed the project) at an unnamed private university. First generation was defined as not having a parent with a four-year college degree. Most of the first-generation students (59.1 percent) were recipients of Pell Grants, while this was true only for 8.6 percent of the students with at least one parent with a four-year degree.  Their thesis -- that a relatively modest intervention could have a big impact -- was based on the view that first-generation students may be most lacking not in potential but in savvy about how to deal with the issues that face most college students. They cite past research by several authors to show that this is the gap that must be narrowed to close the achievement gap.

Many first-generation students "struggle to navigate the middle-class culture of higher education, learn the 'rules of the game,' and take advantage of college resources," they write. And this becomes more of a problem when colleges don't talk about the class advantages and disadvantages of different groups of students. "Because U.S. colleges and universities seldom acknowledge how social class can affect students' educational experiences, many first-generation students lack insight about why they are struggling and do not understand how students 'like them' can improve."

Study finds key criteria that determine college success for low-income youth

<Click on this link to download this report.>

A five-year study by UC researchers that included a survey of California youth and interviews with more than 300 young adults about their interactions with educational institutions has identified the five key issues that matter most for understanding and improving college success for low-income students.  The $7.5 million study, “Pathways to Postsecondary Success: Maximizing Opportunities for Youth in Poverty,” spotlights the importance of student voices, an understanding of student diversity, asset-based approaches to education, strong connections between K–12 and higher education, and institutional support for students.  The study was funded by the Bill and Melinda Gates Foundation and was issued by the University of California’s All Campus Consortium on Research For Diversity (UC/ACCORD) at UCLA’s Graduate School of Education and Information Studies (GSE&IS).

“Our study began in 2008, at the onset of a critical economic downturn—the Great Recession—which impacted education and the labor market in considerably complex ways,” said UC/ACCORD director Daniel Solórzano, co-principal investigator on the study and a professor of social sciences and comparative education at GSE&IS. “It was clear the recession had an effect on both colleges and students. Budget cuts slashed enrollments at campuses and decreased the resources for those already enrolled. Many low-income students faced even greater financial instability from the scarcity of work or sudden unemployment of family members.  Therefore, at a time when students’ required additional support to stay on the path through college, the supports and conditions that are vital to their success were disappearing or overburdened on campuses.”

While “Pathways” reports on national data, the study focused on California, which has the largest number of community colleges (112). The vast majority of low-income students in California who pursue post-secondary education begin at community colleges.

Principal findings from the study include:

  • Student voices matter: Education is a powerful force in the lives of low-income youth, and hearing what students say about their experiences is essential to understanding their educational pathways and outcomes. Financial difficulties, lack of available classes, transportation problems and a lack of availability of child care are obstacles to many low-income students’ success. Yet students reported that when they experienced caring educators and high-quality instruction in high school or college, this made a difference in their engagement and success in college.
  • Diversity matters: Low-income youth are a diverse group, and understanding the similarities and differences in this student population enables administrators to better plan college success initiatives. In California, students of color make up the majority of community college enrollment, and many are the first in their family to attend college. Almost half (46 percent) of community college students are older, 54 percent work full-time and 16 percent are parents. “Common understandings of traditional college students may be less relevant as we plan for the growing number of community college students who are working full-time, raising families and have many responsibilities outside of school,” said Amanda L. Datnow, co-principal investigator on the study and a professor of education at UC San Diego. “These students are quickly becoming the majority, and we need to orient around their needs.”
  • Assets matter: Report findings indicate that an asset-based approach helps education administrators tap into and foster students’ strengths in order to support college success. Low-income students enroll and often persist in college, although not always in traditionally defined ways. They arrive with high aspirations to do well and either finish their certificate program or transfer to a four-year college. Successful programs at the colleges affirm and tap into these assets.
  • Connections between K–12 and higher education matter: High-quality K–12 schooling, combined with college preparatory resources, helps ensure college-going success for students. Nationally, 78 percent of low-income youth do not complete a college-preparatory curriculum in high school. In California, 85 percent of community college students require remediation in math and English to complete coursework they should have been taught in high school. Therefore, to ensure college readiness, better articulation between high schools and colleges needs to occur, and students need accurate information about enrollment practices and assessment procedures.
  • Institutional supports and conditions matter: While funding cuts have resulted in reductions in mentoring programs and supports for students, financial difficulties, transportation problems and a lack of child care also frustrate many low-income students’ attempts to fulfill their goals. Low-income students are particularly dependent on financial aid to attend college, and information about resources—including academic and other services—must be integrated and streamlined to make the existing process less complicated and easier to access.

The multi-method study included the development of a monitoring tool to track educational opportunities for low-income youth. It also identified a set of indicators at the organizational level of community college campuses that support student success.

New WWC Quick Review on Daily Online Testing in Large Classes: Boosting College Performance While Reducing Achievement Gaps

This study investigated the effect of daily quizzes on the performance of college students. Students in an introductory psychology course used their own wireless-enabled devices to take short, Internet-based quizzes at the beginning of every class. The quiz items were drawn approximately equally from material covered in the readings and the lectures. The study authors examined impacts of the daily quizzes on student performance in the psychology course, in addition to other classes taken during the same semester and during the semester following the introductory psychology class.

The intervention took place during the fall 2011 semester, and the performance of intervention students was compared to students from the fall 2008 semester. About 50% of the students in the sample were racial/ethnic minorities, and about 60% were female. About 20% of students were first generation college students, and most students were in their first or second year of college.  The study authors reported that there was a nearly statistically significant effect (p = 0.06) of the daily quizzes on student performance in introductory psychology. Specifically, the daily quizzes incorporated 17 items that were also used on tests given during the comparison semester. Students in the daily quiz condition scored higher on these 17 items (77%) than the comparison students (71%). In addition, students in the intervention condition earned higher grades in their other courses during both the fall (3.07 vs. 2.96) and the subsequent spring (3.10 vs. 2.98) semesters. However, it is unknown whether these differences are statistically significant. Finally, the authors reported a statistically significant interaction suggesting that these effects were strongest among lower-middle SES students.  This study is a cohort-based quasi-experiment, and as such could meet WWC evidence standards with reservations. However, more information is needed from the study authors regarding the comparability of the intervention and comparison students at baseline before a rating can be given. A more thorough review (forthcoming) will determine the final study rating and report more fully on the study’s results.

Citation: Pennebaker, J., Gosling, S. D., & Ferrell, J. D. (2013). Daily online testing in large classes: Boosting college performance while reducing achievement gaps. PLoS One 8(11): e79774