Open educational resources (OER), which are free and openly licensed educational materials, have been a widely discussed topic in response to high textbook costs, the need for more pedagogical flexibility, and inequality in access to educational materials. In this study we examine the efficacy of OER through a quantitative analysis of the impact of OER on student final exam performance in a large calculus course. Our dataset affords us a relatively large sample size, allows us to classify students in both treatment and control groups, and includes a variety of covariates that allow us to control for multiple correlated factors. We estimate causal treatment effects using several econometric approaches. Our study adds the following insights into the research on OER efficacy: (i) OER materials do not, in general, lead to any significant change in student final exam performance; and (ii) OER materials have a significantly positive impact on both international students and Pell Grant eligible students.
- open educational resources,
- teaching calculus,
- treatment effects,
- Bowen, W. G., Chingos, M. M., Lack, K. A., & Nygren, T. I. (2014). Interactive learning online at public universities: evidence from a six-campus randomized trial. Journal of Policy Analysis and Management, 33, 94-111.
- California OER Council. (2016). OER adoption study: Using open educational resources in the college classroom (White paper). California Open Educational Resources Council. Retrieved from https://docs.google.com/document/d/1sHrLOWEiRs-fgzN1TZUlmjF36BLGnICNMbTZIP69WTA
- Colvard, N. B., Watson, C. E., & Park, H. (2018). The Impact of Open Educational Resources on Various Student Success Metrics. International Journal of Teaching and Learning in Higher Education, 30(2), 262-276.
- Feldstein, A., Martin, M., Hudson, A., Warren, K., Hilton, J., & Wiley, D. (2012). Open textbooks and increased student access and outcomes. European Journal of Open, Distance and E-Learning, 15(2), 1-9. Retrieved from https://eric.ed.gov/?id=EJ992490
- Florida Virtual Campus. (2016, October 7). 2016 Florida student textbook and course materials survey. The Orange Grove. Retrieved from https://florida.theorangegrove.org/og/items/3a65c507-2510-42d7-814c-ffdefd394b6c/1/
- Grewe, K., & Davis, W. P. (2017). The impact of enrollment in an OER course on student learning outcomes. The International Review of Research in Open and Distributed Learning, 18(4). Retrieved from http://www.irrodl.org/index.php/irrodl/article/view/2986/4211
- Gurung, R. A. R. (2017). Predicting learning: Comparing an open education research and standard textbooks. Scholarship of Teaching and Learning, 3, 233-249.
- Hewlett (2017). Open educational resources (Blog post). Retrieved from http://www.hewlett.org/strategy/open-educational-resources/
- Hilton, J. (2016). Open educational resources and college textbook choices: A review of research on efficacy and perceptions. Educational Technology Research and Development, 64(4), 73-590. Retrieved from https://link.springer.com/article/10.1007/s11423-016-9434-9
- Hilton, J., Fischer, L., Wiley, D., & Williams, L. (2016). Maintaining momentum toward graduation: OER and the course throughput rate. International Review of Research in Open and Distance Learning, 17(6). Retrieved from http://www.irrodl.org/index.php/irrodl/article/view/2686
- Hilton, J., & Laman, C. (2012). One college's use of an open psychology textbook. Open Learning: The Journal of Open, Distance and e-Learning, 27(3), 265-272.
- Jhangiani, R. S., Pitt, R., Hendricks, C., Key, J., & Lalonde, C. (2016). Exploring faculty use of open educational resources at British Columbia post-secondary institutions. BCcampus Research Report. Victoria, BC: BCcampus. Retrieved from https://bccampus.ca/files/2016/01/BCFacultyUseOfOER_final.pdf
- Imbens, G. W., & Rubin, D. B. (2015). Causal inference for statistics, social, and biomedical sciences. New York: Cambridge University Press.
- Li, Q., & J. S. Racine (2007). Nonparametric econometrics: Theory and practice. New Jersey: Princeton University Press.
- Lovett, M., Meyer, O. & Thille, C. (2008). The open learning initiative: Measuring the effectiveness of the OLI statistics course in accelerating student learning. Journal of Interactive Media in Education, 1, 1-16. Retrieved from https://jime.open.ac.uk/articles/10.5334/2008-14/
- Ozdemir, O., & Hendricks, C. (2017). Instructor and student experiences with open textbooks, from the California open online library for education (Cool4Ed). Journal of Computing in Higher Education, 29(1), 98-113. Retrieved from https://link.springer.com/article/10.1007/s12528-017-9138-0
- Pawlyshyn, N., Braddlee, Casper, L., & Miller, H. (2013). Adopting OER: a case study of cross-institutional collaboration and innovation. EDUCAUSE Review. Retrieved from https://er.educause.edu/articles/2013/11/adopting-oer-a-case-study-of-crossinstitutional-collaboration-and-innovation
- Robinson, T. J. (2015). The effects of open educational resource adoption on measures of post- secondary student success (Doctoral dissertation). Available from BYU ScholarsArchive. (Accession No. 5815)
- Watson, C. E., Domizi, D. P., & Clouser, S. A. (2017). Student and faculty perceptions of OpenStax in high enrollment courses. The International Review of Research in Open and Distributed Learning, 18(5). Retrieved from http://www.irrodl.org/index.php/irrodl/article/view/2462/4299