Educational Psychology

James Pustejovsky

Associate Professor, Quantitative Methods Area

pustejovsky@wisc.edu

(608) 262-0842

1082C Educational Sciences

1025 West Johnson St

Madison, WI 53706-1706

Pustejovsky, James

   https://www.jepusto.com  

Dr. Pustejovsky is an applied statistician, whose research aims to solve problems in how quantitative methods are employed in education and social science research. His work involves developing new statistical methodology, building computing tools, and providing guidance about how to use statistical methods in specific research contexts. His main area of scholarly interest is in meta-analysis, which is the set of statistical techniques for quantifying, summarizing, and synthesizing evidence from different sources (such as primary studies conducted by different researchers in different settings) in order to draw general conclusions about a phenomenon. Within meta-analysis, he has worked on problems of synthesizing effects that have an unknown dependence structure, problems of detecting selective reporting (publication bias), and methods for synthesizing the findings of single-case experimental designs. He often collaborates with scholars conducting large-scale research syntheses. Additional interests include causal inference methods, research design, and robust statistical methods.

Education

  • PhD Statistics, Northwestern University, 2013
  • BA Economics, Boston College, 2003

Select Publications

  • Rodgers, M. A., & Pustejovsky, J. E. (2021). Evaluating meta-analytic methods to detect selective reporting in the presence of dependent effect sizes. Psychological Methods, 26(2), 141-160. Online Publication/Abstract, Pre-print.
  • Wahman, C. L., Pustejovsky, J. E., Ostrosky, M. M., & Santos, R. M. (In Press). Examining the effects of social stories on challenging behavior and prosocial skills in young children: A systematic review and meta-analysis. Topics in Early Childhood Special Education Online Publication/Abstract.
  • Pustejovsky, J. E., & Tipton, E. (In Press). Meta-analysis with robust variance estimation: Expanding the range of working models. Prevention Science, forthcoming Online Publication/Abstract, Pre-print.
  • Ledford, J. R., & Pustejovsky, J. E. (In Press). Systematic review and meta-analysis of stay-play-talk interventions for improving social behaviors of young children. Journal of Positive Behavior Interventions Online Publication/Abstract, Pre-print.
  • Pustejovsky, J. E. (2019). Procedural sensitivities of effect sizes for single-case designs with directly observed behavioral outcomes. Psychological Methods, 24(2), 217-235. Online Publication/Abstract.
  • Pustejovsky, J. E., & Rodgers, M. A. (2019). Testing for funnel plot asymmetry of standardized mean differences. Research Synthesis Methods, 10(1), 57-71. Online Publication/Abstract.
  • Swan, D. M., & Pustejovsky, J. E. (2018). A gradual effects model for single-case designs. Multivariate Behavioral Research, 53(4), 574-593. Online Publication/Abstract.
  • Pustejovsky, J. E., & Tipton, E. (2018). Small sample methods for cluster-robust variance estimation and hypothesis testing in fixed effects models. Journal of Business and Economic Statistics, 36(4), 672-683. Online Publication/Abstract.
  • Pustejovsky, J. E. (2018). Using response ratios for meta-analyzing single-case designs with behavioral outcomes. Journal of School Psychology, 68, 99-112. Online Publication/Abstract.

Select Presentations

  • Pustejovsky, J. E. (2021, January). Synthesis of dependent effect sizes: Versatile models through metafor and clubSandwich. presented at the Evidence Synthesis and Meta-Analysis in R Conference. Link
  • Pustejovsky, J. E., & Rodgers, M. A. (2019, July). A generalized excess significance test for selective outcome reporting with dependent effect sizes. Oral Presentation presented at the Society for Research Synthesis Methodology annual meeting, Chicago, IL.
  • Rodgers, M. A., & Pustejovsky, J. E. (2019, July). Evaluating meta-analytic methods to detect selective outcome reporting in the presence of dependent effect sizes. Oral Presentation presented at the Society for Research Synthesis Methodology annual meeting, Chicago, IL.
  • Pustejovsky, J. E. (2019, May). Log response ratio effect sizes: Rationale and methods for single case designs with behavioral outcomes. Oral Presentation presented at the Association for Behavior Analysis International annual convention, Chicago, IL.
  • Pustejovsky, J. E., & English, K. E. (2019, April). Effects of single-sex schools on academic performance: An evaluation of all-girls public schools in Texas. Oral Presentation presented at the American Educational Research Association annual convention, Toronto, Ontario.
  • Pustejovsky, J. E. (2019, March). Small sample cluster-robust variance estimators for two-stage least squares models. Oral Presentation presented at the Society for Research on Educational Effectiveness Conference, Washington, D.C..
  • Furman, G., & Pustejovsky, J. E. (2019, March). Assessing sampling methods for generalization from RCTs: Modeling recruitment and participation. Oral Presentation presented at the Society for Research on Educational Effectiveness Conference, Washington, D.C..
  • Pustejovsky, J. E., Tipton, E., & Aloe, A. (2018, April). Meta-analysis of dependent effect sizes: A review and consolidation of methods. Oral Presentation presented at the American Educational Research Association annual convention, New York, NY.
  • Pustejovsky, J. E., & Furman, G. (2017, April). Heteroskedasticity-robust tests in linear regression: A review and evaluation of small-sample corrections. Oral Presentation presented at the American Educational Research Association annual convention, San Antonio, TX.
  • Pustejovsky, J. E., & Tipton, E. (2016, July). Small-sample methods for cluster-robust variance estimation and hypothesis testing in fixed effects models. Oral Presentation presented at the Joint Statistical Meetings, Chicago, IL.

Select Awards and Honors

  • Early Career Award, Society for Research Synthesis Methodology, 2021
  • Member, Society for Research Synthesis Methodology, (2016-present)
  • Outstanding Quantitative Dissertation, Division D (Measurement and Research Methodology) of the American Educational Research Association, 2014