Papers and Publications

  • Rutkowski, D., Rutkowski, L., & Liaw, Y. (accepted). Tailoring achievement tests to heterogeneous populations: Are latent trait estimates improved? Educational Measurement: Issues and Practice.
  • Rutkowski, D., Rutkowski, L., Wild, J., & Burroughs, N. (2018). Poverty and educational achievement in the U.S.: A less biased estimate using PISA 2012 data. Journal of Children and Poverty, 24(1), 47-67.
  • Rutkowski, D. & Rutkowski, L. (2018). No one likes a bully: How systematic is international bullying and what relationship does it have with mathematics achievement in 4th grade? IEA Compass: Briefs in Education, 1.
  • Liaw, Yuan-Ling, Rutkowski, D., Wu, Yuanyue. & Rutkowski, L. (accepted). Evaluating PISA scales across Chinese economies. Asia Pacific Journal of Education.
  • Rutkowski, L. & Rutkowski, D. (accepted). Methodological challenges to measuring heterogeneous populations internationally. The Sage Handbook on Comparative Studies.
  • Engel, L. & Rutkowski, D. (accepted). Pay to play: What does PISA participation cost in the US? Discourse: Studies in the Cultural Politics of Education.
  • Oliveri, M. E., Rutkowski, D., & Rutkowski, L. (2018). Bridging Validity and Evaluation to Match International Large‐Scale Assessment Claims and Country Aims. ETS Research Report Series.
  • Rutkowski, D. (2018). Improving international assessment through evaluation. Assessment in Education: Principles, Policy & Practice. 25(1). 127-136. https://doi.org/10.1080/0969594X.2017.1300572
  • Sellar, S., Takayama, K. & Rutkowski, D. (2018). Student preparation for large-scale assessments: A comparative analysis. In B. Maddox (Ed). International large-scale assessment in education: Insider research perspectives. London: Bloomsbury Publishing.
  • Rutkowski, L. & Rutkowski, D. (2017). Improving the comparability of international assessments: A look back and a way forward. Scandinavian Journal of Educational Research. https://dx.doi.org/10.1080/00313831.2016.1261044.
  • Sellar, S., Thompson, G., & Rutkowski, D. (2017). The Global Education Race: Taking the Measure of PISA and International Testing. Calgary: Brush Education.
  • Svetina, D. & Rutkowski, L. (2017). Multidimensional measurement invariance in an international context: Fit measure performance with many groups. Journal of Cross-Cultural Psychology, 48(7), 991-1008. https://doi.org/10.1177/0022022117717028

Working Papers and Papers in Progress

  • Rutkowski, L., & Svetina, D. (under review). The impact of collapsing categories on invariance investigations. Manuscript submitted to Structural Equation Modeling.
  • Rutkowski, L. & Rutkowski, D. (in preparation). Methodological challenges to measuring heterogeneous populations internationally. For inclusion in the SAGE Handbook of Comparative Studies in Education.
  • Rutkowski, L. & Matta, T. (in preparation). Design and treatment of missing auxiliary data in large-scale assessments.
  • Matta, T., Rutkowski, L., & Rutkowski, D. (under review). lsasim: An R package for simulating large-scale assessment data. Manuscript submitted to Journal of Statistical Software.
  • Oliveri, M. E., Rutkowski, D., Rutkowski, L. (in progress). Bridging validity & evaluation to help understand ILSA utility, value, and meaning for various stakeholders.
  • Rutkowski, D., Sandoval, A., & Matta, T. (under review). Back to the drawing board: Can we compare background scales. Manuscript submitted to Revista de Educación.

Presentations

Highlights of 2018 Frontiers in Educational Measurement (FREMO) conference in Oslo, Norway

  • Liaw, Y (2018, September). Peculiar subgroup’s aberrance response behavior in multistage adaptive testing: A simulation study. 2018 Frontiers in Educational Measurement: Oslo, Norway.
  • Rutkowski, L. (2018, September). Can multistage testing bridge the cultural measurement divide? 2018 Frontiers in Educational Measurement: Oslo, Norway.
  • Mughogho, K. (2018, September). IRT model specification’s impact on subscale score estimation in international large scale assessments. Poster session presented at the 2018 Frontiers in Educational Measurement: Oslo, Norway.
  • Rutkowski, L. (2018, July). Increased heterogeneity in international assessments and associated measurement challenges. Invited keynote talk at 2018 International Test Commission annual meeting: Montreal, Quebec.
  • Rutkoski, L., Rutkowski, D., & Liaw, Y. L., (2018, April). Tailored booklets: Improved estimates of latent traits in large-scale assessment? 2018 National Council on Measurement in Education Meeting: Ney York, NY.
  • Rutkowski, L. von Davier, M., & Rutkowski, D. (2018). Advances in measurement and research methodology of large-scale assessments (AERA Division D Awardee Presentation). 2018 American Educational Research Association Meeting: New York, NY.
  • Rutkowski, L. (2018, April). Comments on International Education Assessments: Cautions, Conundrums, and Common Sense. 2018 National Academy of Education Methods and Policy Uses of International Large-Scale Assessments Meeting: Washington, DC.
  • Rutkowski, D. (2018, April). Assessing global competency with diverse populations. ULead Conference, Banff, Canada.
  • Rutkowski, D. (2018, April). International assessment and personal learning. Twin Peaks Conference, Banff, Canada.
  • Rutkowski, D. (2018, April). The international math wars. Calgary public teachers. Calgary, Canada.
  • Rutkowski, L. (2018). Comments on International Education Assessments: Cautions, Conundrums, and Common Sense. 2018 National Academy of Education Methods and Policy Uses of International Large-Scale Assessments Meeting: Washington, DC.
  • Rutkowski, D. (2018, April). International assessment and personal learning. Twin Peaks Conference, Banff, Canada.
  • Rutkowski, D. (2018, April). The international math wars. Calgary public teachers. Calgary, Canada.
  • Rutkowski, D. (2018, March). The impact of floor effects in PISA for low-performing countries. CIES 2018. Mexico City, Mexico.
  • Rutkowski, D. (2018, February). Primer on standardized assessment and why this is a contested space. Keynote session: School Leadership: Supporting Sound Assessment in the era of Datafication, Red Deer, Alberta Canada.
  • Rutkowski, D. (2017, December). The global education race. Norwegian Teacher’s Union, Oslo, Norway.
  • Rutkowski, D. (2017 July). A call for a more measured approach to reporting and interpreting PISA results.  University of Bath, UK.
  • Rutkowski, L. (2017, March). Methodological challenges to measuring heterogeneous populations internationally. 2017 Comparative and International Education Society Conference: Atlanta, Georgia.
  • Rutkowski, D (2017, February). TIMSS and PISA: Different tests, different purposes. Same policies? Seminar on Large Scale Assessment. Educational Research Institute. Ljublijana, Slovenia.
  • Rutkowski, D. (2016, November). Problematizing PISA: Widening the debate about international large-scale assessments. Canadian Teacher’s Association Annual Meeting.

Conferences

American Educational Research Association (AERA)/ National Council on Measurement in Education (NCME), 2018 – New York, New York

  • Rutkowski, L. von Davier, M., & Rutkowski, D. (2018). Advances in measurement and research methodology of large-scale assessments (AERA Division D Awardee Presentation). 2018 American Educational Research Association Meeting: New York, NY.
  • Rutkowski, L., Rutkowski, D., & Liaw, Y.L., (2018, April). Tailored booklets: Improved estimates of latent traits in large-scale assessment? 2018 National Council on Measurement in Education Meeting: New York, NY.

International Meeting of the Psychometric Society, 2017 – Zurich, Switzerland (https://www.psychometricsociety.org/)

  • Missing Data in Large-Scale Educational Assessments, Chair: Tyler Matta

Rutkowski, L., Matta, T. (July, 2017). Design and treatment of missing auxiliary data in large-scale assessments.

Robitzsch, A., Lüdtke, O. (July, 2017). An item response model for omitted responses in performance tests.

Grund, S., Lüdtke, O., Robitzsch, A. (July, 2007). Imputation of missing data at level 2 using plausible values.

Matta, T. (March, 2017). Assessing missing data assumptions using posterior predictive checks. .

7th IEA International Research Conference, 2017 – Prague, Czech Republic (http://www.iea.nl/7th-iea-international-research-conference)

  • Embracing Heterogeneity in International Large Scale Assessments Symposium

Sandoval-Hernandez, A., Rutkowski, D., & Matta, T. (June, 2017). Back To The Drawing Board: Can We Compare Background Scales?

Rutkowski, L., Svetina, D., & Liaw, Y. L. (June, 2017). The Impact of Arbitrary Collapsing Choices in Categorical MG-CFA: A Look at Model Fit and Reliability.

Oliveri, M. E., Rutkowski, D., & Rutkowski, L. (June, 2017). Bridging Validity & Evaluation to Help Understand ILSA Utility, Value, and Meaning For Various Stakeholders.

Matta, T., Rutkowski, L., Rutkowski, D., & Liaw, Y. L. (June, 2017). lsasim: An R Package for Simulating Large-Scale Assessment Data.

Comparative and International Education Society Annual Conference, 2017 – Atlanta, Georgia (http://www.cies2017.org/)

Trevino, E., Inostroza, P., & Sandoval-Hernandez, A. (March, 2017). Evaluating measurement invariance in international large-scale assessments.

Miranda, D., Castillo, J., & Sandoval-Hernandez, A. (March, 2017). Young citizens participation: An emprical test of a conceptual model.

Rutkowski, L. (March, 2017). Methodological challenges to measuring heterogeneous populations internationally.