Monte Carlo evaluations of methods of grade distribution in group projects: simpler is better

Sebastián G. Guzmán

Resultado de la investigación: Article

Resumen

Group projects are widely used in higher education, but they can be problematic if all group members are given the same grade for a project to which they might not have contributed equally. Most scholars recommend addressing these problems by awarding individual grades, computing some kind of individual weighting factor (IWF) from peer and (sometimes) self-assessments, which is then multiplied by the group grade to generate an individual grade. Several variants of the IWF method have been proposed, sometimes with complex algorithms. However, theory suggests they are inaccurate and their accuracy has not been evaluated. This article uses Monte Carlo experiments to assess the accuracy of the original IWF method and variants proposed in the past decade. Findings show that the earlier, simpler methods work best and that self-assessments should definitely be avoided.

Idioma originalEnglish
Páginas (desde-hasta)1-15
Número de páginas15
PublicaciónAssessment and Evaluation in Higher Education
DOI
EstadoAccepted/In press - 25 ene 2018
Publicado de forma externa

Huella dactilar

project group
weighting
evaluation
self-assessment
group membership
experiment
education
Group

ASJC Scopus subject areas

  • Education

Citar esto

@article{34835cb939444e1fb45aa9e7eacbf8ed,
title = "Monte Carlo evaluations of methods of grade distribution in group projects: simpler is better",
abstract = "Group projects are widely used in higher education, but they can be problematic if all group members are given the same grade for a project to which they might not have contributed equally. Most scholars recommend addressing these problems by awarding individual grades, computing some kind of individual weighting factor (IWF) from peer and (sometimes) self-assessments, which is then multiplied by the group grade to generate an individual grade. Several variants of the IWF method have been proposed, sometimes with complex algorithms. However, theory suggests they are inaccurate and their accuracy has not been evaluated. This article uses Monte Carlo experiments to assess the accuracy of the original IWF method and variants proposed in the past decade. Findings show that the earlier, simpler methods work best and that self-assessments should definitely be avoided.",
keywords = "group projects, individual weighting factor, Monte Carlo, Peer assessment, self-assessment",
author = "Guzm{\'a}n, {Sebasti{\'a}n G.}",
year = "2018",
month = "1",
day = "25",
doi = "10.1080/02602938.2017.1416457",
language = "English",
pages = "1--15",
journal = "Assessment and Evaluation in Higher Education",
issn = "0260-2938",
publisher = "Taylor and Francis Ltd.",

}

TY - JOUR

T1 - Monte Carlo evaluations of methods of grade distribution in group projects

T2 - simpler is better

AU - Guzmán, Sebastián G.

PY - 2018/1/25

Y1 - 2018/1/25

N2 - Group projects are widely used in higher education, but they can be problematic if all group members are given the same grade for a project to which they might not have contributed equally. Most scholars recommend addressing these problems by awarding individual grades, computing some kind of individual weighting factor (IWF) from peer and (sometimes) self-assessments, which is then multiplied by the group grade to generate an individual grade. Several variants of the IWF method have been proposed, sometimes with complex algorithms. However, theory suggests they are inaccurate and their accuracy has not been evaluated. This article uses Monte Carlo experiments to assess the accuracy of the original IWF method and variants proposed in the past decade. Findings show that the earlier, simpler methods work best and that self-assessments should definitely be avoided.

AB - Group projects are widely used in higher education, but they can be problematic if all group members are given the same grade for a project to which they might not have contributed equally. Most scholars recommend addressing these problems by awarding individual grades, computing some kind of individual weighting factor (IWF) from peer and (sometimes) self-assessments, which is then multiplied by the group grade to generate an individual grade. Several variants of the IWF method have been proposed, sometimes with complex algorithms. However, theory suggests they are inaccurate and their accuracy has not been evaluated. This article uses Monte Carlo experiments to assess the accuracy of the original IWF method and variants proposed in the past decade. Findings show that the earlier, simpler methods work best and that self-assessments should definitely be avoided.

KW - group projects

KW - individual weighting factor

KW - Monte Carlo

KW - Peer assessment

KW - self-assessment

UR - http://www.scopus.com/inward/record.url?scp=85040968110&partnerID=8YFLogxK

U2 - 10.1080/02602938.2017.1416457

DO - 10.1080/02602938.2017.1416457

M3 - Article

AN - SCOPUS:85040968110

SP - 1

EP - 15

JO - Assessment and Evaluation in Higher Education

JF - Assessment and Evaluation in Higher Education

SN - 0260-2938

ER -