Improving assessment processes in Higher Education: Student and teacher perceptions of the effectiveness of a rubric embedded in a LMS

Students and teachers play different roles and thus have different perceptions about the effectiveness of assessment including structure, feedback, consistency, fairness and efficiency. In an undergraduate Business Information Systems course, a rubric was designed and semi-automated through a learning management system (LMS) to provide formative feedback. Action research with a qualitative approach was undertaken by the teacher. A questionnaire was administered to the 55 students to gather their perceptions of the effectiveness of the process. Students reported benefits of clearly being able to see what they needed to do, what they had achieved, and what they needed to do to improve. The majority (95%) recommended further use of the rubric process. From the teacher's perspective, a key benefit was an estimated 40% reduction in marking time and improved student satisfaction with feedback. An insight from the student feedback and teacher reflection was that there is a balance between providing clear detailed structure versus challenging students with freedom to deal with the ambiguity of open ended issues. The study provides practical insights for further roll-out of assurance of learning initiatives based on rubrics embedded in LMSs, and contributes a model for further research into student and teacher perceptions of assessment effectiveness.

• Publication year

  2013

• Venue

  Australasian Journal of Educational Technology

• Publication date

  2013-11-08

• Fields of study

  Business, Computer Science, Education, Psychology

• Identifiers
  DOI 10.14742/AJET.526
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Planning Programs for Adult Learners: A Practical Guide for Educators, Trainers, and Staff Developers (2nd edition)

  2013cited by this paper
• A Preliminary Investigation into Technology and Processes Facilitating the Assurance of Learning

  2012cited by this paper
• Developing a research design for comparative evaluation of marking and feedback support systems

  2012cited by this paper
• Investigating Factors Affecting the Uptake of Automated Assessment Technology

  2011cited by this paper
• Influence of teachers’ perceptions of teaching and learning on the implementation of Assessment for Learning in inquiry study

  2011influential reference
• Using technology to encourage student engagement with feedback: a literature review

  2011cited by this paper
• An Evaluation of Semi-Automated, Collaborative Marking and Feedback Systems: Academic Staff Perspectives.

  2011cited by this paper
• Rubric-Referenced Assessment in Teacher Preparation: An Opportunity to Learn by Using.

  2010cited by this paper
• Feedback : all that effort, but what is the effect?

  2010cited by this paper
• Academic Analytics and Data Mining in Higher Education

  2010cited by this paper
• Beyond feedback: developing student capability in complex appraisal

  2010cited by this paper
• Computer-Assisted Grading Rubrics: Automating the Process of Providing Comments and Student Feedback

  2009cited by this paper
• Self-Assessment Through Rubrics

  2008cited by this paper
• Student perceptions and use of an assessment rubric for a group concept map in physiology.

  2008cited by this paper
• Improving the Efficiency and Effectiveness of Grading Through the Use of Computer-Assisted Grading Rubrics

  2008influential reference
• A Tale of Two Rubrics: Improving Teaching and Learning Across the Content Areas through Assessment

  2008cited by this paper
• A Critical Assessment of Information Systems Action Research

  2007cited by this paper
• Evaluating and Enhancing Outcomes Assessment Quality in Higher Education Programs

  2007cited by this paper
• Student perspectives on rubric-referenced assessment

  2005cited by this paper
• AUTOMATED RUBRIC GENERATION AND ANALYSIS FOR ASSURANCE OF LEARNING TASKS

  2005cited by this paper
• Accuracy in the scoring of writing: Studies of reliability and validity using a New Zealand writing assessment system

  2004cited by this paper
• Grading for Speed, Consistency, and Accuracy

  2003cited by this paper
• Organisational Development and Change

  2003cited by this paper
• A Diet for Action Research: An Integrated Problem & Appreciative Focuses Approach to Organization Development

  2000cited by this paper
• Qualitative data analysis (2nd ed): Mathew B. Miles and A. Michael Huberman. Thousand Oaks, CA: Sage Publications, 1994. Price: $65.00 hardback, $32.00 paperback. 238 pp

  1996cited by this paper
• Planning Programs for Adult Learners: A Practical Guide

  1994cited by this paper
• Experiential Learning: Experience as the Source of Learning and Development

  1983cited by this paper
• An Assessment of the Scientific Merits of Action Research.

  1978cited by this paper
• Standardized Developmental Ratings.

  1978cited by this paper
• Frontiers in Group Dynamics

  1947cited by this paper
• Frontiers in Group Dynamics

  1947cited by this paper

• The analytic use of rubrics in writing classes by language students in an EFL context: students’ writing model and benefits

  2025cites this paper
• LMS-Based Assessment and Islamic Pedagogy: A Qualitative Case Study in an Indonesian Private University

  2025cites this paper
• Améliorer l’enseignement et l’évaluation des compétences professionnelles : collaboration entre universitaires et professionnels dans une démarche de recherche-action 

  2024cites this paper
• Digital Learning Transformation: The Impact of a Learning Management System-Based E-Book on Classical Assumption Tests in Statistics Courses

  2024cites this paper
• Exploring Feedback Design Perceptions and Relationships with Scores in the Online Component of an EAP-Blended Course

  2024cites this paper
• Assessing creative outcomes in studio-based learning: a comparative assessment of analytical rubrics

  2024cites this paper
• Recontextualising the Unified Theory of Acceptance and Use of Technology (UTAUT) Framework to Higher Education Online Marking

  2024cites this paper
• Factors Influencing Intention to Use Mobile Learning: A Quantitative Study in Higher Education

  2024cites this paper
• Checkbox grading of handwritten mathematics exams with multiple assessors: how do students react to the resulting atomic feedback? A mixed-method study

  2024cites this paper
• Developing an Exam Assessment Website Based Application for Assurance of Learning at One of Universities in Indonesia

  2023cites this paper
• Effectiveness of Lecturer Development Programs in the Context of Higher Education Management

  2023cites this paper
• Exploring the Transformative Potential of Machine Learning in Engineering and STEM Education: A Comprehensive Study on Enhancing Cognitive Levels and Learning Insights

  2023cites this paper
• Learning management system empowered by machine learning

  2022cites this paper
• Perceived convenience, usefulness, effectiveness and user acceptance of information technology: evaluating students’ experiences of a Learning Management System

  2022cites this paper
• Factor structures associated with online student engagement in campus-based blended and online distance education settings

  2022cites this paper
• Students’ Perceptions of Instructional Rubrics in Neurological Physical Therapy and Their Effects on Students’ Engagement and Course Satisfaction

  2021cites this paper
• Learning in Practice

  2021cites this paper
• Can assessment-specific marking criteria and electronic comment libraries increase student engagement with assessment and feedback?

  2021influential citation
• Rubrics as Tools for Effective Assessment of Student Learning and Program Quality

  2021cites this paper
• Learning Management System‐Integrated Spreadsheet Exercises for Facility Location Modeling

  2021cites this paper
• Flipped Classroom and Aronson´s Puzzle: a Combined Evaluation in the Master´s Degree in Preuniversitary Teaching

  2021cites this paper
• Online Learning for Mathematically Talented Students: A Perspective from Hong Kong

  2021cites this paper
• Gathering evidence on e-rubrics: Perspectives and many facet Rasch analysis of rating behavior

  2021cites this paper
• Rúbrica como Instrumento para la Evaluación de Trabajos Fin de Grado

  2021cites this paper
• Towards Consistent and Fair Assessment Practice of Students’ Subjective Writing

  2020cites this paper
• Confirming the Factor Structure of a Research-Based Mid-Semester Evaluation of College Teaching

  2020cites this paper
• Investigation to Improve Timeliness and Quality of Assessment Feedback using a Custom Application

  2020cites this paper
• Evaluating a Peer Assessment Approach in Introductory Programming Courses

  2020cites this paper
• Use of a marking rubric and self-assessment to provide feedforward to level 5 undergraduate Sport students: student perceptions, performance and marking efficiency

  2020influential citation
• Exploring the Use of Rubrics as a Self Assessment Tool for Pre-service Teachers

  2020cites this paper
• TAHAPAN DESAIN ANDROID BASED TEST PADA PROGRAM STUDI PENDIDIKAN KELAUTAN DAN PERIKANAN

  2020cites this paper
• An online inclusive early childhood education approach at a Southwestern University: a follow-up graduate programme

  2019cites this paper
• Good and bad practices in rubrics: the perspectives of students and educators

  2019cites this paper
• Improving Teaching and Learning From High-Level and Close-In Features of Assignments and Assessments in an LMS Instance

  2019cites this paper
• Assessment of Learning in Higher Education

  2019cites this paper
• An undergraduate inclusive teacher preparation programme in early childhood education: an online delivery approach

  2019cites this paper
• Students' Learning Experiences towards the Use of Assessments in a Virtual Learning Environment (VLE)

  2019cites this paper
• Biografía de la implantación de los Trabajos de Fin de Grado en una Facultad de Sociología: incertidumbres, triangulación metodológica e implicaciones prácticas

  2018cites this paper
• A Contribution to Conveying Quality Criteria in Mechanical CAD Models and Assemblies through Rubrics and Comprehensive Design Intent Quantification

  2018cites this paper
• Student Engagement with Rubrics to Promote Enhanced Written Communication of Health Information

  2018cites this paper
• Student Engagement with Rubrics to Promote Enhanced Written Communication of Health Information

  2018cites this paper
• Supporting Learners' Agentic Engagement With Feedback: A Systematic Review and a Taxonomy of Recipience Processes

  2017cites this paper
• How technology shapes assessment design: Findings from a study of university teachers

  2017cites this paper
• Promoting Literacy with Teacher Knowledge in Analyzing and Using Student Data: A Review of Literature

  2017influential citation
• Creating first-year assessment support: lecturer perspectives and student access*

  2017cites this paper
• Student Awareness and Use of Rubrics in Online Classes

  2017cites this paper
• Web-Based System for Adaptable Rubrics: Case Study on CAD Assessment

  2017cites this paper
• Teacher training model — Towards a collaborative rubric bank

  2017cites this paper
• Using Internet based paraphrasing tools: Original work, patchwriting or facilitated plagiarism?

  2017cites this paper
• Diverse delivery methods and strong psychological benefits: A review of online formative assessment

  2017cites this paper
• Guía del Trabajo Fin de Grado (TFG): Grado en Enfermería

  2016cites this paper
• An Investigation of a Two-Tier Test Strategy in a University Calculus Course: Causes versus Consequences

  2016cites this paper
• Study of a Pedagogy Adopted to Generate Interest in Students Taking a Programming Course

  2016cites this paper
• Investigación e Innovación Educativa en Docencia Universitaria. Retos, Propuestas y Acciones

  2016cites this paper
• University Students' Perceptions of Electronic Rubric-Based Assessment.

  2016cites this paper
• Processus de coconstruction d’une grille critériée pour l’évaluation de productions écrites complexes à l’université

  2016influential citation
• A Conceptual Framework to Assess the Effectiveness of Rubric Tool

  2016influential citation
• Standard Work in Higher Education: Creating Rubrics to Improve Student Success

  2015cites this paper
• Using models with rubrics as a form of assessment in astronomy and biology

  2015cites this paper
• Rubrics on the Fly: Improving Efficiency and Consistency with a Rapid Grading and Feedback System

  2015cites this paper
• Perceptions on Project-Based Assessment Rubrics: A Rubric Design for Indonesian School Contexts

  2015cites this paper
• Propuesta para una doble evaluación triádica del Prácticum del Máster de Educación Secundaria = Proposal for a double triadic evaluation of Secondary teachers’ in-training

  2015cites this paper
• Compromiso del estudiante y percepción del proceso evaluador basado en rúbricas

  2014cites this paper
• Using technology for student feedback: Lecturer perspectives

  2014cites this paper
• La evaluación del aprendizaje en red mediante blogs y rúbricas: ¿complementos o suplementos?

  2014cites this paper
• Computer-Assisted Rubric Evaluation: Enhancing Outcomes and Assessment Quality

  2014cites this paper
• Six Instructional Best Practices for Online Engagement and Retention

  2014cites this paper
• Quality Considerations in the Design and Implementation of an Online Doctoral Program

  2014cites this paper
• ASSESSMENT OF STUDENT COMPETENCE USING ELECTRONIC RUBRIC

  2012cites this paper
• ELECTRONIC RUBRIC: EVALUATION TOOL IN THE ASSESSMENT PROCESS IN VOCATIONAL EDUCATION

  year unknowncites this paper