ALTAANZ
  • About ALTAANZ
  • ALTAANZ Committee
    • Current Committee
    • 2021 Committee
    • 2020 ALTAANZ Committee
    • 2018 - 2019 ALTAANZ Committee
    • 2017 ALTAANZ Committee
    • 2016 ALTAANZ Committee
    • 2015 ALTAANZ Committee
    • 2014 ALTAANZ Committee
    • 2013 ALTAANZ Committee
    • 2012 ALTAANZ Committee
    • 2011 ALTAANZ Committee
  • Joining ALTAANZ
  • ALANZ - ALAA - ALTAANZ 2022
  • ALTAANZ Online Research Forum 2021
  • LTRC/ALTAANZ Online Celebratory event 2020
    • About the event
    • Event Programme
    • LTRC Anniversary Symposium
  • Past ALTAANZ Conferences
    • ALANZ / ALAA / ALTAANZ AUCKLAND 2017
    • ALTAANZ Conference Auckland 2016 >
      • Keynote Speakers >
        • Plenary Abstracts
      • Teachers' Day
      • Pre-conference workshops
      • Conference programme
    • ALTAANZ Conference Brisbane 2014
    • ALTAANZ Conference Sydney 2012
  • Past ALTAANZ / LTRC Workshops
    • LTRC / ALTAANZ Workshops July 2014 >
      • Test analysis for teachers
      • Diagnostic assessment in the language classroom
      • Responding to student writing
      • Assessing Pragmatics
      • Introduction to Rasch measurement
      • Introduction to many-facet Rasch measurement
    • LTRC / ALTAANZ workshops September 2015 >
      • A Practical Approach to Questionnaire Construction for Language Assessment Research
      • Integrating self- and peer-assessment into the language classroom
      • Implementing and assessing collaborative writing activities
      • Assessing Vocabulary
      • Revisiting language constructs
  • Studies in Language Assessment (formerly PLTA)
    • Early View Articles
    • Current Issue
    • About SiLA
    • Past Issues >
      • 2022
      • 2021
      • 2020
      • 2019
      • 2018
      • 2017
      • 2016
      • 2015
      • 2014
      • 2013
      • 2012
    • Editorial Board
    • Contributors
  • ALTAANZ Awards
    • ALTAANZ Best Student Paper Award
    • Penny McKay Award
    • PLTA Best Paper Award
  • Sponsorship for Educational Activities
  • Newsletter: Language Assessment Matters
  • Contact us
Contextualised judgements: A comparison of the rating criteria used to judge oral presentations in higher education and speaking performances in the TOEFL iBTTM 
Ana Maria Ducasse, RMIT University, Melbourne, Australia
Annie Brown,  ACER, Camberwell, Australia

https://doi/10.0000/0000
Volume 9, Issue 2, 2020
Abstract: This study investigates assessment within oral academic assessment tasks, specifically focusing on the criteria used by discipline specialists and comparing them with those used to assess performance on TOEFL iBTTM speaking tasks. Three pairs of tutors from three faculties took part in verbal report sessions where they watched, rated and discussed the performances of ten native and ten non-native students completing first-year university oral assessment tasks in their discipline. The verbal report sessions were audio recorded, transcribed and segmented into meaning-based units prior to thematic analysis. The features which emerged from the analysis were compared with those described within the TOEFL speaking rubrics. The analysis found that while there were some broad similarities in the focus there were also marked differences. Two of the three TOEFL strands (delivery and content) were well-represented in the academic tasks assessments rubrics and tutor discussion. However, the quality of the non-native students’ language was only of concern when it was perceived as interfering with the student’s ability to communicate. An additional focus in the assessment of university tasks was the use of academic skills, prompts and aids, non-verbal communication and engagement with the audience. ​
Keywords: TOEFL iBTTM speaking, speaking rubrics, oral assessment tasks, academic skills, non-verbal communication 
Click to download Full Text