Instrument to study rater behaviour: Rater uncertainty and its impact on the quality of assessment in the official language examination, the National Certificates of Language Proficiency (YKI) project

Instrument to study rater behaviour: Rater uncertainty and its impact on the quality of assessment in the official language examination, the National Certificates of Language Proficiency (YKI) project

Description

This research instrument was developed for a study on the uncertainty experienced by language raters and the impact of uncertainty on the quality of assessment in the official language examination, the National Certificates of Language Proficiency. The instrument consists of three online questionnaires using Webropol software and a note-taking sheet using Excel spreadsheet software. The survey focused on the assessment of speaking and writing in the intermediate-level Finnish language examination. The questions in the survey include both closed and open questions. Two almost identical versions of all the questionnaires and the Excel sheet were created for the collection of data for the different survey phases. In the published instrument, the versions are combined and the differences between the original questionnaires are explained. Informal English translations of the research instrument was made after collecting the data.
Show more

Year of publication

2023

Authors

Soveltavan kielentutkimuksen keskus

Honko, Mari Orcid -palvelun logo - Rights holder, Creator

Neittaanmäki, Reeta Orcid -palvelun logo - Rights holder, Creator

Huhta, Ari Orcid -palvelun logo - Creator

University of Utah

Jarvis, Scott Orcid -palvelun logo - Creator

Other information

Fields of science

Languages; Other humanities

Language

English, Finnish

Open access

Open

License

Creative Commons Attribution NonCommercial ShareAlike 4.0 International (CC BY NC SA 4.0)

Keywords

evaluation, language skills

Subject headings

writing, adult language proficiency test, oral language skills, uncertainty, testing