An investigation of the cross-mode comparability of a paper and computer-based multiple-choice cloze reading assessment for ESL learners
department or school: Education, Faculty of
department or school: Language and Literacy Education (LLED), Department of
data provider: DSpace
degree campus: UBCV
creator: Odo, Dennis Murphy
issued: 2012-04-19T16:53:57Z
issued: 2012
related degree: Doctor of Philosophy - PhD
degree grantor: University of British Columbia
description: This study was designed to determine whether a computer-based version of a standardized cloze reading test for second language learners is comparable to its traditional paper-based counterpart and to identify how test takers’ computer familiarity and perceptions of paper and computer-based tests related to their performance across testing modes. Previous comparability research for second language speakers revealed that some studies found that the two forms are comparable while others found they are not. Findings on the connection between computer attitudes and computer test performance were also mixed. One hundred and twenty high school ELL students were recruited for the study. The research instruments included both paper and computer-based versions of a locally developed reading assessment. The two tests are the same in terms of content, questions,pagination and layout. The design was a Latin squares so that two groups of learners took the tests in the opposite order and their scores were compared. Participants were also asked to complete questionnaires about their familiarity with computers and their perceptions of each of the two testing modes. Results indicate that the paper and computer-based versions of the test are comparable. A regression analysis showed that there is a relationship between computer familiarity and computer-based LOMERA performance. Mode preference survey data pointed to differences in preferences depending on each unique test feature. These results help validate the cross-mode comparability of assessments outside of the traditional discrete point multiple choice tests which tends to predominate in current research.
aggregated CHO: https://circle.library.ubc.ca/rest/handle/2429/42086
note: AN INVESTIGATION OF THE CROSS-MODE COMPARABIITY OF A PAPER AND COMPUTER-BASED MULTIPLE-CHOICE CLOZE READING ASSESSMENT FOR ESL LEARNERS by Dennis Murphy Odo B.A. (Hon.), St. Francis Xavier University, 1999 M.A., University of Leicester, 2005 M.S.Ed., D’Youville College, 2007 A THESIS SUBMITTED IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY in THE FACULTY OF GRADUATE STUDIES (Language and Literacy Education) THE UNIVERSITY OF BRITISH COLUMBIA (Vancouver) April 2012 © Dennis Murphy Odo, 2012 ii Abstract This study was designed to determine whether a computer-based version of a standardized cloze reading test for second language learners is comparable to its traditional paper-based counterpart and to identify how test takers’ computer familiarity and perceptions of paper and computer-based tests related to their performance across testing modes. Previous comparability research for second language speakers revealed that some studies found that the two forms are comparable while others found they are not. Findings on the connection between computer attitudes and computer test performance were also mixed. One hundred and twenty high school ELL students were recruited for the study. The research instruments included both paper and computer-based versions of a locally- developed reading assessment. The two tests are the same in terms of content, questions, pagination and layout. The design was a Latin squares so that two groups of learners took the tests in the opposite order and their scores were compared. Participants were also asked to complete questionnaires about their familiarity with computers and their perceptions of each of the two testing modes. Results indicate that the paper and computer-based versions of the test are comparable. A regression analysis showed that there is a relationship between computer familiarity and computer-based LOMERA performance. Mode preference survey data pointed to differences in preferences depending…
has type: Thesis/Dissertation
date issued: 2012-05
is shown at: 10.14288/1.0072746
language: eng
degree discipline: Language and Literacy Education
provider: Vancouver : University of British Columbia Library
publisher: University of British Columbia
rights: Attribution-NonCommercial-NoDerivatives 4.0 International
rights URI: http://creativecommons.org/licenses/by-nc-nd/4.0/
scholar level: Graduate
type: Text
identifier URI: http://hdl.handle.net/2429/42086