Cover image for Testing ESL Sociopragmatics Development and Validation of a Web-based Test Battery.
Testing ESL Sociopragmatics Development and Validation of a Web-based Test Battery.
Title:
Testing ESL Sociopragmatics Development and Validation of a Web-based Test Battery.
Author:
Roever, Carsten.
ISBN:
9783653045987
Personal Author:
Publication Information:
Frankfurt : Peter Lang GmbH, Internationaler Verlag der Wissenschaften, 2014.
Physical Description:
1 online resource (184 pages)
General Note:
11 References.
Contents:
Cover; Acknowledgments; Contents; Figures; Tables; 1 Introduction ; 2 Pragmatics: The lay of the land ; 2.1 The content of pragmatics: Speech acts et al. ; 2.2 Context in pragmatics ; 2.3 What language users know: Sociopragmatic and pragmalinguistic knowledge; 2.4 Applied pragmatics: Cross-cultural and interlanguage pragmatics; 3 Interlanguage pragmatics and pragmatic development; 3.1 Research designs and instruments; 3.1.1 Receptive research instruments ; 3.1.2 Productive research instruments ; 3.2 Developmental trajectories ; 3.2.1 Speech acts.

3.2.2 Implicature, routine formulae and indexicals 3.2.3 Extended discourse ; 3.3 Individual differences and development of L2 pragmatics; 4 Testing second language pragmatics ; 4.1 The ancestors: Early functional orientation ; 4.2 The first generation: Speech acts ; 4.3 The second generation: Broadening the construct; 4.4 Third generation: Interaction ; 4.5 Testing for research purposes ; 4.6 Issues in testing L2 pragmatics ; 4.6.1 Inferences, practicality, context ; 4.6.2 The native speaker standard, or: benchmarking in the age of lingua franca; 5 Validity and Validation.

5.1 The argument-based approach to validity 5.2 Validity and validation in tests of L2 pragmatics; 5.3 A validity argument for a test of ESL sociopragmatic knowledge; 5.3.1 From target domain to observation: Domain Description; 5.3.2 From observation to observed score: Evaluation (Scoring); 5.3.3 From observed score to universe score: Generalization; 5.3.4 From universe score to construct: Explanation ; 5.3.5 From construct to target score: Extrapolation ; 5.3.6 From target score to test use: Utilization ; 6 This study ; 7 Methodology; 7.1 Instrument types ; 7.2 Online development.

7.3 Pre-pilot testing 7.4 Pilot test ; 7.4.1 Instruments ; 7.4.2 Participants ; 7.4.3 Test administration ; 7.4.4 Scoring ; 7.4.5 Data analysis ; 7.4.6 Pilot results ; 7.5 Revising the test ; 7.6 Final test ; 7.6.1 Items ; 7.6.2 Interlanguage pragmatics test ; 7.6.3 Test administration ; 7.6.4 Participants ; 7.6.5 Scoring ; 7.6.6 Data analysis ; 8 Results ; 8.1 Overview ; 8.2 Validity argument ; 8.3 Domain Description ; 8.4 Evaluation ; 8.5 Generalization ; 8.6 Explanation ; 8.6.1 Group comparisons ; 8.6.1.1 Native speakers and non-native speakers.

8.6.1.2 Effect of proficiency and exposure 8.6.2 Test-internal analyses ; 8.6.2.1 Section correlations ; 8.6.2.2 Factor analysis ; 8.6.3 Criterion measures ; 8.6.4 Qualitative validation: Dialog Choice ; 8.7 Extrapolation ; 8.8 Utilization ; 9 Discussion ; 9.1 The validity argument ; 9.1.1 Utilization ; 9.1.2 Extrapolation ; 9.1.3 Explanation ; 9.1.4 Generalization ; 9.1.5 Evaluation ; 9.1.6 Domain Description ; 9.1.7 Overall evaluation of the test ; 9.2 The validity argument: structure or straitjacket?; 9.3 Proficiency, sociopragmatics and pragmalinguistics; 10 Conclusion and outlook.
Abstract:
Testing of second language pragmatics has grown as a research area but still suffers from a tension between construct coverage and practicality. In this book, the authors describe the development and validation of a web-based test of second language pragmatics for learners of English. The test has a sociopragmatic orientation and strives for a broad coverage of the construct by assessing learners'' metapragmatic judgments as well as their ability to co-construct discourse. To ensure practicality, the test is delivered online and is scored partially automatically and partially by human raters.
Holds: Copies: