计算机化语言测试效度研究:基于证据的作文自动评分效度验证

本书分别从应试者的应试心理活动与测试表现，测试评分的准确度与其他效标之间的关联性，测试的区分度和聚合度以及测试的社会影响等视角探索了以风靡全国的句酷在线作文自动评分系统(JAESS)为代表的计算机化作文自动评分的效度，并提出相关对策与建议。

   Chapter One Introduction

1.1 Study Background

1.2 Purpose of This Study

1.3 Research Questions

1.4 Definitions of Key Terms

1.5 Contents of the Book

1.6 Summary

Chapter Two Literature Review

2.1 Introduction

2.2 Automated Essay Scoring Abroad

2.2.1 Project Essay Grader (PEG)

2.2.2 Intelligent Essay Assessor (IEA)

2.2.3 E-rater

2.2.4 IntelliMetric

2.2.5 Bayesian Essay Test Scoring sYstem (BETSY)

2.2.6 Intelligent Essay Marking System (IEMS) and Automark

2.2.7 Conceptual Rater (C-Rater)

2.2.8 Schema Extract Analyse and Report (SEAR)

2.2.9 Paperless School Free-text Marking Engine (PS-ME)

2.2.10 Summary of Automated Essay Scoring Abroad

2.3 Automated Essay Scoring in China

2.3.1 New Horizon College English Online Learning and Automated Scoring System

2.3.2 Bingo Intelligent English Automated Essay Scoring System (BIEAESS)

2.3.3 Juku Automated Essay Scoring System (JAESS)

2.4 General Review of Validation Studies of AES

2.4.1 Relationship between Automated Scores and Human Scores

2.4.2 Relationship between Automated Scores and Non-test Indicators

2.4.3 Validation Studies on Scoring Process and Mental Model

2.4.4 Evidence-based Validation Studies

2.4.5 Argument-based Validation Studies

2.4.6 AES Studies in China and Deficiencies of Previous Studies

2.5 Summary

Chapter Three Theoretical Framework

3.1 Introduction

3.2 Theory of Validity and Validation

3.2.1 Theory of Validity

3.2.2 Validation

3.3 Validity Evidence of Writing Assessment

3.3.1 Theoretical Construct of Writing Ability

3.3.2 Convergent and Divergent Validity Evidence of Writing Assessment

3.3.3 Criterion-related Evidence of Writing Assessment

3.3.4 Consequential Evidence of Writing Assessment

3.4 Validation Procedures in Action

3.5 Summary

Chapter Four Methodology

4.1 Introduction

4.2 Participants

4.2.1 Student Participants

4.2.2 Instructors

……