A test designed to measure depression must only measure that particular construct, not closely related ideals such as anxiety or stress. It means that if a test has construct validity, it is capable of measuring certain specific characteristics in accordance with a theory of a language behavior and learning.
2.3 National Matriculation English Tests
The National Unified Enrollment Examinations (NUEE) is one of the largest-scale tests in China. Due to National Matriculation English Tests (NMET) is one of the three major subjects, many authors pay attention on it. There are many articles about it. A list of them is followed.
?
Validation Study on 2008-2009 National Matriculation English Test Papers of Three Provinces is written by Yan Jing in 2010.
? An Investigation of Washback Effect of the National Matriculation English Test is
written by Hong Xiaoxiang in 2008.
? Content Validity Study on Reading Comprehension Tests of NMET of Chongqing is
written by Qiu Jin in 2010.
? A study on the Backwash Effect of the Nmet (shandong Province)reading and Expression
is written by Zuo Peilan in 2010.
? An Empirical Study on the Washback of the Grammar Part in the National
Matriculation English Test(Shanghai) is written by Zhao Meijuan in 2009.
? Diachronic Study on NMET Reading Comprehension Discourse Characteristics and
Question Design is written by Zhang Quan in 2010.
? A Study of Characteristics and Content Validity of Nmet Reading Tests in Shaan Xi
Province (2006-2009) is written by Bai Haiyu in 2011
? A Study of Content Validity on Reading Comprehension of Matriculation English Test in
Guangdong Province (2004-2010) is written by Zhou Yiqiong in 2011.
There are also many other articles about NMET. However, by carefully analysis author finds that a majority of them regard the NMET as whole to analyze. Of course, there are some articles are about reading comprehension. But few concerns Shangdong province let alone the diachronic research about it. Therefore this paper has chosen to analyze the content validity of reading comprehension component of 2007-2011 Shandong NMET to make a clear analysis of it and throw some light on teaching and learning English reading in high schools as well as on the NMET.
Chapter 3 Theoretical Foundations and Research Framework
3.1 Theoretical Foundation
The author combines the framework of task characteristics and relied content validity study theories proposed by Bachman and Palmer ( 1999 ) , the senior high English teaching syllabus and the syllabus for NMET test.
3.2 Research Framework 3.2.1 Data Collection
The author collects reading comprehension parts of 2007-2011 Shandong NMET, then makes a careful analyses both qualitative and quantitative data which are about length, readability, reading speed, new words, topics and genres. Computers have also been adopted in the data collecting.
3.2.2 Data Analysis
By comparing the collected data with the requirements of the senior high English teaching syllabus and the syllabus for NMET test. The author also invited a classmates and a lecturer to help me when it is difficult for the author to analyze some questions.
Chapter 4 Findings and Discussions
The author combines the framework of task characteristics and relied content validity study theories proposed by Bachman and Palmer (1999), the senior high English teaching syllabus and the Syllabus for NMET test to put forward the objects for testing the content validity (Table1).
Table 1 Objects for testing the content validity Objects Length Speed New Words Readabilities Topics Genres Reading Skills Input Expected Response 4.1 Length
The syllabus for NMET test stipulates that the total length of the passages should be above 1000 words (Dong 2008). Careful counting is shown in the table 2.
Table 2: Length of reading passages from 2007 to 2011 Year 07 08 09 10 11 A 291 269 319 320 266 B 296 264 302 317 287 Passage C 292 324 302 294 317 D 291 229 282 290 290 PT 1170 1086 1205 1221 1160 Words Q 749 580 570 692 642 T 1919 1666 1775 1913 1802 (PT: Passage Total; Q: Question; T: Total)
First, it is obviously the total length of the reading tests is above 1000 words. Alderson (2000:256) recommends that the length of each test passage is suitable when it is between 150~350 words. Liu and Han also mentioned that reading
material should be controlled at about 200-500 words(Dong 2008).The table 2 shows that the length of each reading test is between 250-320 words. Therefore, it meets the requirement of scholars.
As for the layout of the articles, it should follow the general principle that from short to long and from easy to difficult. However, this study found that some years the articles’ layout is not very reasonable, such as the 2009 and 2010, which begin with the longest passage of the whole reading test. This may give candidates \feeling, which will affect students’ normal performance.
4.2 Speed
As for reading speed of NMET, two ways can be considered. First is the speed of reading articles, and the second is finishing the reading tests. The syllabus for high school students has specific demands. Senior middle school goals are divided into two levels, and the first level is 50~70 words per minute, then, the second level is 70~80 words per minute. Yang Huizhong and Weir(1998)submit that the proportion of reading articles and answering questions is 1 to 0.75. Syllabus requires that reading comprehension section should be finished by 35 minutes. According to this, reading the article takes up 20 minutes, and answering the questions takes 15 minutes. Based on these, the author calculates the reading speed according to the proportion of twenty to fifteen minutes (WPM1). In addition, the writer also adopts the usual way to calculate t he reading speed, or the total input amount is divided by reading time (WPM2). The two calculations are shown in t he table below:
Table 3 Reading speed from 2007 to 2011 WPM1 WPM2 07 58.5 54.7 08 54.3 47.6 09 60.4 50.7 10 61.0 54.6 11 58.0 51.4
Through the first calculation, the read speed of the five-year is from54.3-61.0 wpm. Basically,the speed fully meets the curriculum requirements. And the reading speed is well balanced, except for 2008 which is a slightly slower.
As for the second calculation method, generally speaking, reading speed for every paper almost meets the requirement of the teaching syllabus, except for the speed of 2008 which is lower that 50 wpm.
By analyzing the Table 3, the author finds out that they just reach the first level requirement of the first grade ( 50- 70 wpm) , not reach the second level ( 70-80 wpm ) . NMET is a top level test which is used to select the qualified candidates for university. Therefore, reading speed should sometime rise to second level. Based on the analysis, a suggestion may be made that reading speed of NMET needs to be slightly raised.
4.3 New Words
The teaching and testing syllabi(判决理由书的要旨) stipulate clearly that the new words of each reading passage should be less than 3%. The new words and vocabulary beyond the teaching syllabus of each year are shown in the table 4.
Table 4 New words and vocabulary beyond the teaching syllabus N 07 1.42 08 1.34 09 1.03 10 1.45 11 1.23 A 1.29 (N: New Words A: Average)
From the Table 4, the author finds that the new words rates of 2007-2011 are lower than 3%. What’s more, the new words of each year are stable except the year of 2009. Reading comprehension tests of NMET in Shangdong province gets better control of the amount of new words which matches well in line with the requirements of the syllabus.
4.4 Readability
The readability of the article refers to the level of reading material that is easy to read and understand. The readability of reading comprehension should be appropriate because it can not reflect the actual reading abilities if it is too difficult or too easy.
Nowadays widely used formula was the Flesh, which is first used in 1948 and still in use today. The formula is like this: RE = 206. 835-(0. 846 x NSYLL) - (1. 015 x W/S) (qt d in Alderson 2000: 71). NSYLL refers to the number of syllables per 100 words, and W/S refers to the average number of words per sentence Although, the formula is designed f or the English native learners not for the foreigners, Yang and Weir (1998) put forward that it can be regarded as a reference for the test designers and provide us a basis to build our comparison with a uniform criterion. The formula describes the readability with seven levels from easy to difficult.
Table 5 The references of Flesh readability (Yang Huizhong &W e IR, 1998) R D 0-30 Very difficult 30- 50 difficult 50- 60 Fairly difficult 60-70 standard 70- 80 Fairly easy 80- 90 easy 90-100 Very easy (R: Readability; D: Description of difficulty)
Based on the Flesh formula, the readability of reading passages of NMET in Shangdong province is described according to readability yardstick as follows:
Table 6 Readability classifications of reading passages from 2007 to 2011 Year 07 08 09 10 11 A 55.2 56.3 57.5 60.2 59.3 Passage Readability B C 56.7 58.2 59.3 58.3 58.9 61.4 59.7 63.2 57.8 61.4 AR D 57.2 54.4 64.5 62.6 59.6 56.8 57.1 60.1 61.5 59.5 (AR: Average Readability)
By analyzing the table shown above the readability of reading comprehension tests of NMET in Shangdong province is from 50-70. According to the Flesh
reference scale, the readability of the reading materials is from fairly difficult to standard. So, a conclusion can be made that it well meets the requirement of the two syllabi. What’s more, it is characterized with stationarity.
4.5 Topics
Alderson (2000) notes that usually good reading tests and good assessment procedures will make sure that readers have been assessed for their ability to make a well known of texts in a range of different topics. The senior high English teaching syllabus and the syllabus for NMET test require that senior middle school graduates can read and understand articles on different topics including science and technology, biography, story, social life and culture, literature and history. Based on these, the topics will be divided into six parts and the collected data will show in the form 7.
Table 7 Topics of reading passages from 2007-2011 2007 2008 2009 2010 2011 S&C 0 1 1 0 0 2 S 1 1 1 2 2 7 E 1 1 1 0 1 4 S&T 1 1 0 2 1 5 H&G 0 0 0 0 0 0 PE 1 0 1 0 0 2 (S&C: Social life and Culture; S: Story; E: Education; S&T: Science and Technology; H&G: History and Geography; PE: Personal Experience. )
By analyzing the table 7, the author concludes some characteristics about the topics of reading materials as follows:
First, the selection of topics is extensive. The table 7 shows that almost the six topics are included. By this, it can ensure to test the candidates’ reading abilities more scientifically, objectively and thoroughly.
Second, the selection of topics is comfort to the times. There are some heated topics which can stimulate students’ interest in reading and help to guide the students to focus on social and current affairs.
Third, the selection of topics is realization. Many topics are concerned with the students ' daily life which they are so familiar with. This can make sure the fairness of the test. Just as Bachman (1990: 138) proposes that if the subject matter of input is familiar to some test takers and not others, these individuals may have an unfair advantage, resulting in better performance.
Fourth, the selection of topics is ideology. The table 7 shows that different topics account for different proportions. Among of them story occupies a large proportion. Every story has been carefully selected, and every of them has its ideology, which can make significant influence on the students.
In short, all kinds of topics involved can not only favor students ' reading skills, inspire students ' interest in reading but also can help develop their good qualities. However, the author also finds that there are little topics about History and
百度搜索“77cn”或“免费范文网”即可找到本站免费阅读全部范文。收藏本站方便下次阅读,免费范文网,提供经典小说综合文库大学本科英语专业毕业论文模板(2)在线全文阅读。
相关推荐: