Modeling the relationships between EFL learners' construct-relevant and -irrelevant strategies in listening test performance
The strategic processes that contribute to construct-relevant variations in test results (such as metacognitive and cognitive strategies) and construct-irrelevant variances (such as test-wiseness strategies) have been identified in both practice and theories in Language Testing (LT). Few studies, ho...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2024-11-01
|
| Series: | Acta Psychologica |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S0001691824005018 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846123578862338048 |
|---|---|
| author | Nick Zhiwei Bi Yue Wang |
| author_facet | Nick Zhiwei Bi Yue Wang |
| author_sort | Nick Zhiwei Bi |
| collection | DOAJ |
| description | The strategic processes that contribute to construct-relevant variations in test results (such as metacognitive and cognitive strategies) and construct-irrelevant variances (such as test-wiseness strategies) have been identified in both practice and theories in Language Testing (LT). Few studies, however, have attempted to incorporate construct-relevant and -irrelevant strategic processes into a more comprehensive conceptual model. This study probed into the complicated relationships between construct-relevant strategies (i.e., metacognitive and cognitive strategies), construct-irrelevant strategies (i.e., test-wiseness strategies), and IELTS (International English Language Testing System) listening performance from a micro perspective. A total of 473 Chinese EFL undergraduates from various majors were recruited to take an IELTS listening test and complete the metacognitive and cognitive strategy questionnaire for English listening (MCSQEL) and test-wiseness strategy questionnaire for English listening (TWSQEL). This study identified three metacognitive strategies (planning, monitoring and evaluating) and four cognitive strategies (memory, inferencing and elaboration, retrieval and comprehending) as construct-relevant processes. In contrast, test-wiseness strategies, as a unitary factor, encompassed three dimensions (deductive reasoning, test format and cue-using). The micro-level analyses show that (1) planning strategies directly regulated memory, comprehending and test-wiseness strategies, and monitoring strategies had an executive function over retrieval strategies, whereas evaluating strategies did not directly regulate any types of strategies; (2) only comprehending strategies had a direct impact on listening performance, and the other three cognitive strategies (memory, inferencing and elaboration and retrieval strategies) assisted test-takers' listening performance via comprehending strategies; (3) all metacognitive strategies were not found to directly influence the listening score; (4) test-wiseness strategies had a negative but insignificant effect on the listening test performance. The findings corroborate that the IELTS listening test has high cognitive validity. The study also provides further evidence suggesting that L2 instruction programs should place less emphasis on teaching test-wiseness strategies and more on construct-relevant strategic processes and language knowledge. |
| format | Article |
| id | doaj-art-a80ee7e6ff2b498da4734f31573dd788 |
| institution | Kabale University |
| issn | 0001-6918 |
| language | English |
| publishDate | 2024-11-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Acta Psychologica |
| spelling | doaj-art-a80ee7e6ff2b498da4734f31573dd7882024-12-14T06:28:29ZengElsevierActa Psychologica0001-69182024-11-01251104623Modeling the relationships between EFL learners' construct-relevant and -irrelevant strategies in listening test performanceNick Zhiwei Bi0Yue Wang1University of Shanghai for Science and Technology, Shanghai, China; Corresponding author.University of Shanghai for Science and Technology, Shanghai, China; Bailuzhou Middle School of Ji'an City, Jiangxi Province, ChinaThe strategic processes that contribute to construct-relevant variations in test results (such as metacognitive and cognitive strategies) and construct-irrelevant variances (such as test-wiseness strategies) have been identified in both practice and theories in Language Testing (LT). Few studies, however, have attempted to incorporate construct-relevant and -irrelevant strategic processes into a more comprehensive conceptual model. This study probed into the complicated relationships between construct-relevant strategies (i.e., metacognitive and cognitive strategies), construct-irrelevant strategies (i.e., test-wiseness strategies), and IELTS (International English Language Testing System) listening performance from a micro perspective. A total of 473 Chinese EFL undergraduates from various majors were recruited to take an IELTS listening test and complete the metacognitive and cognitive strategy questionnaire for English listening (MCSQEL) and test-wiseness strategy questionnaire for English listening (TWSQEL). This study identified three metacognitive strategies (planning, monitoring and evaluating) and four cognitive strategies (memory, inferencing and elaboration, retrieval and comprehending) as construct-relevant processes. In contrast, test-wiseness strategies, as a unitary factor, encompassed three dimensions (deductive reasoning, test format and cue-using). The micro-level analyses show that (1) planning strategies directly regulated memory, comprehending and test-wiseness strategies, and monitoring strategies had an executive function over retrieval strategies, whereas evaluating strategies did not directly regulate any types of strategies; (2) only comprehending strategies had a direct impact on listening performance, and the other three cognitive strategies (memory, inferencing and elaboration and retrieval strategies) assisted test-takers' listening performance via comprehending strategies; (3) all metacognitive strategies were not found to directly influence the listening score; (4) test-wiseness strategies had a negative but insignificant effect on the listening test performance. The findings corroborate that the IELTS listening test has high cognitive validity. The study also provides further evidence suggesting that L2 instruction programs should place less emphasis on teaching test-wiseness strategies and more on construct-relevant strategic processes and language knowledge.http://www.sciencedirect.com/science/article/pii/S0001691824005018Construct-relevant strategyConstruct-irrelevant strategyTest-wiseness strategyIELTS listening testCognitive validity |
| spellingShingle | Nick Zhiwei Bi Yue Wang Modeling the relationships between EFL learners' construct-relevant and -irrelevant strategies in listening test performance Acta Psychologica Construct-relevant strategy Construct-irrelevant strategy Test-wiseness strategy IELTS listening test Cognitive validity |
| title | Modeling the relationships between EFL learners' construct-relevant and -irrelevant strategies in listening test performance |
| title_full | Modeling the relationships between EFL learners' construct-relevant and -irrelevant strategies in listening test performance |
| title_fullStr | Modeling the relationships between EFL learners' construct-relevant and -irrelevant strategies in listening test performance |
| title_full_unstemmed | Modeling the relationships between EFL learners' construct-relevant and -irrelevant strategies in listening test performance |
| title_short | Modeling the relationships between EFL learners' construct-relevant and -irrelevant strategies in listening test performance |
| title_sort | modeling the relationships between efl learners construct relevant and irrelevant strategies in listening test performance |
| topic | Construct-relevant strategy Construct-irrelevant strategy Test-wiseness strategy IELTS listening test Cognitive validity |
| url | http://www.sciencedirect.com/science/article/pii/S0001691824005018 |
| work_keys_str_mv | AT nickzhiweibi modelingtherelationshipsbetweenefllearnersconstructrelevantandirrelevantstrategiesinlisteningtestperformance AT yuewang modelingtherelationshipsbetweenefllearnersconstructrelevantandirrelevantstrategiesinlisteningtestperformance |