跳到正文
原文
Frontiers in Psychology· Lan Zhang·· 3 小时前AI 评分17

基于IPA与中介分析的第二语言教材表现评价:景观感知生态学视角下的质量教育研究

Quality education from the perspective of landsenses ecology: research on performance evaluation of L2 teaching materials based on Importance-Performance Analysis

AI 导读

一项基于L2学习者问卷的研究将Importance-Performance Analysis与中介分析结合,用于诊断第二语言教材的改进优先级并揭示其影响学习效率的心理路径。结果显示,景观感知指标的感知表现显著低于其重要性,存在传统单维评价无法捕捉的系统性表现差距。教材表现与外语愉悦正相关,外语愉悦与学习投入正相关,学习投入又与学习效率正相关,构成情绪—行为链中介路径。

正文

Abstract

At present, the evaluation of teaching materials mostly remains at the one-way comparison of indicators, lacking an effective mechanism to transform user feedback into improvement paths. Based on a questionnaire survey of L2 learners, this study aims to construct a dual mechanism: firstly, Importance-Performance Analysis is applied to identify the dimensions that need to be prioritized for improvement in the target teaching materials, and then mediation analysis is conducted to reveal the psychological pathways through which teaching materials influence learning outcomes. The results show that the perceived performance of landsense indicators is significantly lower than their importance, revealing a systematic performance gap that traditional unidimensional evaluation fails to capture. Furthermore, teaching material performance is positively correlated with foreign language enjoyment, and foreign language enjoyment is positively correlated with learning engagement. Learning engagement is further positively correlated with learning efficiency. This chain relationship provides statistical support for the process by which teaching material performance affects learning efficiency, revealing the vital role of the emotion-behavior chain mediation path in the transmission of teaching material effects.

Introduction

Quality education is a core goal of the United Nations 2030 Agenda for Sustainable Development, and effective teaching materials are the foundation for achieving this goal, directly influencing learners' engagement and sense of efficacy. Second language (L2) teaching materials are the main medium for learners to come into contact with the target language, providing teachers and learners with progressive language input of course content and teaching guidance. Although research on L2 teaching materials has been extensive, encompassing both theoretical developments (; ) and scale constructions (; ; ; ), the dominant paradigm remains a static, one-way comparison of indicators. This approach is characterized by a singular methodology and a lack of systematic investigation of users' subjective experiences, making it difficult to effectively integrate the dynamic perceptions and genuine needs of end-users.

This disconnect has given rise to a pressing practical issue, namely the lack of an effective mechanism to transform quantified user feedback into practical improvement strategies. Traditional matching assessment () and even the development of modern multi-dimensional scales () have largely focused on whether teaching materials conform to linguistic theories or syllabus requirements. However, they seldom investigate whether the priorities set by teaching material compilers and assessors align with what users deem important or satisfactory. Consequently, there is currently a lack of dynamic evaluation models and effective analytical methods that can facilitate interaction and communication among the needs, preferences, or visions of the multiple stakeholders involved in teaching materials (i.e., compilers, assessors, and users). This leaves teaching material revision without evidence-based, scientifically informed guidance derived from user data.

To address this gap, the present study introduces a brand-new dynamic evaluation framework that integrates user-centered quantitative diagnosis with impact pathway analysis. Grounded in the landsense concept and a learner-based evaluation index system for L2 teaching materials, the study employs Importance-Performance Analysis (IPA) to explore the needs, visions, and interactions among the multiple stakeholders involved in teaching material development. The aim is to generate insights for constructing teaching attribute profiles that support the development of teaching material users, as well as indicators for textbook quality assessment. We argue that moving beyond static scale-based evaluation () requires a two-step empirical approach: first, diagnose the specific strengths and weaknesses of teaching materials from the users' perspective; and second, reveal the psychological mechanisms through which teaching material quality influences learning outcomes. This approach provides the key operational methods and analytical tools for the paradigm shift in teaching material evaluation from entity research (focusing on disciplinary knowledge) to subjectivity research (focusing on the practical characteristics of teaching and learning) ().

The significance of this study lies in its contribution to achieving a cross-level integration from micro-level diagnosis to macro-level impact. At the theoretical level, it moves beyond traditional static evaluation by constructing a dynamic model that integrates real-time diagnosis with impact mechanism analysis, offering a new framework for understanding how teaching materials truly work. At the practical level, it transforms large-scale user data into actionable priority improvement lists, providing direct tools for precise teaching material revision and scientific evaluation. By empirically revealing the core emotion-behavior learning pathway, it can provide an evidence base and theoretical foundation for empowering learner-centered educational decision-making and advancing the sustainable development of quality education.

Theoretical basis and research hypothesis

Landsenses ecology and linguistic landsenses

Landsenses ecology is a multidisciplinary theoretical system and research method proposed by Chinese ecologist Jingzhu Zhao, who defined it as a scientific discipline that studies land-use planning, construction, and management toward sustainable development, based on ecological principles and the analysis framework of natural elements, physical senses, psychological perceptions, socio-economic perspectives, process-risk, and associated aspects (). Its interdisciplinary integration and research methods based on people's multi-sensory and multi-dimensional perception have enabled it to be widely applied in fields such as urban construction (e.g., ), community planning (e.g., ), cultural communication (e.g., ), and educational guidance (e.g., ). This theory holds that in social practice, people usually give or integrate one or more of their own visions into a carrier in an appropriate way, so that people (including themselves) can understand this or these visions in the carrier and its related manifestations, and these visions can guide or standardize people's words and deeds, so as to promote the realization of sustainable development (). The carrier of vision is called the landsense, and the process of conceiving and constructing a landsense is called landsense creation (). “These carriers can be hardware facilities, such as buildings, gardens, cities and blocks, as well as cultural resources such as poetry, novels, paintings, advertisements and songs” (, p. 654).

The proposal of the concept of linguistic landsense further extends the idea of landsense from the physical space to the humanistic field of language use and language learning, giving rise to exploratory research on linguistic landsense in areas such as sustainable consumption behavior (, , ), ecological harmonious discourse analysis (), linguistic ecology () and the complex language-behavior-environment system (; ). Linguistic landsense is defined as “a meaning carrier of people's vision, which can integrate the designer's subjective vision into the appropriate linguistic carrier and play a role in cultural communication and educational guidance in real life” (, p. 11). As a teaching tool that can make science education reform really enter the classroom (), teaching materials, through their content organization, visual presentation, and structural design, constitute a significant source of users' multi-sensory experiences. They also serve as essential carriers through which multiple stakeholders (e.g., curriculum standard developers and teaching material designers) embed their pedagogical philosophies and curriculum visions. This positioning renders teaching materials a form of linguistic landsense, from which the users (teachers or students) of the teaching materials can understand the curriculum vision and teaching concepts bestowed by the designers, thereby promoting the users to achieve the prescribed curriculum goals and the sustainable development of science education reform. This aligns closely with the bidirection principle of vision manifestation emphasized within the landsense framework. This principle indicates that designers can integrate their own vision into a certain landsense, while contactors can grasp or understand the vision within the landsense (). In other words, the transmission of vision is not a one-way projection but is achieved through a two-way interaction where the designer endows it and the contactors understand it. In this process, the landsense serves as a key medium for the transmission of vision. In the context of teaching materials, this principle can be manifested as follows: the formulators of curriculum standards and the compilers of teaching materials constitute the vision endowing end, embedding curriculum concepts and teaching ideas into the content arrangement, visual presentation and structural design of teaching materials; teachers and learners constitute the vision receiving end, perceiving, understanding and internalizing the educational concepts and knowledge spectrum therein during the usage process. It is evident that teaching materials are neither pure containers of knowledge nor aimless formal designs, but rather landsense carriers that carry and convey the vision of the curriculum. The complete realization of their educational functions depends on the co-construction of meaning achieved through the interaction between the two ends of endowing and comprehension. Therefore, the research on the evaluation of teaching material landsenses from the perspective of landsenses ecology is not a replacement for the existing teaching material evaluation framework, but rather a systematic expansion of its assessment dimensions. The landsense evaluation can expand the evaluation of teaching materials from a one-way review of the text to a dynamic assessment of the vision transmission and meaning interaction among multiple subjects (e.g., curriculum standard formulators, teaching material compilers, teachers, and learners). This enables the evaluation of teaching materials to no longer be confined to the quality of the content, but to monitor whether the curriculum vision carried by the teaching materials has reached a consensus on meaning through the interaction of multiple subjects.

In addition, the framework and scale for textbook evaluation carry the assessors' and scale developers' cognition for the application value of the design elements of the textbook and their evaluation of the teaching function of the textbook. Thus, it also constitutes a linguistic landsense, and becomes a carrier and bridge for the demand response and vision resonance between the agents who tailor, compile or evaluate the teaching materials and the recepients who procure or use the teaching materials. However, to date, no research has systematically integrated the landsense concept with teaching material evaluation, either theoretically or empirically. In response to this situation, this study constructed a user-based landsense evaluation index system for L2 teaching materials (see Table A1 in Appendix), based on the curriculum design elements of the formulators, the educational concepts of the compilers, and the evaluation indicators of the assessors. IPA was then employed to diagnose the expectation-experience gaps in the teaching materials. Furthermore, a mediation model was used to examine the mechanism through which the performance of these landsense indicators influences learning efficiency. This study aims to provide a dynamic analytical framework that integrates user perception with empirical testing for teaching material evaluation, thereby filling a research gap in this field. Ultimately, it seeks to advance the research on teaching material evaluation from a superficial analysis of the content attributes toward an in-depth assessment of their subject attributes.

Importance-Performance Analysis (IPA)

Importance-Performance Analysis (IPA), also known as importance-satisfaction analysis, is a comprehensive evaluation method proposed by ) for evaluating service quality and customer perception of service-oriented enterprises as well as the performance of various attributes. IPA mainly collects the data of the respondents' evaluation of the indicators of the specified survey object from two aspects of importance and satisfaction through questionnaire survey, thus forming the IPA matrix. In this matrix, the expectation degree (importance) of respondents to each indicator of the survey object is taken as the horizontal axis, and the satisfaction degree (performance) of respondents to each indicator is taken as the vertical axis, and the total average value of importance and performance is taken as the separation point of X–Y axis to construct a two-dimensional four-quadrant graph. The meanings of each quadrant are as follows: the quadrant I is the area of high importance and satisfaction, which is the dominant area, and the index factors falling into this area should be regarded as the key development objects; the quadrant II, with low importance and high satisfaction, is the retentive area, and a little attention can achieve better creation results; the quadrant III is a low area of importance and satisfaction, which is a slow improvement area, and the index factors falling into this area generally do not need to be considered; the quadrant IV, which has high importance but low satisfaction, is the key improvement area, and the index factors falling into this area can be used as breakthroughs to enhance the subjects' experience and should therefore be prioritized for improvement. Since proposed, IPA has attracted much attention from scholars and has been widely used in the fields of pedagogy (e.g., ) and urban planning (e.g., ; ), etc., but no scholars have applied it to the evaluation of teaching materials. In traditional paradigm of teaching material evaluation, scholars have predominantly employed a single-focus satisfaction judgment, drawing conclusions about how the textbook performs based on students' satisfaction ratings across various dimensions. While this approach captures students' intuitive responses, it fails to address a more critical question whether students' perceived performance aligns with their internal expectations. This is precisely where IPA innovates. By introducing importance as a reference coordinate, IPA expands the single-focus satisfaction evaluation into a dual-coordinate comparative analysis of expectation vs. experience.

Therefore, combined with research objectives and research questions, this paper uses IPA method (taking student satisfaction as teaching material performance) to evaluate the performance of textbook landsense indicators based on learner evaluation form. From the perspective of learners' perception, IPA method can be used to accurately and effectively identify the roles of landsense indicators of different dimensions in the high-quality development of teaching materials through the comparison of the two dimensions of learners' importance perception and satisfaction evaluation, which is highly innovative, practical and feasible.

Learning efficiency

Learning efficiency refers to the effects and gains of learning activities engaged by learners within a defined timeframe, including learners' learning outcomes, learning performance and achievement, such as academic knowledge, scientific attitude, problem-solving ability, learning quality, experimental skills, values, etc. (). As an important indicator for measuring the degree of achievement of learning goals, learning efficiency not only reflects the effectiveness of an individual's learning process, but also reveals the practical utility of instructional design, learning materials and educational technology (; ). Some factors affecting learning efficiency have also been extensively explored. For example, ) revealed that the main factors affecting college students' learning efficiency include personal factors, family factors, school level factors, and so on. Among them, personal factors mainly include students' learning motivation and learning interest. Learning motivation can become a kind of learning power and have a positive impact on students' learning attitude and learning diligence. ) believed that the amount of time and energy students spent in the learning process had a lot to do with their academic performance.

In addition to learning performance such as grades and skill exercises, learning efficiency can also be reflected through the perception of students (). Research shows that perceived satisfaction and perceived usefulness are the key variables influencing learners' technology acceptance behavior (; ). The effectiveness of interactive learning environments is critical to helping learners communicate and share knowledge, and also has an important impact on enhancing positive attitudes such as perceived satisfaction and the usefulness of learning technologies (). From the perspective of landsenses ecology, teaching materials, as structured and systematic carriers of disciplinary knowledge, undertake the function of imparting knowledge and skills. Their teaching attributes inherently contain the potential to build an interactive learning environment. The integrity principle of psychological perceptions emphasized in landsenses ecology, reveals the internal mechanism by which an individual's multi-dimensional perception of the environment is integrated to form an overall psychological judgment. Similarly, learners' perceptual experiences regarding various landsense indicators of teaching materials (e.g., content appropriateness, structural clarity, and visual comfort) do not exist in isolation; rather, they intertwine during cognitive processing and are ultimately integrated into an overall evaluation of teaching material performance. This holistic performance identified through IPA, reflecting learners' integrated satisfaction with their multi-sensory and multidimensional experiences of landsense indicators for teaching materials, may directly shape their overall perceptual judgment of learning efficiency. Therefore, the following hypothesis is proposed:

H1: The performance of landsense indicators of teaching materials has a significant positive predictive effect on learning efficiency.

Learning engagement

Learning engagement (ENG) refers to the state in which learners are actively engaged through high concentration of attention (; ), involving determination of learning goals, participation in learning activities and positive attitude. As a dynamic construct (), the diachronic changes, multidimensional influencing factors, and associated effects of learning engagement have become a focal point of scholarly attention. ) highlighted that learning engagement was a process of continuous development and change, which presented obvious differences in different time scales or analysis levels. ) also pointed out that learning engagement could predict learning outcomes. ) further proved that learning engagement would have a certain impact on students' academic performance and personal development. The academic community generally regards learning engagement as a comprehensive construct, including behavioral engagement (i.e., students' participation in learning activities), emotional engagement (i.e., students' positive emotional experience), agentic engagement (i.e., students' enthusiasm and initiative in teaching activities) and cognitive engagement (students' cognitive effort in learning activities) (). ) pointed out that these four dimensions collectively reflect students' capacity to achieve academic progress through behavioral engagement, emotional regulation, constructive participation in the instructional process, and the use of learning strategies.

Some researches show that compared with teacher-generated content, learning tasks involving student-generated content can better stimulate students' interest and engagement in multi-level learning (; ). This discovery reveals the significance of the interactive experience between learners and the learning content. From the perspective of landsense ecology, people's perception of the environment follows the multiscale principle of spatiotemporal combination (). In other words, this perception not only occurs within an immediate instantaneous field but also manifests as multi-level dynamic integration across temporal extension and spatial transition. Applying this principle to the field of teaching material evaluation, teaching materials are not only the medium for presenting knowledge, but also a learning environment field composed of multi-dimensional perceptual elements. From the micro-level (e.g., layout design, tactile sensation of fonts) to the meso-level (e.g., unit structure, content progression), and further to the macro-level (e.g., sustained use across a semester), learners' interactive experiences with teaching materials across different spatial and temporal scales collectively shape their multidimensional perceptions of teaching material performance. Some landsense elements (e.g., the applicability of the materials, structural coherence, and aesthetic design) serve as concrete manifestations of this spatiotemporally integrated perception, jointly influencing learners' emotional arousal and behavioral engagement during the learning process. The key to understanding whether teaching materials can truly stimulate learning engagement lies in effectively identifying learners' importance ratings and performance evaluations of each dimension of landsense indicators and diagnosing the potential gaps between them.

IPA introduced in this study helps to compare learners' importance ratings with their actual performance perceptions across various dimensions, promoting the effective identification of dimensions that learners highly value but experience poorly. This expectation–experience discrepancy essentially reveals the dysfunction of teaching materials as a learning environment field. When teaching materials fail to meet learners' expectations on key dimensions, their affordance and motivational force as environmental stimuli diminish, potentially inhibiting learners' willingness to engage and their level of effort. This constitutes the core mechanism for understanding how teaching material performance influences learning engagement. Based on this, the following hypotheses are proposed:

H2: The performance of landsense indicators of teaching materials has a significant positive impact on learning engagement.

H3: Learning engagement has a significant positive impact on learning efficiency.

Foreign language enjoyment

Foreign language enjoyment (FLE) refers to the positive emotions that learners feel when learning a foreign language (), involving FLE-Private (positive emotions stimulated by factors such as academic progress), FLE-Teacher (positive emotions stimulated by factors such as teacher support and encouragement) and FLE-Atmosphere (positive emotions associated with participation in class or group activities) (), characterized by a sense of novelty and accomplishment (). Enjoyment is an activity-centered emotion that is actively activated and has been shown to have a positive impact on learners' academic performance (; ) and the construction of language learning resources and broadening one's horizon (). In addition, FLE can also strengthen language input or output ability, promote mental resilience, and improve learning efficiency. FLE has dynamic characteristics (; ), which has potential relationship with various social and psychological variables involved in foreign language learning, such as learners' self-evaluation and enjoyment, classroom anxiety () and affection ().

Thus, learners' perceptions of teaching materials are not merely simple mappings of their physical attributes (e.g., content, structure, form, and function) but rather integrated psychological constructs formed on the basis of multi-sensory perception and processed through individual cognitive schemas. For instance, the visual reception of layout design and color combinations can directly influence learners' first impressions and reading experience; the tactile experience of paper texture affects comfort and sense of affinity; spatial cognition regarding the structural organization or information hierarchy of the materials influences the efficiency of information retrieval and cognitive load; and the auditory perception of accompanying audio materials can also impact the sense of fluency and achievement in the learning process. This process of perception formation—integrating multiple physical sensory inputs (e.g., visual, auditory, and tactile sensations) with diverse psychological cognitions (e.g., attitudes, emotions, and intentions)—is fundamentally aligned with the core proposition of landsense ecology, namely the interactivity principle of physical senses and psychological perceptions ().

This principle emphasizes that physical senses and psychological perceptions are not isolated from one another; rather, they interact to jointly shape people' environmental experiences. People receive environmental information through multiple sensory channels, and this information is transformed into emotional experiences and behavioral intentions through cognitive processing. Extending this principle to the field of teaching material evaluation, teaching materials are not merely a medium for transmitting knowledge, but also a perceptual environment with which learners interact. Their design philosophy (e.g., visual layout), content presentation (e.g., language difficulty, example appropriateness), and cultural relevance (e.g., familiarity and identification with cultural elements) can all be regarded as environmental information acting upon learners' multi-sensory channels. Through learners' perception and cognitive processing, this information may evoke positive emotional responses, namely the experience of foreign language enjoyment. This enjoyment, triggered by the teaching materials, forms an emotional bond between learners and the materials, which may in turn strengthen the intensity of learning engagement and enhance the perceived level of learning efficiency. Therefore, the following hypotheses are proposed:

H4: The performance of landsense indicators of teaching materials has a significant positive impact on FLE.

H5: FLE has a significant positive impact on learning engagement.

H6: FLE has a significant positive impact on learning efficiency.

Construction of landsense evaluation index system of teaching materials

The construction of the teaching material evaluation system in this study is based on the theory of landsenses ecology. This theory emphasizes that individuals receive environmental information through multiple senses and integrate it into an overall experience through psychological cognitive processing. When this theory is applied to the field of teaching material evaluation, teaching materials can be regarded as the perceptual field of learners, and their attributes (e.g., content, structure, and form) jointly constitute the environmental information that acts on learners' multi-sensory experiences. Based on this, the development and validation of landsense index system in this study follow a strategy that combines top-down and bottom-up approaches. This process not only deduces the perception dimension of teaching materials based on the theoretical framework of landsenses ecology, but also summarizes and supplements the indicators based on learners' actual experiences. At the top-down level, the research results of scholars (e.g., ; ) on the evaluation of L2 teaching materials were systematically sorted out, and the dimension structure of teaching material evaluation scales at home and abroad was referred to. The core assessment dimensions of teaching material quality were initially extracted. At the bottom-up level, we have supplemented and adjusted the initial dimensions in combination with the demand levels and usage experience feedback of L2 learners. To ensure the content validity of the index system, two experts in the field of L2 teaching were invited to conduct two rounds of expert reviews on the initial index system. Based on expert feedback, the expressions of some indexes have been revised.

Ultimately, the evaluation index system was determined to include 10 element-level evaluation indicators such as student applicability, framework structure, theming content and language content (Table 1), involving a total of 39 index-level evaluation indicators (see Table A1 in Appendix). The design logic of this index system is rooted in the core tenets of the landsense concept, which is to comprehensively capture the experiential feedback elicited by teaching materials as a perceptual field for learners, starting from their multi-sensory and multi-dimensional experiences. Among them, multi-sensory experiences primarily include visual (e.g., layout, illustrations) and tactile (e.g., paper texture, binding) dimensions, etc., while multi-dimensional experiences encompass teaching material attributes such as content, structure, and format. Each indicator factor was scored on a Likert five-point scale (1 = very not important or very not dissatisfied and 5 = very important or very satisfied).

Table 1

Element-levelIndex-levelImportance (I)Performance (P)I-PTSig. (two-tailed)Adj. sig.
M ±SD95% CINo.M ±SD95% CINo.
Student applicability14.66 ± 0.65[4.59, 4.73]14.39 ± 0.78[4.30, 4.47]30.275.775< 0.0010.0167
24.61 ± 0.63[4.55, 4.67]24.44 ± 0.83[4.35, 4.53]10.173.594< 0.0010.05
34.55 ± 0.69[4.48, 4.63]44.38 ± 0.79[4.29, 4.46]40.183.788< 0.0010.025
44.52 ± 0.73[4.44, 4.60]64.23 ± 0.93[4.12, 4.33]320.295.835< 0.0010.0125
Framework structure54.47 ± 0.76[4.39, 4.55]194.37 ± 0.84[4.28, 4.46]50.102.0590.0400.025
64.53 ± 0.70[4.45, 4.60]54.36 ± 0.80[4.27, 4.44]60.173.434< 0.0010.0125
74.48 ± 0.75[4.40, 4.57]164.33 ± 0.86[4.24, 4.42]80.153.1180.0020.0167
Theming content84.49 ± 0.75[4.41,4.57]154.21 ± 0.91[4.11, 4.31]350.275.524< 0.0010.0125
94.46 ± 0.79[4.37, 4.54]254.27 ± 0.89[4.17, 4.36]260.194.053< 0.0010.0167
104.45 ± 0.79[4.36, 4.53]284.28 ± 0.89[4.18, 4.38]180.173.350< 0.0010.025
Language content114.46 ± 0.76[4.38, 4.54]234.29 ± 0.91[4.20, 4.39]150.173.1490.0020.05
124.58 ± 0.65[4.51, 4.65]34.43 ± 0.78[4.34, 4.51]20.153.527< 0.0010.025
134.50 ± 0.72[4.42, 4.58]124.32 ± 0.90[4.22, 4.41]90.183.653< 0.0010.0167
144.52 ± 0.76[4.44, 4.60]74.29 ± 0.87[4.19, 4.38]170.235.000< 0.0010.0083
154.52 ± 0.75[4.44, 4.60]84.30 ± 0.84[4.21, 4.39]140.224.527< 0.0010.01
164.50 ± 0.80[4.41, 4.58]144.31 ± 0.86[4.21, 4.40]110.193.738< 0.0010.0125
Western culture174.41 ± 0.80[4.32, 4.49]374.27 ± 0.86[4.17, 4.36]250.142.6900.0080.0167
184.36 ± 0.85[4.27, 4.45]384.25 ± 0.87[4.16, 4.35]270.112.0890.0370.025
194.33 ± 0.85[4.24, 4.43]394.23 ± 0.89[4.13, 4.33]300.101.9720.0490.05
204.45 ± 0.77[4.37, 4.54]274.28 ± 0.86[4.19, 4.38]200.173.519< 0.0010.01
214.47 ± 0.73[4.39, 4.55]204.31 ± 0.85[4.22, 4.40]100.163.2010.0020.0125
Activity design224.48 ± 0.85[4.39, 4.57]174.22 ± 0.94[4.12, 4.33]330.254.850< 0.0010.01
234.43 ± 0.83[4.34, 4.52]314.21 ± 0.91[4.11, 4.31]360.234.359< 0.0010.0125
244.43 ± 0.79[4.35, 4.52]304.23 ± 0.93[4.13, 4.33]310.213.773< 0.0010.0167
254.51 ± 0.79[4.43, 4.60]104.25 ± 0.94[4.14, 4.35]280.275.016< 0.0010.0083
264.50 ± 0.73[4.42, 4.58]114.33 ± 0.86[4.24, 4.42]70.173.533< 0.0010.05
274.46 ± 0.79[4.37, 4.54]244.28 ± 0.90[4.18, 4.38]210.183.610< 0.0010.025
Strategy training284.51 ± 0.76[4.43, 4.60]94.27 ± 0.91[4.17, 4.37]240.255.085< 0.0010.0167
294.46 ± 0.80[4.38, 4.55]214.28 ± 0.87[4.19, 4.38]190.183.512< 0.0010.05
304.47 ± 0.77[4.39, 4.56]184.29 ± 0.89[4.19, 4.39]160.183.680< 0.0010.025
Localized content314.46 ± 0.79[4.38, 4.55]224.27 ± 0.91[4.17, 4.37]220.193.627< 0.0010.025
324.46 ± 0.78[4.37, 4.54]264.30 ± 0.92[4.20, 4.40]120.152.9200.0040.05
334.50 ± 0.73[4.42, 4.58]134.22 ± 0.91[4.12, 4.32]340.285.414< 0.0010.0167
Formal device344.43 ± 0.77[4.35, 4.51]324.23 ± 0.91[4.13, 4.33]290.203.879< 0.0010.0167
354.42 ± 0.80[4.33, 4.50]354.30 ± 0.91[4.20, 4.40]130.122.2450.0250.05
364.42 ± 0.84[4.33, 4.51]344.27 ± 0.93[4.17, 4.37]230.152.8170.0050.025
Supporting resources374.41 ± 0.83[4.32, 4.50]364.12 ± 1.06[4.00, 4.23]390.294.976< 0.0010.0167
384.42 ± 0.81[4.33, 4.51]334.14 ± 1.05[4.02, 4.25]380.284.749< 0.0010.025
394.44 ± 0.87[4.34, 4.53]294.16 ± 1.06[4.04, 4.27]370.284.503< 0.0010.05

The importance-performance means in the index level.

The Index-level column presents concise descriptors. The complete original survey items (in English) for all 39 indicators are listed in Table A1 (Appendix).

In the questionnaire, five items to measure FLE were selected from the study of ), eight items to measure learning engagement were adapted from the study of ), and five items to measure learning efficiency were selected from the study of ) (see Table A2 in Appendix). The Chinese version of learning engagement scale, learning efficiency scale and FLE scale adopted the translation-back translation method to translate the English scale into Chinese. After expert review and the pre-test of 20 students, the expressions of some items were slightly adjusted to ensure cultural adaptability. Eventually, the Likert five-point scoring system was used for all the three scales (1 = strongly disagree, 5 = strongly agree).

Methods and analysis

The main body of this study is non-English major undergraduates in a Chinese university, and the research object is the New Generation of College English teaching materials published by Foreign Language Teaching and Research Press. A cluster sampling method was adopted. From September to October 2024, four intact classes were randomly selected as sampling units among second-year non-English major students at a university in China, and all students in these classes were included in the survey. With the consent of the course instructors, questionnaires were distributed and collected in class. The participant sample had sufficient experience with the target teaching material examined in this study, enabling them to provide valid evaluations across its various dimensions.

A total of 360 questionnaires were distributed and 345 questionnaires were recovered, including 18 invalid questionnaires and 327 valid questionnaires (107 males and 220 females), with an effective rate of 90.83%. Participants' ages ranged from 18 to 22 years (M = 18.84, SD = 0.71).

Subsequently, SPSS 29.0 was employed for descriptive statistics and IPA, while AMOS 24.0 was used to conduct confirmatory factor analysis to assess the discriminant and convergent validity of the scales. The mediation effects were tested using the PROCESS macro (Model 6).

Results

Validity and reliability tests

To ensure the validity of the subsequent analyses of this study (including the IPA analysis of the teaching material and the test of the mediating mechanism between variables), we first conducted confirmatory factor analysis and reliability assessment on the core scales.

Confirmatory factor analysis

To test the measurement structure of the four core latent variables in the theoretical model (i.e., teaching material performance, foreign language enjoyment, learning engagement, and learning efficiency), a confirmatory factor analysis was first conducted. Due to the large number of items in the teaching material performance scale (39 items), including all items as manifest variables would have resulted in an overly complex model with unstable parameter estimates. Therefore, based on the theoretical constructs, we averaged the item scores within each dimension to generate 10 item parcels (i.e., the 10 element-level indicators shown in Table 1), which served as observed indicators for the latent variable of teaching material performance. For foreign language enjoyment, learning engagement, and learning efficiency, all original items were directly used as observed indicators.

The results of the analysis showed that the hypothesized four-factor model fit the data well: χ2/df = 2.88, CFI = 0.929, TLI = 0.922, RMSEA = 0.076, and SRMR = 0.0403. As shown in Table 2, all observed variables had standardized factor loadings ranging from 0.721 to 0.91 on their respective latent constructs, all reaching statistical significance (p < 0.001). Furthermore, the composite reliability (CR) of all latent variables ranged from 0.911 to 0.965, which was much higher than the acceptable threshold of 0.7 (), and the AVE value was between 0.673 and 0.734, all higher than the excellent criterion of 0.5 (). These results indicate that each scale has extremely high internal consistency, and the measurement model has very ideal convergent validity.

Table 2

Latent variablesλCRAVE
Teaching material quality0.721, 0.828, 0.846, 0.854, 0.858, 0.867, 0.867, 0.891, 0.908, 0.910.9650.734
Foreign language enjoyment0.77, 0.777, 0.82, 0.838, 0.8920.9110.673
Learning engagement0.805, 0.811, 0.813, 0.814, 0.819, 0.833, 0.841, 0.8580.9440.680
Learning efficiency0.774, 0.84, 0.841, 0.87, 0.8820.9240.709

Composite reliability (CR) and Average Variance Extracted (AVE).

Reliability statistics

After establishing the validity of the measurement structure, we assessed the internal consistency reliability of each scale using Cronbach's alpha coefficients. As shown in Table 3, the reliability coefficients for all core variable scales and the 10 sub-dimensions of teaching material quality exceeded the commonly accepted threshold of 0.7, indicating a high degree of reliability in the measurements. Specifically, the reliability coefficients for the two overall scales—teaching material performance and importance perception—both surpassed 0.9, and the 10 subdimensions underlying them also demonstrated good reliability (α ranging from 0.743 to 0.894). The reliability coefficients for the mediator and dependent variable scales (i.e., foreign language enjoyment, learning engagement, and learning efficiency) were also at a high level above 0.9. These results indicate that the scales employed in this study possess excellent internal consistency reliability, and the data obtained are highly reliable, stably reflecting the target constructs and satisfying the requirements for subsequent data analysis.

Table 3

Measurement constructNumber of itemsα
Importance perception αPerformance perception α
Teaching material quality (total scale)390.9700.978
Sub-dimension 140.8360.857
Sub-dimension 230.7430.813
Sub-dimension 330.7930.830
Sub-dimension 460.8490.882
Sub-dimension 550.8650.885
Sub-dimension 660.8940.893
Sub-dimension 730.7790.835
Sub-dimension 830.8110.856
Sub-dimension 930.8070.839
Sub-dimension 1030.8150.861
Foreign language enjoyment50.902
Learning engagement80.943
Learning efficiency50.923

Results of reliability analysis.

Descriptive statistics and correlation analysis

Table 4 listed the mean and standard deviation of each variable and their Pearson correlation coefficients, indicating that there were significant positive correlations among teaching material performance, FLE, learning engagement and learning efficiency (P < 0.001), and the correlation coefficients ranged from 0.333 to 0.854, among which the correlation between learning engagement and learning efficiency was the strongest. To systematically evaluate the impact of this high correlation and other potential methodological issues on subsequent regression analysis, common method bias tests and multicollinearity diagnoses were conducted, respectively.

Table 4

VariablesMSDTeaching material performanceForeign language enjoymentLearning engagementLearning efficiency
Teaching material performance4.280.661
Foreign language enjoyment4.210.780.333**1
Learning engagement4.190.770.387**0.788**1
Learning efficiency4.020.870.366**0.825**0.854**1

Descriptive statistics and correlation analysis of variables.

**Correlation is significant at the 0.01 (2-tailed).

Testing for common method bias

All data for the core variables in this study were collected through student self-reports, so there was a potential risk of common method bias. To address this, we employed Harman's single-factor test, the most commonly used statistical diagnostic method. This test was conducted on the variables that were jointly analyzed in the subsequent mediation model. With the help of SPSS 29.0, all items in the questionnaire measuring teaching material performance, FLE, learning engagement and efficiency were used for exploratory factor analysis, and Harman single factor test was performed on the collected data. The items measuring the importance perception were not involved in the subsequent path analysis and their data were solely used for IPA, so they were excluded from this test. Results are as follows. The explanatory volume of the first factor was 42.58%, which was lower than the threshold (50%), indicating that the common method bias was acceptable ().

Collinearity diagnostics

To test for multicollinearity, all predictor variables in the mediation model (i.e., teaching material performance, foreign language enjoyment, and learning engagement) were included in a linear regression equation with learning efficiency as the dependent variable, and the variance inflation factor (VIF) and tolerance values (Tol) for each variable were calculated.

As shown in Table 5, the VIF for all predictor variables ranged from 1.179 to 2.767, which were below the critical threshold of 5, and the corresponding Tol all exceeded the common criterion of 0.1. This indicates that, despite the high bivariate correlation observed between learning engagement and learning efficiency, no severe multicollinearity issues were present in the multiple regression framework. Consequently, this does not pose a substantial threat to the parameter estimation of the subsequent mediation effects.

Table 5

Dependent variableIndependent variablesTolVIF
Learning efficiencyTeaching material performance0.8481.179
Foreign language enjoyment0.3782.646
Learning engagement0.3612.767

Overall multicollinearity test.

IPA results

Descriptive analysis of the importance-performance of the index level

This study conducted an IPA on the 39 landsense indicators of the surveyed teaching material, aiming to diagnose their strengths and weaknesses from the learners' perspective.

According to the means of importance shown in Table 1, all 39 evaluation indicators have been agreed by learners, and all means are above 4 points, indicating that learners believe that the content of these 39 indicators has a significant impact on their English learning activities during the use of the tested teaching material. For each indicator, the mean of performance is slightly lower than the mean of importance although the mean performance for each indicator is also above 4 points, indicating that the teaching material tested in these indicators of the construction of learning is in place, and learners' satisfaction is relatively high, but there is still a certain room for improvement.

To assess whether there were statistically significant differences between the importance and performance ratings for each dimension, we conducted paired-sample t-tests. According to the initial results of paired t-test analysis, the importance-performance (I-P) differences of 39 indicators were all positive and above the significance level, of which 10 indicators (P < 0.05) had significant differences, and the remaining 29 indicators (P < 0.001) had extremely significant differences.

To control for the potential inflation of Type I errors resulting from 39 paired comparisons, we applied the Holm–Bonferroni method to adjust the raw p-values and calculated the adjusted p-values. As shown in Table 1, the I-P differences for all 39 sub-dimensions remained statistically significant after correction, indicating that the performance shortfalls were statistically reliable. Consequently, these dimensions should be regarded as key areas requiring attention and improvement in subsequent teaching material revision and resource allocation.

The above findings reveal that, based solely on a performance scale, learners' evaluation of the teaching material appeared satisfactory (with mean performance scores for each indicator ranging from 4.12 to 4.44). However, the two-dimensional comparison of IPA uncovers a more critical fact: learners' expectations across various dimensions of the teaching material exceeded their actual experiences, indicating a systemic performance-expectation gap in the textbook as a whole. This finding profoundly exposes the fundamental limitations of traditional evaluation paradigms of teaching materials. Whether it is the matching assessment based on expert checklists () or the absolute value judgment relying solely on satisfaction surveys, both fail to capture learners' authentic experiences. The former, while capable of addressing theoretical compliance (e.g., verifying the alignment between teaching materials and predetermined checklists), cannot answer the core practical question of whether the textbook meets learners' expectations. The latter also has blind spots: without importance as a reference, it is impossible to identify the potential expectation gaps hidden behind seemingly satisfactory ratings.

This highlights the value of introducing IPA in this study. By incorporating importance as an evaluative dimension, IPA transforms static satisfaction assessments into a dynamic analysis of expectation-experience gaps, thereby revealing authentic issues that traditional methods fail to capture. This finding aligns closely with the call by ) for a paradigm shift from entity research to subjectivity research in teaching material evaluation—that is, moving beyond static examinations of knowledge itself toward a focus on learners' practical perceptions and experiential gaps. Future research could integrate qualitative methods (e.g., interviews) to gain deeper insights into the reasons behind learners' evaluations of specific indicators, thereby providing richer evidence for the improvement of teaching materials.

IPA quadrant analysis

The IPA quadrant diagram was used to further analyze 39 indicators. In the IPA quadrant diagram (Figure 1), the mean of overall importance of 39 indicators (4.4744) and the mean value of overall satisfaction (4.2788) were taken as vertical crossing points, and the importance mean of indicators was taken as horizontal axis and performance mean as vertical axis to establish a four-quadrant matrix. This approach of employing grand means as intercepts follows the standard IPA procedure (), as it reflects the overall evaluation level of the sample and enables a natural identification of dimensions that are high or low relative to the overall mean. According to the data in Table 1, the IPA quadrantal distribution of performances of 39 indicators in the tested teaching material can be obtained (see Figure 1).

Figure 1

As shown in the IPA quadrant diagram (Figure 1): the first quadrant contains 11 indicators, 5 of which belong to “language content” elements, indicating the repetition rate of new words, typical example sentences, the annotation and translation of new words and grammar in this series of teaching materials have been fully affirmed and paid attention to by learners; the second quadrant has five indicators, which are, respectively, “unit module design,” “language communication,” “content arrangement of Western culture,” “integration into Chinese culture,” and “illustration and content coordination,” indicating learners are satisfied with the actual perception of unit modules, communication and Chinese culture integration, but the index I-P difference is positive, which indicates that the content arrangement and appearance configuration can be further standardized and improved; there are 12 indicators in the third quadrant, 3 of which belong to Western culture and 3 of which belong to supporting resources; the fourth quadrant has six indicators, which are “the learning content arousing students' interest,” “diverse theme ortopics,” “activities or exercises integrating the use of English skills,” “provision of major language learning strategies,” “Chinese annotation,” etc., indicating that these indexes need to be improved urgently. The relationship between teaching material performance assessed by these indicators and FLE, learning engagement and learning efficiency should be verified by the following intermediary analysis results.

Mediation analysis results

SPSS Process macros were used to examine the mediating effects of FLE and learning engagement on teaching material performance and learning efficiency through the non-parametric percentile Bootstrap method of mediating effect test. The regression analysis showed that the direct effect of teaching material performance on learning efficiency was significant before adding mediating variables. When FLE and learning engagement were included in the regression equation, teaching material performance had a significant positive effect on FLE and learning engagement, but no longer had a significant effect on learning efficiency. FLE had significant positive effects on learning engagement and learning efficiency, respectively. And learning engagement had a significant positive impact on learning efficiency, as shown in Table 6.

Table 6

Regression equationOverall fit indexRegression coefficient
Outcome variablePredictor VariableRR2Fβt
FLETMP0.330.1120.42***0.336.35***
ENGTMP0.800.64191.41***0.143.97***
FLE0.7420.96***
EFFTMP0.890.79309.43***0.030.95
FLE0.399.51***
ENG0.5312.67***

Chain mediation analysis.

Each variable is normalized before being brought into the equation. *p < 0.05, **p < 0.01, and ***p < 0.001. FLE, Foreign language enjoyment; TMP, Teaching material performance; ENG, Learning engagement; EFF, Learning efficiency.

The intermediate effect test and confidence interval estimation were carried out for the three paths, respectively. The results showed that 95% confidence intervals of the three paths did not include 0, indicating that the indirect effects of the three paths had reached a significant level (as shown in Figure 2). The total standardized mediation effect was 0.338, accounting for 93.89% of the total effect. The indirect effects of the three intermediary paths accounted for 36.39%, 20.83%, and 36.67% of the total effects, respectively, as shown in Table 7.

Figure 2

Table 7

PathEffect sizeProportion of total effect95% CI
TMP → FLE → EFF0.13136.39%0.0850.190
TMP → ENG → EFF0.07520.83%0.0290.129
TMP → FLE → ENG → EFF0.13236.67%0.0850.189
Total indirect effect size0.33893.89%0.2360.461

Mediating effects and confidence intervals.

CI, confidential intervals.

Discussion

The feedback adjustment mechanism of teaching material landsense among plural subjects

The United Nations Millennium Development Goals 4 (Quality Education) proposed to ensure inclusive and equitable quality education and promote lifelong learning opportunities for all. The construction and evaluation of teaching materials is a priority field of action to carry out quality education and a concrete way to promote sustainable development education. As an important medium through which learners are exposed to scientific knowledge, teaching materials need to provide students with engaging and academically challenging learning experiences and support their self-directed learning. Additionally, the chain mediating effect of “teaching material performance → foreign language enjoyment → learning engagement → learning efficiency” has been demonstrated in this paper, which indicates that teaching material performance can be an organic component of quality education. However, if a teaching material is only used as the carrier of knowledge and the objective object of students' learning, it has the entity characteristics independent of learners, and often lacks the subject relevance for learners, which is not conducive to the interaction between learners and the teaching material, difficult to help learners achieve their own academic development (), and is not conducive to the realization of quality education goal. Therefore, how to enhance the analysis of teaching attributes and quality assessment of teaching materials has become an important issue that urgently needs to be addressed in the implementation of science courses and the use of teaching materials.

However, it is worth noting that the planning, design, management and evaluation of teaching materials is a comprehensive and complex process, and the implementation process of teaching materials in teaching practice does not only pursue a single goal or result, but also involves the comprehensive feedback and gradual adjustment of the design concept, evaluation ideas and learning needs among plural subjects (e.g., textbook designers, assessors, and users). This is in line with the overall meliorization framework () of landsenses ecology, which uses the meliorization model and hyperfeedback mechanism to promote the sustainable development of complex systems. Therefore, based on landsenses ecology, this paper constructs a hyperfeedback adjustment mechanism for textbook designers, assessors and users (Figure 3) to analyze the vision resonance among plural subjects of teaching materials and its effect on the landsense creation of learners' learning engagement, enjoyment and efficiency.

Figure 3

As shown in Figure 3, the teaching material designers integrate their understanding of the syllabus and visions of the teaching goal into the compilation and design of the textbook through appropriate forms of manifestation, with the aim of effectively stimulating the sensory system of learners, thus triggering a series of knowledge perception and psychological cognitive processes. The teaching material bearing the designers' design concept and visions constitutes a linguistic landsense, and the process of its landsense creation is closely related to the user's perceptions of the teaching material. In view of this, teaching material assessors usually start with the key links of teaching implementation, and conduct practice-oriented application value assessment on the design of teaching support elements in teaching materials, so as to comprehensively analyze and evaluate the teaching function of teaching materials. These reference elements, which are used to evaluate and judge the performance and level of teaching material in helping students learn, constitute the landsense indicators of teaching material evaluation, carrying the understanding and visions of assessors on the diversity and accessibility of learning opportunities for students in the teaching material. They usually focus on whether the teaching material can provide opportunities for students of different types or levels to actively participate in the learning by designing an attractive variety of content materials and practical activities. On the one hand, based on the evaluation of the cognitive value and application value or function of the teaching material, assessors give feedback on the application of the design concept and visions of the teaching material designers in real teaching scenarios; on the other hand, the problem scenarios in the textbook (e.g., the text content and practical activities), which are closely related to students, are organized and designed, so as to comprehensively and deeply evaluate the accessibility of the textbook from multiple perspectives (e.g., learners' cognition, behavior, and interaction), thus improving learners' learning engagement, enjoyment, efficiency, scientific literacy, and practical ability, etc. The main reason for the existence and development of teaching materials is that they provide convenient means for the systematic structure of teaching, but there are no perfect teaching materials (). Teaching material evaluation is really a process of alignment (matching needs with feasible solutions) (). The meliorization framework and the hyperfeedback mechanism of plural subjects of teaching material emphasize that it is necessary to analyze each element of the process of knowledge perception and psychological cognition of teaching materials separately, and to take them as a whole to analyze their mutual influence and function. At the same time, it is necessary to integrate more adequate perception data from people. The operation process of the model is not a one-way optimization problem, but a complicated interweaving of constraints and objectives in each evaluation dimension (e.g., the possibility and quality level of teaching materials to support students and teachers to achieve curriculum literacy goals), and a process of improve step-by-step in each evaluation dimension or stage with the support of multi-source data. According to the different characteristics of the landsense indicators, there are different manifestations of the meliorization model, but its core idea is to emphasize the continuous feedback, regulation and improvement in the process of teaching material use and evaluation. Using the plural-subjects meliorization thinking to study the problem of teaching material evaluation will make the goal and process of textbook curriculum construction more clearly understood, and take timely countermeasures according to the actual application of teaching materials and the needs of users. The application of the meliorization thinking in the concept of landsenses ecology can make the landsense design and evaluation of teaching materials get rid of the once-and-for-all planning ideas, so as to better adapt to the sustainable development of teaching materials and meet the needs of learning subjects constantly updated.

The application prospect of IPA and linguistic landsenses in teaching material evaluation

The traditional evaluation framework mainly relies on single-dimensional satisfaction judgments. By collecting learners' satisfaction scores for several dimensions of the teaching materials, it draws conclusions on how the teaching materials perform. Although this evaluation method can capture the learners' intuitive feelings, it cannot answer another more crucial question whether the performance perceived by the students matches their inner expectations. IPA adds the reference dimension of importance, expanding the single-dimensional satisfaction judgment to a two-dimensional comparison and analysis of expectations and experiences, thus transforming the evaluation of teaching materials from a static description of satisfaction levels to a dynamic diagnosis of whether expectations and experiences match. This discovery does not deny the value of the traditional framework, but rather points out that the satisfaction standards on which the traditional evaluation framework is based lack reference system calibration. Its judgment results may overestimate the experience quality of the teaching materials in actual use and lack the backtracking and correction mechanism starting from the learner's experience.

Furthermore, the IPA results of this study show that learners' evaluations of the importance and satisfaction of Western cultural elements are both at a relatively low level, indicating that there may be a mismatch between the designer's intention and the user's perception. This discovery proposes a further revision to the previous call that teaching material evaluation should shift from entity research to subjectivity research (), that is, simply turning to users may not be sufficient. If the single-focus satisfaction survey is still used, even if it turns to users, only satisfaction data can be obtained, but the gap between importance and satisfaction cannot be identified. In other words, turning to users is only the first step. The key lies in what kind of analytical framework to introduce. The evaluation of teaching material landsense based on IPA is a systematic expansion of the existing assessment dimensions, transforming the evaluation of teaching materials from the static judgment of a single subject on the text to the dynamic analysis of the perceptual interaction of multiple subjects during the use of teaching materials. At the same time, it enables the revision of teaching materials to adopt a hierarchical action strategy: immediate revision items (indexes falling into the fourth quadrant of high importance but low performance), mid-term optimization items (indexes falling into the third quadrant of low importance and low performance), advantage maintenance items (indexes falling into the first quadrant of high importance and high performance), and moderate attention items (indexes falling into the second quadrant of low importance but high performance). In addition, the teaching material planning should follow the principle that multiple subjects jointly create landsense indexes. Before revision, the designers should conduct research on the current status of teaching materials and the users' demands, guiding the teaching material compilers and users to jointly participate in the planning and construction of teaching material indexes, so as to promote the positive transfer from in-class learning to extracurricular application, laying a foundation for the accumulation of students' humanistic qualities and the cultivation of their lifelong learning abilities.

Conclusion and suggestion

Summary of findings

This study, taking learners' perceptions as the point of departure, analyzes the landsense-oriented optimization model and hyperfeedback mechanism through which teaching material performance promotes learning engagement, enjoyment, and efficiency from behavioral, cognitive, emotional, and social dimensions. The main findings can be summarized into three aspects.

First, among the multiple dimensions of teaching material landsense, student applicability plays a dominant role in subjects' perceptual experience, followed by language content, while subjects pay relatively little attention to Western cultural elements. This finding reveals the hierarchical nature of textbook landsense—that is, learners' perceptions of teaching materials are not evenly distributed but are centered on the dimensions most relevant to their own learning practices. This provides specific directions for teachers to adjust input in order to facilitate learning engagement.

Second, the IPA analysis uncovered deep-seated issues that traditional satisfaction surveys fail to capture. By introducing importance as a reference coordinate, it extends the traditional unidimensional satisfaction evaluation into a dual-coordinate expectation-experience gap analysis, offering a more explanatory diagnostic tool for assessing teaching material quality.

Furthermore, the mediation analysis revealed that the influence of teaching material performance on learning efficiency can operate through both direct and indirect pathways. The direct effect validated the immediate impact of the teaching material as a learning environment field, while the indirect effect was realized through the sequential pathway of foreign language enjoyment and learning engagement. This finding corroborates the hierarchical transmission mechanism of “physical senses → psychological perceptions → behavioral intention” emphasized in the landsense concept. This constitutes the intrinsic mechanism through which the multiple landsense indicators of teaching materials affect learning outcomes.

Theoretical contributions and practical implications

The theoretical contribution of this study lies in extending the landsense concept from the field of environmental perception to the domain of teaching material evaluation, thereby providing a new theoretical lens for understanding the subjective attributes of teaching materials. IPA further expands the evaluation of teaching materials to the analysis of the expectation-experience gap of landsense indicators. Its dual-coordinate positioning function can also answer the practical question of which gaps should be prioritized for improvement, achieving the transformation from problem diagnosis to action guidance. Additionally, a chain mediation model uncovers the psychological mechanism underlying the influence of teaching material performance on learning outcomes, offering empirical insights into how teaching materials truly function.

On a practical level, the value of this study is reflected in three dimensions. For teaching material editors, it provides an evidence-driven priority list, clarifying which aspects require priority improvement and which strengths should be maintained, thereby shifting teaching material revision from experience-based judgment to data-driven decision-making. For frontline teachers, the findings suggest that the key to enhancing learning efficiency lies not only in the teaching material content itself, but also in how instructional design and classroom interactions can activate the potential of teaching materials to stimulate positive emotions and promote active engagement. For educational policymakers, this study offers a dynamic analytical tool for teaching material evaluation, laying a methodological foundation for constructing an evaluation community involving multiple stakeholders (e.g., editors, assessors, and users).

Limitations and suggestions

Several limitations of this study should be acknowledged. First, the sample was drawn from L2 learners at a specific university, whose educational background and cultural context have certain particularities; thus, the cross-contextual generalizability of the findings requires further examination. Second, this study employed cross-sectional data, which can only capture users' perceptions at a specific point in time and cannot reveal the dynamic evolutionary patterns of expectation-experience gap of landsense indicators during the process of teaching material use. Third, this study focused on a single teaching material case. Although this allows for an in-depth analysis of its landsense characteristics, the generalizability of the conclusions needs to be verified through more empirical studies involving different teaching materials and disciplines.

Based on the aforementioned limitations and the findings of this study, future research could expand the heterogeneity of the sample to include learner groups from different educational stages, cultural backgrounds, and language proficiency levels, thereby examining the cross-group stability of the landsense perception structure and exploring the influence mechanisms of cultural context on teaching material evaluation. In addition, longitudinal designs could be employed to track the dynamic changes in learners' perceptions of teaching materials across different learning stages, revealing the evolutionary patterns of teaching material landsense and its temporal relationship with learning outcomes. Furthermore, integrating qualitative methods (e.g., interviews and focus groups) could provide deeper insights into the reasons behind learners' evaluations of specific indicators, combining quantitative diagnosis with qualitative understanding. Meanwhile, variables (e.g., teacher factors and classroom atmosphere), which may influence learning engagement and enjoyment, should also be incorporated to provide a richer evidence base for teaching material improvement.

Statements

Data availability statement

The original contributions presented in the study are included in the article/supplementary material. Further inquiries can be directed to the corresponding author/s.

Ethics statement

The studies involving humans were approved by the research committee of the first author's institution with an ethical approval letter on May 6th, 2026 (Approval number: 20260506). The study fulfilled all the ethics requirements regarding human participants. The research was conducted following the Declaration of Helsinki's appropriate rules and regulations that apply when involving human participants. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study. Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.

Author contributions

LZ: Writing – review & editing, Writing – original draft, Validation, Supervision, Software, Funding acquisition.

Funding

The author(s) declared that financial support was received for this work and/or its publication. This research was supported by funding from the Heilongjiang Provincial Education Science Planning Project [GJB1526238].

Conflict of interest

The author(s) declared that this work was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Generative AI statement

The author(s) declared that Generative AI was not used in the creation of this manuscript.

Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2026.1901977/full#supplementary-material

References

  • 1

    AppletonJ. J.ChristensonS. L.FurlongM. J. (2008). Student engagement with school: critical conceptual and methodological issues of the construct. Psychol. Sch.45, 369–386. doi: 10.1002/pits.20303

  • 2

    BreenM. P.CandlinC. N. (1987). “Which materials: a consumer's and designer's guide,” in ELT Textbooks and Materials: Problems in Evaluation and Development, ed. L. E. Sheldon (London: Modern English Publications in Association with The British Council), 13–28.

  • 3

    ChenK.GaoY.ZhouJ.ChenN, Amiri, F.KhodiA.et al. (2025). Inclusive language testing for migrant and global learners: theory meets practice in English-mediated instruction. Forum for Linguist. Stud.7, 404–491. doi: 10.30564/fls.v7i6.9249

  • 4

    ChiuT. K. F. (2022). Applying the self-determination theory (SDT) to explain student engagement in online learning during the COVID-19 pandemic. J. Res. Technol. Educ. 54(sup1), S14-S30. doi: 10.1080/15391523.2021.1891998

  • 5

    CsikszentmihalyiM. (2008). Flow: The Psychology of Optimal Experience. New York, NY: Harper Perennial.

  • 6

    De SmetA.MettewieL.GalandB.HiligsmannP.Van MenselL. (2018). Classroom anxiety and enjoyment in CLIL and non-CLIL: does the target language matter?Stud. Second Lang. Learn. Teach.8, 47–72. doi: 10.14746/ssllt.2018.8.1.3

  • 7

    DewaeleJ. M.MacintyreP. D. (2014). The two faces of Janus? Anxiety and enjoyment in the foreign language classroom. Stud. Second Lang. Learn. Teach.4, 237–274. doi: 10.14746/ssllt.2014.4.2.5

  • 8

    DewaeleJ. M.SaitoK.HalimiF. (2022). How foreign language enjoyment acts as a buoy for sagging motivation: a longitudinal investigation. Appl. Linguist.44, 22–45. doi: 10.1093/applin/amac033

  • 9

    Elahi ShirvanM.TaherianT. (2018). Longitudinal examination of university students' foreign language enjoyment and foreign language classroom anxiety in the course of general English: latent growth curve modeling. Int. J. Biling. Educ. Biling.24, 31–49. doi: 10.1080/13670050.2018.1441804

  • 10

    FornellC.LarckerD. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. J. Mark. Res.18, 39–50. doi: 10.1177/002224378101800104

  • 11

    HairJ. F.AndersonR. E.TathamR. L.BlackW. C. (1998). Multivariate Data Analysis, 5 Edn. Upper Saddle River, NJ: Prentice Hall, 648–650.

  • 12

    HairJ. F.HultG. T. M.RingleC. M. (2017). A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM), 2nd Edn.Thousand Oaks, CA: Sage Publications.

  • 13

    HanL.ShiL.YangF.XiangX.GaoL. (2021). Method for the evaluation of residents' perceptions of their community based on landsenses ecology. J. Clean. Prod.281:124048. doi: 10.1016/j.jclepro.2020.124048

  • 14

    HutchinsonT.WatersA. (1987). “Materilas evalution,” in English for Specific Purposes: A Learning-Centred Approach, eds. H. B. Altman, P. Strevens (Cambridge: Cambridge University Press), 96–105.

  • 15

    JangH.KimE. J.ReeveJ. (2016). Why students become more engaged or more disengaged during the semester: a self-determination theory dual-process model. Learn. Instr.43, 27–38. doi: 10.1016/j.learninstruc.2016.01.002

  • 16

    JiangT.NiuZ.HuN.YuY. (2016). Greenway satisfication investigation based on the importance-performance analysis method. Ecol. Environ. Sci.25, 815–820 (in Chinese).

  • 17

    KuhG. D. (2009). What student affairs professionals need to know about student engagement. J. Coll. Stud. Dev.50, 683–706. doi: 10.1353/csd.0.0099

  • 18

    LambertC.PhilpJ.NakamuraS. (2017). Learner-generated content and engagement in second language task performance. Lang. Teach. Res.21, 665–680. doi: 10.1177/1362168816683559

  • 19

    LambertC.ZhangG. (2019). Engagement in the use of English and Chinese as foreign languages: the role of learner-generated content in instructional task design. Mod. Lang. J.103, 391–411. doi: 10.1111/modl.12560

  • 20

    LiC.JiangG.DewaeleJ. M. (2018). Understanding Chinese high school students' foreign language enjoyment: validation of the Chinese version of the foreign language enjoyment scale. System76, 183–196. doi: 10.1016/j.system.2018.06.004

  • 21

    LiZ.XuS.ZhaoX.WenH. (2026). Development and implementation of learning efficiency evaluation model: using the double reference point method. Stud. Educ. Eval.88:101553. doi: 10.1016/j.stueduc.2025.101553

  • 22

    LiangY. (2023). Guoji zhongwen jiaocai dongtai pingjia moxing Goujian Yanjiu. J. Sichuan Normal Univ.50, 136–145 (in Chinese).

  • 23

    LiawS. S.HuangH. M. (2007). Developing a collaborative e-learning system based on users' perceptions. Lecture Notes Comput. Sci.4402, 751–759. doi: 10.1007/978-3-540-72863-4_76

  • 24

    LiawS. S.HuangH. M. (2016). Investigating learner attitudes toward e-books as learning tools: based on the activity theory approach. Interact. Learn. Environ.24, 625–643. doi: 10.1080/10494820.2014.915416

  • 25

    LinY.NiuR.YuZ. (2023). Roles of ambiguity tolerance and learning effectiveness: structural equation modeling evidence from EFL students' perceptions of factors influencing peer collaboration. Lang. Teach. Res.30, 3257–3290. doi: 10.1177/13621688231216201

  • 26

    LitzD. R. A. (2005). Textbook evaluation and ELT management: a South Korean case study. Asian EFL J.48, 1–53.

  • 27

    LiuH.MaX.ZhangZ.ChengX.ChenY.KojimaS. (2021). Study on the relationship between thermal comfort and learning efficiency of different classroom-types in transitional seasons in the hot summer and cold winter zone of China. Energies14:6338. doi: 10.3390/en14196338

  • 28

    MacintyreP.GregersenT. (2012). Emotions that facilitate language learning: the positive-broadening power of the imagination. Stud. Second Lang. Learn. Teach.2, 193–213. doi: 10.14746/ssllt.2012.2.2.4

  • 29

    MartillaJ. A.JamesJ. C. (1977). Importance-Performance Analysis. J. Mark.41, 77–79. doi: 10.1177/002224297704100112

  • 30

    MukundanJ.AhourT. (2010). “A review of textbook evaluation checklists across four decades 1970-2007,” in Research for Materials Development in Language Learning: Evidence for Best Practice, eds. B. Tomlinson, H. Masuhara (London: Bloomsbury Academic), 336–352.

  • 31

    MüllerF. A.WulfT. (2020). Technology-supported management education: a systematic review of antecedents of learning effectiveness. Int. J. Educ. Technol. High. Educ.17:47. doi: 10.1186/s41239-020-00226-x

  • 32

    PavelescuL. M.PetrićB. (2018). Love and enjoyment in context: four case studies of adolescent EFL learners. Stud. Second Lang. Learn. Teach.8, 73–102. doi: 10.14746/ssllt.2018.8.1.4

  • 33

    PekrunR.FrenzelA. C.GoetzT.PerryR. P. (2007). “The control-value theory of achievement emotions: an integrative approach to emotions in education,” in Emotion in Education, eds. P. A. Schutz, R. Pekrun (Burlington, NJ: Elsevier Academic Press), 13–36. doi: 10.1016/B978-012372545-5/50003-4

  • 34

    PinielK.AlbertÁ. (2018). Advanced learners' foreign language-related emotions across the four skills. Stud. Second Lang. Learn. Teach.8, 127–148. doi: 10.14746/ssllt.2018.8.1.6

  • 35

    QianY. (1995). Jieshao yifen jiaocai pinggu yilanbiao. Foreign Lang. World57:17 (in Chinese).

  • 36

    ReeveJ. (2013). How students create motivationally supportive learning environments for themselves: the concept of agentic engagement. J. Educ. Psychol.105, 579–595. doi: 10.1037/a0032690

  • 37

    ReeveJ.TsengC. M. (2011). Agency as a fourth aspect of students' engagement during learning activities. Contemp. Educ. Psychol.36, 257–267. doi: 10.1016/j.cedpsych.2011.05.002

  • 38

    ShakM. S. Y.AlbakriI. S. M. A.ShukorS. S.TahirM. H. M. (2022). Criteria in English language textbook evaluation checklists: a systematic review. Int. Assoc. Res. Textb. Educ. Media14, 1–14. doi: 10.21344/iartem.v14i1.978

  • 39

    SulisG. (2022). Engagement in the foreign language classroom: micro and macro perspectives. System110:102902. doi: 10.1016/j.system.2022.102902

  • 40

    SunP. C.TsaiR. J.FingerG.ChenY.-Y.YehD. (2008). What drives a successful e-Learning? An empirical investigation of the critical factors influencing learner satisfaction. Comput. Educ.50, 1183–1202. doi: 10.1016/j.compedu.2006.11.007

  • 41

    TarsitanoE.SinibaldiP.ColaoV. (2021). Green days in the park: a case study on landsenses ecology. Int. J. Sustain. Dev. World28, 632–643. doi: 10.1080/13504509.2021.1920060

  • 42

    UlrichF.HelmsN. H.FrandsenU. P.RafnA. V. (2021). Learning effectiveness of 360 video: experiences from a controlled experiment in healthcare education. Interact. Learn. Environ.29, 98–111. doi: 10.1080/10494820.2019.1579234

  • 43

    WangX. W.ZhuY. J.ZhangY. C. (2022). An empirical study of college students' reading engagement on academic achievement. Front. Psychol. 10:1025754. doi: 10.3389/fpsyg.2022.1025754

  • 44

    WuX.WangZ. (2021). From science knowledge to users' subjectivity: reflections on the development of the evaluation tools for science curriculum materials in the United States in the past three decades. J. Comp. Educ.4, 150–163 (in Chinese).

  • 45

    XuM.ZhangP.WuJ. (2017). Primary mission identification of innovation-driven development strategy implementation based on Importance-Performance Analysis: a case study of Xi'an. Forum Sci. Technol. China11, 28–35 (in Chinese).

  • 46

    ZhangL. (2024). How to measure the impact of landsenses ecology on sustainable development? A review of people-oriented emerging approaches. Environ. Sci. Eur.36, 1–12. doi: 10.1186/s12302-024-01010-8

  • 47

    ZhangL.HuangG.HaC.BaoS. (2026). How linguistic landsense shapes the perceived brand image of business ecological products. Humanit. Soc. Sci. Commun. doi: 10.1057/s41599-026-08180-1

  • 48

    ZhangL.HuangG.LiY.BaoS. (2021a). The application of landsenses ecology in language carriers. Int. J. Sustain. Dev. World28, 653–660 . doi: 10.1080/13504509.2021.1920062

  • 49

    ZhangL.HuangG.LiY.BaoS. (2021b). A psychological perception mechanism and factor analysis in landsenses ecology: a case study of low-carbon harmonious discourse. Int. J. Environ. Res. Public Health18:6914. doi: 10.3390/ijerph18136914

  • 50

    ZhangL.HuangG.LiY.BaoS. (2021c). Quantitative research methods of linguistic niche and cultural sustainability. Sustainability13:9586. doi: 10.3390/su13179586

  • 51

    ZhangL.HuangG.LiY.BaoS. (2022). Advancement trajectory of emerging landsenses ecology for sustainability research and implementation. Int. J. Sustain. Dev. World29, 641–652. doi: 10.1080/13504509.2022.2075483

  • 52

    ZhangL.XuD.ZhangW.ZhangL. (2025). Research on the shift of sustainable consumption behavior from the perspective of linguistic landsense. Discov. Sustain.6:1090. doi: 10.1007/s43621-025-01999-9

  • 53

    ZhangX. (2001). Introducing two evaluation standards for English teaching material. J. PLA Univ. Foreign Lang.24, 61–65 (in Chinese).

  • 54

    ZhangY.LuoY. (2022). The preliminary construction of the importance-performance model (I): an investigation into the effectiveness of music teacher education in Chian. Peoples Music3, 57–61 (in Chinese).

  • 55

    ZhangY.WangL.DongR.DengH.FuX.HuangBet al. (2023). Understanding the effects of urban perceptions on housing rent using big data and machine learning. Int. J. Sustain. Dev. World30, 964–980. doi: 10.1080/13504509.2023.2234332

  • 56

    ZhaoJ. (1998). Lun duiwai hanyu jiaocai pinggu. Lang. Teach. Linguist. Stud.3, 4–19 (in Chinese).

  • 57

    ZhaoJ.LiuX.DongR.ShaoG. (2016). Landsenses ecology and ecological planning toward sustainable development. Int. J. Sustain. Dev. World23, 293–297. doi: 10.1080/13504509.2015.1119215

  • 58

    ZhaoJ.SuX.ZhangY.DongR.YanY.WangH. (2021). Hyperfeedback: meliorization regulation mechanism towards sustainable development based on landsenses ecology Int. J. Sustain. Dev. World28, 588–592. doi: 10.1080/13504509.2021.1955773

  • 59

    ZhaoJ.YanY.DengH.LiuG.DaiL.TangL.et al. (2020). Remarks about landsenses ecology and ecosystem services. Int. J. Sustain. Dev. World27, 196–201. doi: 10.1080/13504509.2020.1718795

  • 60

    ZhaoY.XiaoL. (2020). Analysis on the landsense creation of Chinese classical poetry and mountains-and-waters painting based on landsenses ecology. Int. J. Sustain. Dev. World27, 292–296. doi: 10.1080/13504509.2020.1726835

Keywords

Importance-Performance Analysis, landsense indicators, learning efficiency, linguistic landsenses, teaching material performance

Citation

Zhang L (2026) Quality education from the perspective of landsenses ecology: research on performance evaluation of L2 teaching materials based on Importance-Performance Analysis. Front. Psychol. 17:1901977. doi: 10.3389/fpsyg.2026.1901977

Received

06 June 2026

Revised

21 July 2026

Accepted

23 July 2026

Published

01 October 2026

Volume

17 - 2026

Edited by

Daniel H. Robinson, The University of Texas at Arlington College of Education, United States

Updates

Copyright

© 2026 Zhang.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Lan Zhang, zhanglan9416@stu.scau.edu.cn

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

来源:Frontiers in Psychology · frontiersin.org

猜你喜欢