Research Associate (Office For Research) [Nie]

The National Institute of Education invites suitable applications for the position of Research Associate on a 12-month contract (renewable) at the .

Project Title:

Data and Theory Driven Artificial Intelligence to Boost the Science of Learning (AI4SoL)

Project Introduction:

Many primary school students struggle with mathematical word problems due to challenges in:

Structure inquiry using Polya's Problem-Solving Processes covers four steps:

Traditional teacher-guided structured inquiry leads students through the four steps to help them address the challenges in word problem solving, but its scalability is limited by classroom constraints such as teacher workload and time. Teacher-guided structured inquiry in a classroom setting cannot adapt to every student’s pace of learning nor could the teacher provide timely feedback to every student.

While self-studying worked examples allows students to learn at their own pace, such learning lacks immediate feedback when they are overwhelmed by vast amount of information designed in the worked examples. They may hence focus on mimicking the steps in a worked example without full understanding. Self-study may be also constrained by students’ motivation and self-regulation (e.g., monitoring and regulating one’s own learning).

The use of educational technologies is increasingly becoming more ubiquitous in mathematics education. With artificial intelligence (AI) being integrated into the development of educational technologies, for example Intelligent Tutoring Systems (ITSs), AI for education (AIED) applications could provide real-time error detection and personalized feedback to students. But the development of ITSs is often costly and limited (e.g., explicit development knowledge model and the design of hints/scaffolding using a rule-based approach). The optimization of adaptive feedback requires big data being collected for training the algorithms of the ITS. The use of ITSs may also lead to students’ over-reliance on ITS adapting learning progression and hints based on big data, subjecting students to potential data biases, limiting their learner agency and therefore under-optimizing their learning and transfer.

The recent widespread availability of pretrained Large Language Models (LLMs), such as ChatGPT, shows renewed potential for AIED: LLMs may provide timely personalized feedback to students in a more natural way (e.g., being dialogical) and on a scale, without a need to build explicit hints or knowledge models.

There are still challenges to overcome in adopting LLMs in math teaching and learning, making it a promising nascent field in AIED research. For example, the extents to which LLMs can accurately solve math problems and assess students’ work, e.g., their conceptual understanding, etc. The effective pedagogical use of LLM for math teaching and learning is also emerging to be an important area of research.

Specifically in math education, mathematics learning requires both conceptual and procedural knowledge, and students learn mathematics through sense-making of these types of knowledge through problem-solving (e.g., word problem solving). This requires students to access and/or construct their own relevant mathematics knowledge, create representations of said knowledge, and map their representations to the knowledge. Besides using these steps to problem-solve, mathematics learning also requires students to communicate their problem-solving strategies and solutions. From a socio-constructivist perspective, co-constructing knowledge requires a dialogic exchange between teacher and students, and feedback from teachers is essential in mathematics discourse. Based on Thurlings et al.’s models of feedback processes, most feedback in computer systems is cognitivist in nature. The advancements in LLMs appear promising in bridging this dialogic gap in feedback and learning via computer systems.

Education Study 1 aims to test the efficacy of ChatGPT in teaching mathematics word problem solving through dialogue in structured inquiry. Specifically, this study investigates the extent to which a ChatGPT-supported structured inquiry application can:

Findings could contribute to the growing literature on LLMs in education within the field of AIED and implications of design and development of LLM-based learning applications (e.g., through prompt engineering). Furthermore, the use of process data as a study instrument could contribute to both methodology (introduce system process data to support findings from research on technology-education interactions) and design (system designs that leverage LLM to enact educational practices (e.g., dialogic practice) that work.

Requirements:

Academic qualifications:

Work experience:

Desirable interests, skills, and attributes:

Responsibilities:

Application

Applicants (external and internal) will apply via Workday. We regret that only shortlisted candidates will be notified.

Closing Date

Closing date for advertisements will be set to 14 calendar days from date of posting.