Deakin University
Browse

File(s) not publicly available

BiDKT: Deep Knowledge Tracing with BERT

conference contribution
posted on 2022-01-01, 00:00 authored by W Tan, Y Jin, Ming LiuMing Liu, H Zhang
Deep knowledge Tracing is a family of deep learning models that aim to predict students’ future correctness of responses for different subjects (to indicate whether they have mastered the subjects) based on their previous histories of interactions with the subjects. Early deep knowledge tracing models mostly rely on recurrent neural networks (RNNs) that can only learn from a uni-directional context from the response sequences during the model training. An alternative for learning from the context in both directions from those sequences is to use the bidirectional deep learning models. The most recent significant advance in this regard is BERT, a transformer-style bidirectional model, which has outperformed numerous RNN models on several NLP tasks. Therefore, we apply and adapt the BERT model to the deep knowledge tracing task, for which we propose the model BiDKT. It is trained under a masked correctness recovery task where the model predicts the correctness of a small percentage of randomly masked responses based on their bidirectional context in the sequences. We conducted experiments on several real-world knowledge tracing datasets and show that BiDKT can outperform some of the state-of-the-art approaches on predicting the correctness of future student responses for some of the datasets. We have also discussed the possible reasons why BiDKT has underperformed in certain scenarios. Finally, we study the impacts of several key components of BiDKT on its performance.

History

Event

13th EAI International Conference, ADHOCNETS 2021

Volume

428

Series

Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

Pagination

260 - 278

Publisher

Springer

Location

Virtual event

Place of publication

Berlin, Germany

Start date

2021-12-06

End date

2021-12-07

ISSN

1867-8211

eISSN

1867-822X

ISBN-13

9783030980047

Language

eng

Publication classification

E1 Full written paper - refereed

Title of proceedings

Ad Hoc Networks and Tools for IT

Usage metrics

    Research Publications

    Categories

    No categories selected

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC