Proceedings of the workshop "Intelligent Educational Systems on the World Wide Web",
8th World Conference of the AIED Society, Kobe, Japan, 18-22 August 1997

An Implementation of the WWW Based ITS for Guiding Differential Calculations

Yasuhisa OKAZAKI
Department of Information Science,
Faculty of Science and Engineering,

Saga University
Saga-shi Saga 840, JAPAN
Phone: +81-952-28-8506
FAX: +81-952-28-8650
E-Mail: okaz@ai.is.saga-u.ac.jp
URL: http://www.is.saga-u.ac.jp/ai/staff/okaz.html


Kenzi WATANABE
Department of Computer and Communication Sciences,
Faculty of Systems Engineering,
Wakayama University
Wakayama-shi Wakayama 640, JAPAN
Phone: +81-952-28-8506
FAX: +81-734-54-0134
E-Mail: watanabe@sys.wakayama-u.ac.jp
URL: http://www.sys.wakayama-u.ac.jp/~watanabe


Hiroki KONDO
Department of Information Science,
Faculty of Science and Engineering,

Saga University
Saga-shi Saga 840, JAPAN
Phone: +81-952-28-8504
FAX: +81-952-28-8650
E-Mail: kondo_h@ai.is.saga-u.ac.jp
URL: http://www.is.saga-u.ac.jp/ai/staff/kondo_h.html

Abstract. This paper describes a WWW based ITS(we call ``WITS'' in short) for guiding differential calculations at high school. The basic structure of the WITS follows a standard ITS. All modules of the WITS are constructed on a WWW server except interface, that is implemented with a WWW client. The individualized tutoring mechanism is accomplished by combination of CGI(Common Gateway Interface) and FOF(Fill-Out Form) facilities of the WWW and user modeling technique on ITS technology. Distinctive features of our system are (1)user's (students') error origin identification based on buggy model, (2)student's state classification based on score and frequency of the bug, (3)teaching paradigms' selection based on classified student's states, (4)individualized guidance message generation and (5)adaptive KR message generation in the WWW framework. The advantages of the WWW for an ITS are that a user can access to the system from anywhere on the Internet without any special interface programs. Although the WWW framework causes some limits especially in its interface, it brings an ITS great benefit.

1 Introduction

Many schools in Japan have started to join in the Internet [1]. Educational use of the Internet has been expected to bring new educational environments and tools in classroom[2].

The World-Wide Web(WWW) is one of the most popular technology on the Internet in school. We have proposed an application of the WWW in school as a platform for an educational system[3]. Although there are many proposals and experiments on building educational systems of the WWW framework [4,5,6,7,8], they lack error origin identification mechanism that is one of essential mechanisms for highly individualized tutoring.

We have integrated the WWW with ITS[3,9] and implemented a WWW based ITS(we call ``WITS'' in short) that guides each student based on his error origin.

Our system is a WITS for guiding differential calculations at high school level[10,11]. Distinctive features of our system are that it identifies student's error origin by buggy model[12] and classifies student's states based on his scores and frequency of the bug (See section 4.5). It realizes individualized tutoring by generating Hyper Text Markup Language(HTML) documents dynamically based on each student's state.

The advantages of the WITS are that a user can access to the system from anywhere on the Internet without any special interface programs.

In this paper, we describe our WWW based ITS(WITS) for guiding differential calculations. In section 2, we present architecture of the WITS. We explain individualized tutoring mechanism in the WWW framework in section 3. In section 4, we describe features of our system and how it works. We evaluate our system in section 5. Section 6 gives summary and future works.

2 Architecture of the WWW based ITS(WITS)

We show architecture of the WITS in Figure 1. The WITS adopts CGI and FOF facilities for interactive communication between a user(student) and the system. Since these facilities are very common in the WWW framework, only a WWW client is required to use it.

Architecture of the WITS
Figure 1: Architecture of the WITS: The system consists of teaching knowledge that is expressed as CGI scripts, courseware knowledge, student model in server side and interface implemented by WWW clients. Teaching knowledge dynamically generates HTML documents based on user's(student's) current input and his student model.

3 Individualized tutoring mechanism in the WWW framework

Individualization is essential for an ITS. However, the WWW that adopts a stateless protocol, which is called HTTP, has no mechanism to identify a user. It just sends back a response unrelated to whose request. We have overcome this problem by applying CGI and FOF facilities. We embed a user identifier into every action in the HTML documents by using ``HIDDEN tag'' of FOF. An example of the embedded user identifier is as follows:
<FORM METHOD="post" ACTION="/cgi-bin/ITS/quit">
<INPUT TYPE="HIDDEN" NAME="username" VALUE="okaz@ai.is.saga-u.ac.jp">
<INPUT TYPE="submit" VALUE="no">
</FORM>

After the system recognizes a user, all HTML documents continue including the user identifier. This user identifier is registered by the user and protected by the password.

This mechanism enables user management in the WWW server and to apply the standard ITS student modeling method. Combining CGI facility on the WWW with user modeling technique on an ITS realizes flexible and individualized tutoring on the WITS(Figure 2).

Individualized tutoring mechanism in the WWW framework
Figure 2: Individualized tutoring mechanism in the WWW framework: The teaching knowledge that is expressed as CGI script analyzes the user identifier and updates the student model file if necessary. Teaching knowledge decides teaching paradigms and generates an individualized message based on the student state and courseware knowledge. The output follows HTML format so as to be presented via a WWW client. The system embeds the user identifier in it for user identification

4 The WITS for guiding differential calculations

4.1 Outline and features of our system

Our system is designed for high school students who have learned differential calculations in classroom lessons in school[13]. It has two modes corresponding to the purposes of its use. The one is practice mode and the other is remedy mode. The system consists of fixed HTML files(54 files, total 140 KB), CGI scripts(49 files, total 22 MB) and plain text data files. Nine of them are teaching knowledge which is implemented by SICStus Prolog Release 3. Other scripts are B shell scripts on UNIX. We use UNIX workstation(Sun Microsystems SPARCstation 5) for WWW server machine.

The main features of our system are as follows:

4.2 How the system works

Our system works as follows:

  1. Access
    Our system can be accessed in the following URL, which is Home Page of Intelligent Information Science Laboratory of Department of Information Science in Saga University.
    http://www.is.saga-u.ac.jp/ai/ai.html
  2. Initial set up
    The system identifies the user by the registered user name and password.
    When it is the first time of use, the user needs to register a user name and a password.
  3. Select purpose and problem type
    The user selects the purpose either practice or remedy. In practice mode, the user selects a target function type and a difficulty level. The user solves 5 problems in a period. In remedy mode, the user specifies the form of problems. The user solves 3 problems in a period.
  4. Solve a problem
    The system automatically generates a specified type of problem and candidates for an answer. They include individualized buggy candidates. The user selects an answer from the candidates.
  5. Answer analysis and guidance
    The system analyzes user's answer. If it has an error, the error origin is identified. Then an individualized message based on student model is presented(See Figure 4).
  6. Continue studying in a period
    By repeating step 4 and step 5, the user continues studying in a period.
  7. Period end
    When the period is end, the system presents the record of this time study and KR message.
  8. Continue studying or stops
    The user selects a next study period or stops studying.

4.3 Courseware Knowledge

Processes of differential calculations can be seen as sequential application of mathematical operations. We call this knowledge unit as ``tactics''. The tactics, which reduces an expression INPUT to an expression OUTPUT by using operation named TACTICS, is expressed by the following Prolog predicate,

tactics(INPUT,OUTPUT,TACTICS,CB).

The variable CB represents that the operation is correct or buggy.

This representation enables the system to simulate solving processes of human being and it is useful for student modeling and guidance. Our system has 12 kinds of tactics in the courseware knowledge.

4.4 Error origin identification based on buggy model

Here we present how the system identifies the error origin. We adopt ``buggy model''[12] that is one of the standard modeling method for error origin identification in ITS technology.

For example, differentiating function ``y=sin 5x'' is ``y'= cos 5x'' is expressed by the following buggy knowledge named ``[formula-7,bug-1]'':

tactics([sin,F],[cos,F],[formula-7,bug-1],b).

The last ``b'' indicates this is buggy knowledge. Buggy knowledge is expressed by same form as correct knowledge.

We have carried out field researches in high schools and analyzed about 400 errors[14]. The most errors except slips can be explained by buggy knowledge. Our system has 13 buggy knowledge that includes all buggy knowledge in [14].

4.5 Student's state classification and teaching paradigm decision

Our system classifies student's states by the error origin(bug), its frequency and average score. The frequency of the bug is expressed in a Prolog list form "[BugName,[A,M]]", where the variable BugName represents the name of bug, the variable A represents how many times the student has made mistakes in this origin and the variable M represents total problem number in which the student has be possible to make this bug.

As the frequency of the bug becomes higher, the average score becomes lower. Thus the student's state is in the triangle region of the frequency of bug i and average score space.

Student's state classification
Figure 3: Student's state classification: student's state of each region expresses the following state;
a:almost understanding state d:state in tendency of making this bug
b:little unstable state e:state in liability to make this bug
c:state in tendency of making another bug f:misunderstanding state

We divide this space into 6 regions as we show in Figure 3. Simple guidance is enough for students in upper score regions. On the other hand, students in lower score regions require concrete guidance. We assign each student's state region appropriate teaching paradigms (See Table.1). Teaching knowledge includes 6 teaching paradigms related to the student's state.

Table 1: Relation between teaching paradigms and student's states

Teaching Paradigm Student's state
abcd ef
Correct or error point out o o o o o o
Correct answer exhibition  o o o o  
Error origin explanation    o o o
Formula explanation   o o  
Solving process explanation      o

Although our system has data which types of problems a student has solved, our tutoring method focuses on the bug and not takes into account them. Tutoring mechanism which takes into account dynamical progress of study has not implemented at present.

4.6 Guidance message generation

When a student makes an error, the system presents a guidance message. Teaching knowledge module has guidance message patterns for each bug, each teaching paradigm and each student's state. Teaching knowledge module generates guidance messages by embedding appropriate expressions into the patterns. The appropriate expressions are generated by using courseware knowledge (Figure 4).

4.7 Abstract KR message generation

Abstract KR(Knowledge of Result) message is the message to encourage a student. The system presents this message at the end of a period of study The system selects some of the 6 topics, which are ``this time study record'', ``this time score'', ``achievement'', ``error tendency'', ``next study step'' and ``encouragement'', according to the student model, and generate an appropriate message.

5 Evaluation of our system

Table 2: Results of the questionary from November 24, 1996 to July 5, 1997 : 97 people have used our system within the period and 20 people have answered the questionary.

 very goodgoodaverage below averagepoor
Response 0 8 6 5 1
Contents of guidance 10 4 7 1 0
Use of language 7 6 5 0 1

Our system was opened to the public on April 25, 1995. The latest version of the system has opened since October 29, 1996. We present some results of the questionary in Table 2.

The response of the server is fairly well. The reasons are that the amounts of data are little (they are plain text and less than a few Kilo bytes), data exchange between the WWW server and the client is not so often and quick response of the WWW server owing to simple student's diagnosis and tutoring mechanism. The response depends not only the server but also the network. Although multimedia such as video and audio may be useful, it would lose its effects when the system keeps a student waiting long.

An example of a generated guidance message for state 'e'
Figure 4: An example of a generated guidance message for state 'e'. It says "Your answer is wrong. Differentiating the function y=sin 5x is not y'= cos 5x. The correct answer is y'= 5 cos 5x. Although differentiating the function y=sin x is y'= cos x, differentiating the function y=sin 5x is not y'= cos 5x. The function y=sin 5x is a composite function, which is composed of y = sin u and u = 5x.
Our guidance mechanism gives fairly good results. However, evaluation of guidance is not wholly satisfactory. Our guidance mechanism focuses only on the average score and frequency of the identified bug. We think our student modeling is little oversimplified. We are now in progress of research in more sophisticated tutoring mechanism which based on more accurate student model.

Use of language also has room for improvement. Our method is likely to generate same or similar messages repeatedly to the same student. It is necessary for discourse mechanism to generate flexible and situated messages.

6 Summary and future works

As an educational system of the WWW framework, we have implemented a WWW based ITS(WITS). In this paper, we have described architecture of the WITS, especially its individualized tutoring mechanism and illustrated features of our system, a WITS for guiding differential calculations at high school. Distinctive features of our system are user's(students') error origin identification based on buggy model, classification of student's state based on bug frequency and average score, individualized guidance message generation, and adaptive KR message generation in the WWW framework.

The advantages of the WWW for an ITS are that a user can access to the system from anywhere on the Internet without any special interface programs. Although the WWW framework causes some limits especially in interface, the WITS is an effective ITS with the advantages of the WWW.

Future works include another use of student's data gathered in the WWW server and application to another courseware. The former contains (1)construction of average student model and (2)sharing mechanism of student model between other educational systems on the Internet. The latter contains (1)definite separation of teaching knowledge from courseware knowledge and (2)making generalized CGI scripts for a WITS. At present, our system is too specialized to apply another courseware. We also need to settle the problems of limitation of HTML format and teaching paradigms decision to be our system in practical use. After these improvements, we are going to evaluate our system in the real educational field.

References

[1] K. Goto, M. Nakayama, ``Summary of K12 activities in Japan'', Proc. of INET'95, pp.307 - 314, June 1995.
[2] T. L. Parker, ``The Internet and Schools : A Survey of Networking Activities'', Proc. of INET'94, pp.143-1 - 143-8, June 1994.
[3] K. Watanabe, Y. Okazaki and H. Kondo, ``An Internet with multimedia and its application to education, Proc. of the ITEJ 1994, pp.439 - 440, July 1994 (in Japanese).
[4] D. Goldwin-Jones, ``Language Learning and the WWW'', Proc. of WWW94, October 1994.
[5] R. B. Blumberg, ``MendelWeb: An electronic science/math/history resource for the WWW'', Proc. of WWW94, October 1994.
[6] N. Nakamura, M. Kobayashi, K. Miyahara and M. Takeya, ``Design of an Electronic Textbook using Multimedia Network on Mathematical Learning Environment''. Trans. of JSISE, Vol. 12, No. 1, pp.39 - 51, April 1995 (in Japanese).
[7] M. Soga, A. Kashihara and J. Toyoda, `` How to Make Fill-in-blank Program Problems'' Proc. of HCI'95, July 1995.
[8] K. Nakabayashi, Y. Koike, M. Maruyama, H. Touhei, S. Ishiuchi and Y. Fukuhara, ``An Intelligent Tutoring System on World-Wide Web: Towards an Integrated Learning Environment on a Distributed Hypermedia'', Proc. of ED-MEDIA95, pp.488 - 493, June 1995.
[9] P. Brusilovsky, ``Intelligent Tutoring System for World-Wide Web'', Proc. of WWW95, April 1995.
[10] Y. Okazaki, K. Watanabe and H. Kondo, ``A development of an ITS of the WWW, Trans. tech. SIG-IES-9502-08 JSAI, pp.50 - 57, October 1995 (in Japanese).
[11] Y. Okazaki, K. Watanabe and H. Kondo, ``WWW Based ITS for Guiding Differential Calculations: Individualized Tutoring Mechanism in the WWW Framework'' Proc. of International Symposium on Educational Revolution with Internet(ERI'96), pp.65 - 71, December 1996.
[12] J. S. Brown and R. R. Burton, ``Diagnostic models for procedural bugs in basic mathematical skills'', Cognitive Science, Vol. 2, No. 2, pp.155-192, 1978.
[13] Y. Okazaki and H. Kondo, ``A development of an ITS for guiding differential calculations'', Trans. tech. SIG-IES-9601-01 JSAI, pp.1 - 8, May 1996 (in Japanese).
[14] Y. Okazaki, S. Tadaki and H. Kondo ``Analysis of student's errors in differential calculations and buggy model'', Trans. of JSISE, Vol. 10, No. 3, pp.91 - 101, September 1993 (in Japanese).