On The Line
Developing Conferencing Within a Distance Learning Management Education Context: Training the Tutors
Presented to: On line Educa Asia,
September 1997
Introduction
The Open University Business School is concerned with the professional development of managers up to and including Master of Business Administration (MBA) level over much of Western Europe and increasingly in other parts of the world, through multi-media, supported distance learning.

Many commentators are arguing currently that technology provides all educators with a challenge and an opportunity as we move into the next Century. Macfarlane argues that the challenge is to "construct & deploy highly supportive environments" ..providing " self-paced tutor supported learning" . The challenge is to change the ways we aid the learning process to increase individual support, collaborative environments and provide more flexibility - to explore, where we do want to change our ways, where we do not, what we can do better than ever, what we can do that was not possible before - in terms of learning & teaching.

New Communication Technologies (NCTs) present particular opportunities to distance education institutions such as UK Open University Business School (OUBS). Individuals do not need to be logged on at the same time, there is freedom from spatio-temporal limitations, there are opportunities for reflective or spontaneous interaction, increased contact between individuals , more control of communications for students, more communicating in writing

One important application of NCTs is Computer Mediated Conferencing (CMC). In this paper we address in particular the training and development of Distance Learning teachers faced for the first time with the need to use Computer Mediated Communication (CMC) for teaching purposes, taking Metz's wide definition of CMC as "any communication patterns mediated through the computer" p31.

Some researchers, writing in the late 1980s about organisational use of CMC, reported as little as 20% successful implementation of electronic communication systems citing inadequate planning , poor integration and cultural resistance as the main causes of failure It is the contention of our paper that attempting to overcome a training gap would seem an obvious way to increase the success rate - the provision of "a comprehensive learning program designed to ensure at least minimum competency of learner-interface interaction" p.31

We contend that such training and development for effective use of CMC for on-line communication, networking and teaching, needs to be based on a constructivist, learner-centred approach . It needs to address likely barriers to learning in the context of CMC and emphasises a progression from the acquisition of basic skills through to the development of deeper insight into the potential of CMC as a teaching and communication medium.

The immediate training need
The Open University Business School first offered an MBA from 1989. In 1994 the decision was taken was to produce a purpose designed and fully integrated Foundation year, which came to be known as B800, Foundation for Senior Managers. Early in the design process, the Course Team took the decision to integrate the educational, networking, communication and administrative opportunities offered by computer conferencing into the Course Design. In May 1995, the decision was taken that the software platform to be used would be FirstClass. At this time, a very small team of interested individuals were set up under the joint Chair of the authors to design a training programme for the 180 part time tutors to ensure an adequate level of competence to teach through this medium by the time to course started in February 1996. The users we describe in this paper were logging in from home computers, using modems and telephone lines, to a central server, based in Milton Keynes, England, UK.

The basis of the training programme
Metz’s review of the CMC literature suggested that "research concerning CMC has scrambled along behind the technology" (p. 33), that the field is not yet defined, and there is no fundamental underlying theory Error! Reference source not found.. Metz also makes the plea for seeing Computer Mediated Conferencing as its own context and not the same as e mail (since this leaves out the important issues of culture and many:many communications)

In developing his argument for CMC to be researched as a context rather than as a tool or simply as a channel of communication, Metz insists that an action research perspective is the most useful . Wild, writing recently of the need to develop a theoretical base for CMC research says:

"Interpretivist and developmental studies (rather than analytical and comparative research) are likely to enlighten what we already know about what works and what doesn’t in this area"

As the area of study is essentially a new one, it was necessary to have a "starting point" hence the building of a simple model of use based on the practice of students and tutors on line. In this sense, we were following Carr and his description of practical theory, meaning reflective practice .

Earliest uses of content analysis were related to frequency of use of words in documents, typically to describe trends or patterns in the content of the communication, to audit communication against standards or to analyse style ;. However, there are recent examples of researchers using content analysis for evaluation or to infer critical thinking skills from messages in computer mediated conferencing [Newman, 1996 #31; ; . From MBA conferences in 1993 and 1994, content analysis enabled the building of a simple descriptive model of the way that OUBS students and tutors deployed CMC to assist with their teaching and learning on their courses. We have written elsewhere and given further details of the development and key features of this model .

Five Stage Model Fig 1

The Experience of the On Line Training Programme
From this 5 stage model, we then built an on line training programme, through the medium of FirstClass that enabled tutors to take part in conferencing from the very first level, and work through each stage until they became competent and confident on line moderators. See Appendix 1 for illustrations of the computer screens and software. The trainees involved in working through this programme were part time tutors recruited to work on the Foundation year of the OUBS’s distance learning MBA. They were logging in through ordinary telephone lines from all over the UK and Continental Western Europe, using remote PCs to a server in Milton Keynes, England.

Back | Top of Page
Level 1 ACCESS
At this stage we aimed to ensure that tutors were competence and confident at logging into the system and were motivated to continue. We asked them to let us know they had "arrived", by posting a message in the conference, and this enabled us to greet them individually.

187 first messages were posted in the "arrivals" conference between November 1995 and March 1996. The authors of this paper, as the training programme leaders, e-mailed individual welcomes and directional messages to all new "arrivals" on line. The tutors in training were also at this stage given instructions on how to post their resumes - short biographies available to all users of FirstClassä .

All participants were also asked to visit a "Reflections" conference before moving on to level 2, and subsequently at each stage of their training. Since we were taking a broadly constructivist view, the notion of "reflecting" at each stage of the learning was considered to be of key importance for the learning development of the tutors in training. Reflective practice focuses on individual interpretation of events and the framing of these into suitable actions. Implicit in this notion is the idea that practitioners can be prepared for all situations through such an approach. This has broad implications for trainers, and for researchers .

The "Reflections" conference at level 1 aimed directly to test the achievement of the objectives of level 1 as well as to determine the amount of time the training was taking. Access to the conferencing system was rated highly by participants. On a possible scale of 1(-) to 10(+), there was a mean of 6.94, with 47% of tutors in training rating access as 9 or 10, and only 5 (6%) scoring under 5. The attempts to make tutors in training feel valued and welcome in the virtual environment were successful, with a mean score of 8.74 with 54% scoring 9 or 10.

At this stage too, motivation was high. 38% of tutors in training reported that they felt highly motivated to continue with only 7% not motivated. Similarly, very positive feelings were reported both about the training programme (a mean score of 7.84) and only slightly less about using this medium for teaching on the course (7.39).

Off Line Resources
Questions were also asked at this level about the documentation that had been provided to support the tutors in training and what other training aids they would have liked. The documentation was not well received with a mean score of 5.58 with 10% of the tutors in training unhappy with it and only 18% very happy. The main complaint was not about the existence of documentation but about its length, lack of direct compatibility with the 5 levels of the training programme and lack of examples of what would be presented on screen at key stages - a reflection of a problem created by the need to prepare documentation in advance of the finished on-line structure.

At this point at the end of level 1, trainees reported an average of 105 minutes spent off line on reading and preparing to train, and 67 minutes on line. However, the off-line time included, in some cases an inordinate amount of time spent on getting and setting up appropriate equipment.

Back | Top of Page
Level 2 INDUCTION AND SOCIALISATION
Level 2 was intended to provide basic software skills in using FirstClassä , increasing feelings of confidence and comfort in working with others through the CMC medium and the opportunity to find others with similar interests. The "comfort" achieved at this level was considered to be a basic staging post for more constructive and cognitive skills at later level of the training. The feedback collected in the "Reflections" conference, indicated that tutors in training felt they had acquired basic technical skills at this level (mean score of 7.49), and were increasing in confidence (mean of 7.08).
Back | Top of Page
Level 3 SEEKING INFORMATION, FINDING NEW PATHWAYS
The aim of this stage was to encourage the tutors in training to freely offer and seek information from others on line.

At level 3 of the tutor training, additional skills conferences or "workshops" developed participants' ability to work with the software at this level. In addition, on line seminars and workshops were set up to correspond with the four main disciplines of the course for which the tutors were preparing to teach, i.e. Managing People, Finance & Information, Organisations & Change and Marketing. The model suggested that after the basic skills and confidence of working on line was acquired, tutors in training would be interested in considering and discussing the content of the blocks of the course that were relevant to them and this proved to be true. They felt that this level of the programme had fulfilled the objectives for them, with a mean score of over 7 on each of the objectives.

At this level, the participants began to be acutely aware of who was contributing and participating and who was not. Many of the qualitative comments in the "Reflections" conference concerned these aspects.

Back | Top of Page
Level 4 KNOWLEDGE CONSTRUCTION
At this stage, we were looking to encourage and facilitate the kind of interaction between the tutors that could lead to "knowledge construction", as a prelude to their eventually working with students on line. Actions that we promoted were:
    creative and active thinking:creative and active thinking:
    offering up ideas or resources and inviting critique of them
    asking challenging questions
    articulating, explaining and supporting positions on issues
    exploring & supporting issues by adding explanations and examples
    reflecting and re-evaluating personal position

    interactive thinking:
    critiquing, challenging, discussing and expanding ideas of others
    negotiating interpretations, definitions and meanings
    summarising and modelling previous contributions
    proposing actions based on developed ideas

At level 4, the conferencing area was set up to discuss the functional areas of tutoring through distance learning, e.g. correspondence teaching and assignment marking, face to face tutorials and teaching on line. It attracted a large number of positive qualitative comments, as the tutors in training felt they were sharing with each other, and achieving new ideas that had direct relevance and impact on their teaching. Each sub-conference however very rapidly filled up, and since only the more confident felt able to be selective in reading some message and not others, there were a number of complaints about the volume of unread messages, indicated in FirstClassä by red flag alongside the unread message. The leaders of the conferences needed to log in often in order to summarise and archive messages, and where this happened the conferences were more attractive and better received. However, the level of engagements with each other, and the obvious competence of the tutors in training by this stage in using conferencing to develop ideas and impact on their practice as facilitators was clear.
Back | Top of Page
Level 5 - AUTONOMY AND DEVELOPMENT
The aim at this stage was to encourage the learners to become responsible for their own continuing developing in on line learning and teaching through the CMC opportunities and the aim was to provide little support beyond what was already available

At this stage, the learners became responsible for their own learning through the computer mediated opportunities and little support beyond what is already available was necessary. At this level, tutors in training were introduced to the skills of creating and setting up their own conferences, and they were given a practice area in which to do this. In addition, they were invited to set up discussion conferences on topics of their choice.

The final reflections conference again indicated very positive feelings about the training at this stage - with an average score of 7 against most of the questions. Only the question asking how they felt about using CMC for working with their students attracted a slightly lower average score - 6.52, probably because the setting up of their own conferences seemed a little complicated than they might have thought and the start of the B800 course was only days away!

Evaluation of the Software by the Tutors at the end of their On Line Training
At this stage of the training, the tutors answered an on-line questionnaire about the use of the software and their participation, together with questions about the use of CMC for management learning programmes. FirstClassä scored highly with the tutors in training in terms of consistency of icons and screen displays with 40 respondents giving scores 9 or 10, with a mean of 8.22. It was also considered easy to use by most. Over 75% of the tutors in training reported "active participation" in the on-line training programme. However, 53 respondents also pointed out the value of "passive" participation, i.e. browsing or lurking. In addition, respondents were asked to rate the overall training programme in terms of maintaining their interest. This scored a mean of 7.3 , with 24 giving it a score of 9 or 10 and only 3 giving it less than 5. This suggests that a structured on-line programme, using FirstClassä , is suitable for training purposes.

Trainees were also asked for any features of FirstClassä that they felt had got in the way of their learning. The lack of an off-line reader was mentioned typically by those who had used one for other conferencing platforms. Worries about working on line and resultant telephone costs were mentioned by many others. In total, throughout the 7 questionnaires and reflections conferences, this issue was mentioned 158 time. We now (1997) have an off-line reader.

Back | Top of Page
Discussion & Conclusions
This paper has outlined a 5-stage model for the development of competence in on-line computer conferencing. The model was tested in an action-research setting - during an on-line training programme for a cohorts of Open University Business School MBA tutors. Results showed that the model-based training programme was effective in enabling participants progressively to develop skills in the use of CMC. To confirm carry-over, subsequent performance in the deployment of these skills for on line teaching was monitored by a system of on line "visits". The on-line training programme was found to be cost effective against face-to-face training . Working with the 5 stage model as a basis, the experience of running the training demonstrated that good, quick access on line and toleration of "browsing" and social interaction prior to commencing with learning and course based interaction courses was a key feature.

The study suggests that the medium offers new opportunities for the development of management teachers on-line. A most notable outcome from the training has been that a very large percentage of the MBA tutors interact on line with each other and staff of the OUBS in addition to their students, thus forming a viable and creative on line distance teaching community. In this sense, we feel that training on line fills the gap in preparing tutors to teach through CMC and enables the OUBS to focus on fully developing on line teaching for students as a viable and integrated aspect of supported distance learning for managers.

Further Work in Progress:

    A second cohort of MBA tutors took part in a revised on line training programme during the winter of 96/7 which also fed back further understanding and development of the 5 stage model, with qualitative feedback and reflections
    research on novices to CMC and ways of supporting and developing them
    understanding and development of induction for students ( a large scale on line induction programme involving some 1500 MBA students was run during winter 96/7)
    research on the more detailed skills and techniques needed to successfully lead and teach on line (moderating)
Back | Top of Page
References
Caldwell, B. S. and L. H. Taha (1993). “Starving at the Banquet: Social Isolation in electronic Communication Media.” Interpersonal Computing & Technology 1(1).

Carr, W. (1995). For education: Towards critical educational enquiry. Buckingham, Open University Press.
Dede, C. (1996). “Emerging Technologies and Distributed Learning.” American Journal of Distance Education 20(2): 4-36.

Garrison, D. R. (1992). “Critical Thinking and self directed learning in adult education: an analysis of responsibility and control issues.” Adult Education Quarterly 42(3): 136-148.

Henri, F. (1991). Computer Conferencing and Content Analysis. Computer Supported Collaborative Learning. C. O'Malley. Heidelberg, Springer-Verlag.

Hillman, D. C. A., D. J. Willis, et al. (1994). “Learner-Interface Interaction in Distance Education: An Extension of Contemporary Models and Strategies for Practitioners.” American Journal of Distance Education 28(2): 30-42.

Holsti (1968). Content Analysis. The Handbook of Social Psychology: Research Methods. G. Lindzey and E. Aronson. Reading, Mass., Addison-Wesley. 2.

Jonassen, D., M. Davidson, et al. (1995). “Constructivism and Computer-mediated Communication in Distance Education.” American Journal of Distance Education 9(2): 7-25.

MacFarlane, A. J. G., Ed. (1995). Future Patterns of Teaching & Learning. The Changing University? Milton Keynes, OU Press.

Mason, R. (1991). Evaluation Methodologies for Computer Conferencing Applications. Collaborative Learning Through Computer Conferencing. A. R. Kaye. Berlin, Springer-Vaerlag.

Mason, R. (1992). Written Interactions. Computer Conferencing, The Last Word... R. Mason. Victoria, British Colombia, Beach Holme: 3-19.

McComb, M. (1993). “Augmenting a Group Discussion Course with computer mediated communication in a small college setting.” Interpersonal Computing and Technology 1(3).

Metz, M. (1994). “Computer-Mediated Communication:Literature Review of a New Context.” International Computing & Technology 2(2): 31-49.

Rose, A. (1992). “Framing Our Experience: Research Notes on Reflective Practice.” Adult Learning,(January): 5.
Salmon, G. and K. Giles (1997). “Training Virtual Management Teachers.” European Journal of Open & Distant Learning. http://www.nks.no/eurodl/eurodlen/index.html 1(1).

Travers, R. M. W. (1969). An Introduction to Educational Research. London, Routledge.
Wild, M. (1996). “Technology refusal: Rationalising the failure of student and beginning teachers to use computers.” British Journal of Educational Technology 27(2): 134-143.