versión On-line ISSN 2076-3433
versión impresa ISSN 0256-0100
S. Afr. j. educ. vol.34 no.2 Pretoria jun. 2014
Computer and Instructional Technologies Department, Karadeniz Technical University, Turkey firstname.lastname@example.org
This study assesses the quality of distance learning (DL) in higher education assessed by considering the Seven Principles of Good Practice (SPGP). The participants were 77 second-year students from the Computer and Instructional Technologies Program (CEIT) of a Faculty of Education in Turkey. A questionnaire was developed in line with the SPGP and administered to collect data after 14 weeks of teaching. The author's observations were added to a discussion of the connections between student perspectives and the SPGP. The lessons were delivered in a virtual classroom. It is a synchronous online learning environment with online meetings, chat, forums, whiteboards, desktop sharing, document sharing and other online features. The analysis of the results of the questionnaire indicate that this questionnaire as it has been developed in this study can be effective in understanding and evaluating the perspectives of learners on the quality of distance learning in virtual classrooms. This study also presents some new evidence on the potential of virtual classrooms for teaching, learning and learner interaction. Finally, some suggestions regarding the expectations of distance learners were also provided for instructors who wish to utilize virtual classrooms in their teaching.
Keywords: distance learning; introductory programming course; learners' perspectives; Seven Principles for Good Practice; synchronous setting; virtual classrooms
Over the course of the last decade, many changes have occurred in the emerging economies that support education programmes. One of the key changes is the wide-spread use of the internet in teaching, which facilitates communication among learners, teachers and sharing resources for learning. The cost of education is another factor driving the change. In emerging economies, with an increase in the population, the cost of conventional education has increased significantly (Moore & Kearsley, 1996); while on the other hand, the cost of storing and transmitting information has been falling due to innovations in DL technologies.
As a reasonable and more affordable alternative to conventional education, DL settings have begun to be used all over the world and research studies have focused on various aspects of distance learning settings in the last decade. For instance, Tricker, Rangecroft, Long and Gilroy (2001) have focused on the quality of feedback, materials and tasks in DL. Fuks, Aurelio, Gerosa and De Ducena (2002) motivate for the instructor's role in facilitating and managing counselling cooperative learning within the DL environment. Spangle, Hodne and Schierling (2002) have meanwhile evaluated more than 1200 students in order to determine students' communication skills, the design of activities and the quality of feedback. Time management was also evaluated in DL practices, taking note of variables in technology, context and class size. Richardson and Newby (2006) focused on students' responsibilities for their own learning. Puzziferro (2008) investigated the relationships between student satisfaction, grades and performance in higher education. In another study, students' perspectives reflect that effective teachers should be visibly and actively involved in their learning, and should provide a flexible learning environment (Young, 2006).
Following the improvements in DL systems, new features in synchronous communication augmented DL systems. Considering the idea that effective learning comes by means of real time interactions, a number of higher education institutions have begun to launch courses within synchronous settings. Virtual classrooms are one of the main components of synchronous settings, which share certain similarities with 'real' classrooms. In this context, Loniie and Andrews (2009) have addressed the new technical and pedagogical roles and responsibilities of instructors in managing virtual classrooms. Stewart, Harlow and DeBacco (2011) studied both student-instructor and student-student interactions. The authors found that enhanced video-conferencing, whiteboards, and chatting and discussion boards can support the interactions in synchronous DL. In addition, Lowrie (2007) studied learning engagement in DL settings; Goldwater and Fogarty (2011) focused on classroom management in virtual classrooms; and Chiu, Yang, Liang and Chen (2010) discussed the students' participation style and its effect on success in virtual classrooms.
Despite the increase in the number of organisations offering virtual classrooms, Owens, Hardcastle and Richardson (2009) have pointed out that new evidence is required for exploring teaching-learning processes in virtual classrooms. In this study, pedagogical and technical characteristics of virtual classrooms were evaluated by ascertaining student views, in order to contribute to the standard development efforts in this regard. Thus, the SPGP was used in order to present a comprehensive assessment of virtual classrooms.
Despite the increase in the number of organisations offering virtual classrooms, Owens et al. (2009) have pointed out that new evidence is required to explore teaching-learning processes in virtual classrooms. In this study, both the pedagogical and technical characteristics of virtual classrooms were evaluated through students' views, in order to contribute knowledge in this area. Thus, the SPGP was used in order to put forward a comprehensive assessment on virtual classrooms.
Evaluating the distance learning quality
Educators and researchers are concerned that quality assurance procedures for the design and delivery of DL courses have been ignored (Motiwalla & Tello, 2000). Thus, with the increasing number of applications using DL, researchers have started to look at evaluations of the quality of DL at different dimensions. For example Mohono-Mahlatsi and Van Tonder (2006) studied evaluations of the mentoring system, with a focus on effective mentoring. Recommendations are made for different stakeholders on how the mentoring system can be improved for DL. Chaney, Dorman, Glessner, Green & Lara-Alecio (2007) listed common quality indicators, including: clear analysis ofaudience; institutional support and resources; faculty support services; mission of the institution; reliability of technology; and review of instructional materials. Wang, Solan and Ghods (2010) noticed that course quality and system quality interact with one another, and both lead to changes in the DL environment. They found that course quality significantly affects both system flexibility and the faculty-perceived impact of distance education. Taylor (2002) conducted a survey with instructors regarding seven principles and suggested that learner perspectives ought to be involved.
In this study, I used the SPGP, which includes criteria for assessing quality in higher education courses, according to learner perspectives. Seven principles were specified in line with the discussion of experts in the field (Chickering & Gamson, 1987). The authors Chickering and Gamson (1987) argue that the quality of course depends on a set of seven principles. In their view, effective teaching practices encourage: (1) student-faculty contact; (2) cooperation among students; (3) active learning; (4) prompt feedback; (5) time on task; (6) high expectations; and (7) respect for diverse talents and ways of learning.
Although some studies have taken SPGP into consideration in higher education, only a few studies have used these principles to evaluate online courses. For example, Graham, Cagiltay, Lim, Craner & Duffy (2001) analysed online course materials, student and instructor discussion-forum postings, and faculty interviews, through SPGP. Bangert (2004) used the SPGP to evaluate the effectiveness of an Educational Statistics course by conducting a 35-item questionnaire. Hoskins (2010) found that the SPGP can be administered in an electronic classroom to put criteria for evaluating an e-teacher. She showed that the content remains the same as in the traditional classroom, but the modes of interaction vary between the content, faculty, and students, respectively.
The need for empirical data on DL pedagogy is crucial because there is the danger that DL course design becomes driven by technology without sufficient emphasis on pedagogy. In recognizing this gap, Chickering and Ehrmann (1996) have argued that these principles can be effective guides for the implementation of online courses. In addition to this, a team of evaluators at Indiana University found that the seven principles can be applied to both face-to-face and online courses (Graham, Cagiltay, Craner, Lim & Duffy, 2000). However, they concluded that specific strategies for evaluating the principles differed between the face-to-face and online settings. Also, the Ohio Learning Network (OLN) drew on SPGP in a report that assessed online education and recommendations for higher education institution for quality instruction (OLN, 2002). The report stated that the principles derived from SPGP remained valid for online education.
All of these studies hint at the possibility of SPGP as an evaluation method for different online learning applications such as forums, web-based applications and online applications, amongst others.
Purpose of the study
Some studies give insight into the potential evaluation methods that might be used to assess student reactions in different DL applications (Newlin & Wang, 2002; Gökta°, 2009; Kiggundu & Nayimuli, 2009). In emerging economies, the tendencies on using synchronous sessions of DL require assessing this kind of environments. So, identifying the advantages and limitations of the synchronous sessions in virtual classrooms when employing DL can provide crucial insights for distance educators.
Thus, this study evaluates distance learner perceptions about the quality of a course delivered in virtual classroom. The quality of the DL setting is investigated in three dimensions (teaching, learning and interaction), by a questionnaire based on SPGP.
The data in this study are obtained by administering a questionnaire, and observing learner behaviour in an introductory programming language course. The participants were 77 (46 male, 31 female) pre-service teachers (sophomores) from the CEIT Program of the Faculty of Education. The course was taught for five hours a week over 14 weeks, synchronously in a virtual classroom. All of the learners had access to the internet at home, 90.9% of them had previous synchronous course experience.
The course consisted of synchronous sessions (live sessions in virtual classrooms). In virtual classroom sessions, Adobe® Connect infrastructure was used. Students participated in the synchronous sessions from their houses, which were distanced from the institution, in different cities around Turkey.
The main subjects of the course were: algorithms; programming language constructs; interface design; general programming concepts; and problem-solving activities. Instructors presented the subjects by using the components of virtual classrooms in their presentation, discussion, group work, and so forth. The virtual classroom has three main components managed by instructor:
1. Meeting (organisation, recording, teleconferences)
2. Communication (webcam, chat, imaging participants, controlling role of participants etc.).
3. Content sharing (desktop share, documents share, whiteboard, notes, surveys, tests, etc.).
A wide variety of videos, images, animations, texts, as well as a whiteboard, in different formats, could be shared between the learners and instructors in the virtual classroom. Participants could raise hands and talk via microphones and webcams and use the chat function for writing. Participants could write, draw pictures, figures and graphics by using a whiteboard. A Facebook group is also used as a supplement, to post announcements or to conduct discussions about assignments. The system supports up to 8-10 students synchronously. Figure 1 illustrates a view from virtual classroom.
The researcher, who was also the instructor, developed a Likert-type questionnaire to determine the quality of the course. Dillman's (2000) principles, namely: 1. purpose of the instrument; 2. specifications; 3. items pool; 4. pretesting and final form; were followed as a guideline for developing this questionnaire.
In the first phase, the purpose of the instrument was defined for the learners and instructors to determine the quality of the synchronous courses. In the second phase, the items' format is adjusted as five-point scale from '1. strongly disagree', to '5. strongly agree'. In the third phase, by reviewing similar instruments in studies of Bangert (2004) and Graham et al. (2001), considering the perspectives of Hoskins (2010) from the "Art of E-Teaching" and adding new items according to the experts' opinions, 69 items were constructed. The last phase is pretesting for validity and reliability. The content validity of the instrument was provided by three experts' reviews. Experts reviewed the items for clarity, accuracy and their appropriateness for sample by using the criteria: (1) unnecessary; (2) somewhat necessary; and (3) necessary. Also experts' opinions were used to check whether the items measured the constructs to be measured. The most essential 40 items remained in the pool and they were allocated in seven subsections according to seven principles. For reliability, first, a pilot survey was carried out on another 71 pre-service teachers (α = 0.85). In addition, α is calculated for each subsection, in order to determine the internal consistency (α1=0.87, α2=0.83, α3=0.79, α4=0.84, α5=0.76, α6=0.78, α7=0.92).
Descriptive analysis was carried out based on mean, frequency, percentage and standard deviations of the items. The statistical data for all subsections were interpreted for each item and for the whole subsection. The items that have negative meaning were analysed by reversing the mean values. In addition, the author used his observations to explain and discuss the causes of respective learner responses. During the lessons, the researcher recorded his observations by taking notes about learner behaviours. The lessons in virtual classroom were recorded by the system, so that the researcher also took the records into consideration. For example, the item "multiple ways are allowed to interact with the instructor privately", was explained by referring to observations of these "ways" as realized in the teaching process. Similarly, in the item "instructor could prepare enriched activities for group work", the activities were exemplified. Thus, observations contribute to the validity of the study, along with a discussion of learner responses compared with learner behaviour. In order to discuss learners' responses clearly, the seven principles are grouped into 3 dimensions (shown in Figure 2) by considering their most common features.
The following mean value intervals were used to evaluate perceptions regarding subsections (1.00-1.79: not satisfactory, 1.80-2.59: merely satisfactory, 2.60-3.39: satisfactory, 3.40-4.19: highly satisfactory, 4.20-5.00: excellent).
Results and Discussion
The discussions were constructed on the items of each dimension, in the form of a bottom-to-top hierarchy (items-subsection-dimension).
Practices related to "interaction"
Contact between Student and Faculty
Student answers regarding student and faculty contact are shown in Table 1.
The mean response given to this principle was highly satisfactory (M = 3.88). Participants assessed the items regarding instructors' announcements (M = 4.24) and the instructors' responses to the questions (M = 4.23). In the virtual classroom, instructors often used text-based communication (notes, instant-messaging) to inform the learners about course topics or to make announcements. Instructor also used video and voice features in the context of instructor-student communication. The item "instructor could encourage communication between students and himself" is evaluated as highly satisfactory (M = 4.02). Sometimes instructors stopped the presentation to acknowledge student opinion. In this context, Conceição (2006) highlights that due to the fact that the instructor is physically absent, he should learn how to communicate with students to make online courses more student-centred. The process of accessing instructor and asking questions synchronously is assessed as being highly satisfactory (M = 3.87) and the instructor's responses towards them are assessed as excellent. Also, outside the virtual classroom, the instructor provided students multiple ways (email or phone) for private interaction where necessary for learning. In this manner, Mayisela (2013) concluded that mobile technology has the potential to increase accessibility and communication in blended learning courses.
The mean values about student-faculty subsection were rated as satisfactory (M = 3.88). In this regard, Watson and Rutledge (2005) found in their own study that 30% of students did not agree with the statement: "I felt as much a part of my online class as a regular class." In another study, Keeton (2004) pointed out that students in online courses expected more interaction with the instructor outside the classroom than did regular face-to-face students. Similarly in this study, student-faculty contact is found to be effective especially in the virtual classroom, and some limitations regarding the synchronous system are addressed.
Cooperation among Students
The mean, frequency and percentage values for the student responses regarding co-operation among students are illustrated in Table 2.
Cooperation may be interpreted as activities conducted inside the course or outside the course. In this study, there were some limitations in terms of discussion among learners. Although discussions carried out on in the online chat setting were useful, occasionally learners found these difficult to follow. Specifically, they expressed that the communication was slow in online chat settings. In a similar study Rhode (2009) found that participants found it difficult for learners to follow the messages in the sending order. In this sense, some students indicated the need for some other online tools for effective cooperation. For example, Palloff and Pratt (2009) stated that effective use of discussion forums can contribute to cooperative learning. This is because the item about the effective discussion among students is rated as merely satisfactory (M = 2.0). Working on code pieces together by sharing desktops and time spent working on tasks in groups proved useful. In the virtual classroom, this kind of cooperative work could not be realized in all lessons. Students were required to discuss the incorrect pieces of programming codes, for example, away from the online sessions, but they were not able to conduct effective peer critique. The students assessed the item stating that the instructor encouraged them in peer critiques as merely satisfactory (M = 2.26).
In assignments or projects, a number of students thought that group members could not work collaboratively, so the related item is rated as merely satisfactory (M = 3.01). In this sense, I can say that allocating students groups and asking them to work together in the online environment may not meet their expectations. With regards to learner perspectives, Chiu et al. (2010) note that within a group, students must actively share ideas, explain their opinions, articulate their reasoning, and elaborate their knowledge. In addition, most students expressed that the instructor could not precisely assess how much student work was conducted the group work. Learner perspectives showed that interaction among students during the course was less than their interaction outside the course. Buckley (2003) considered teacher perspectives, postulating that it is not only important to create an interactive environment for learning, but it is also important to design discussion activities that can trigger learning cooperatively.
The results of this study reflected that cooperative learning activities can be constructed in DL settings, but the results show that the lowest mean value (M = 2.59) to have been given to this subsection by learners. In this regard, Zhang and Walls (2006) reported that the encouragement of cooperation among students was most rarely practised in online instruction.
Practices related to teaching
Time on Task
The mean, frequency, percentage and standard deviations of student responses regarding time spent on tasks are shown in Table 3.
For carrying out the classroom activities smoothly in a virtual classroom, learners ought to be able to use the tools without facing technical impediment. In virtual classroom when the learner attempted to express an idea he/she raises his/her hand (activate the hand raising function). The instructor made sufficient time available to learners to talk on raising their hands. Also, when the learners worked on different tasks in the lessons, they were given sufficient time to complete tasks. The participants rated this issue as excellent in their feedback (M = 4.30). Similarly, in Bangert's study (2004), most students (83%) indicated that the course was organised in such a manner as to allow them to effectively complete assignments. Thus, by good organisation, DL courses provide sufficient time for learners engaging in learning activities, as well as for completing course assignments. Technical problems, especially when the line is busy, negatively affected the lesson time. Also, the programming activities took a significant amount of time for students to complete. Therefore, planning the activities proved crucial to time management. Learners assessed the instructor to have planned the course well in this regard, arranging time necessary for tasks, and making the importance of deadlines clear to the students as satisfactory (M = 3.25). According to the perspective of e-teachers, in her own study, Hoskins (2010) stated that e-teachers also ought to plan their time such that teaching no longer occurs at a scheduled time. It can become an activity without established ground rules for accessibility.
Instructors explained time management on assignments to students and managed them through the system, by reminding students of their deadlines. However, in some lessons, instructors were required to explain the program code line by line, and spent some time on the code pieces. Accordingly, the item "instructor developed examples which takes much time to solve", was considered a limitation and assessed as satisfactory (M = 3.36). In addition, the time students remained in lessons during the term was recognised, which helped students when it came to time management.
Delivering online teaching requires more time than does face-to-face teaching (Dahl, 2003 ; Mabrito, 2006). In addition, Taylor (2002) found in a separate study that time on task was the only principle that was rated in the lower scores, with a score of 2.94. In this study, although technical problems and limitations regarding the nature of the course caused occasional limitations when it came to time management, learners' overall assessments of time on task showed it to have been satisfactory (M = 3.54).
The descriptive results regarding prompt feedback are illustrated in Table 4.
Feedback provides an opportunity to evaluate student improvements on learning. Tsai (2012) found that online feedback from teachers and course websites may enhance student learning. In this study, students could resubmit their projects after revising them according to instructor reviews. In this regard, students assessed the evaluative and corrective feedback mechanism as having been highly satisfactory (M = 3.48). Graham et al. (2001) assert that providing detailed feedback to each student ought to be one of the main targets of online instructors. In order to send feedback for each task or projects, instructors preferred to share examples of general mistakes on projects as a way of using time effectively. Instructors used a variety of ways including synchronous system features, email and social networking, in order to send feedback. Some studies have shown that successful feedback can be given through email or forum postings (Göktaș, 2009; Williams & Jacobs, 2004). Learners assessed the item about multiple ways of giving feedback as satisfactory.
In the virtual classroom, lessons are recorded (videos of activities in virtual classroom), and organised for learners to follow the videos repeatedly. This feature may be considered an important advantage of synchronous sessions, and was assessed by students in this study as excellent (M = 4.48). One of the most important issues in online learning is giving feedback on time, where students need it for their projects, assignments or other tasks. In this regard, participants have some negative opinions about the delays in timely feedback (M = 2.78). Also, peer feedback is an important factor for learners while working on projects. However, the instructor did not allow students to share their own projects with each other before the project was completed. As a result, the responses to the item related to the effectiveness of peer feedback on projects rated this aspect as unsatisfactory. In virtual classrooms, or by using other tools, eye contact and body language cannot be realized as it can face-to-face. This can affect feedback regarding motivation. The majority of students thought that motivational feedback had some limitations (M = 3.13).
The mean value of learner's rates on the subsection "prompt feedback" is highly satisfactory. Similarly, in another study based on WebCT, learner responses reflect that most of the learners (96%) not only feel that feedback was timely, but also felt that feedback was helpful when it came to course assignments, and general course requirements (Bangert, 2004).
As a result, the synchronous setting allowed learners to receive feedback from the instructor and from peers, which enhanced their understanding through revision. But the instructors' habits about feedback and systems affordances can effect participants' behaviours.
Table 5 shows the results of student assessment of the high expectations subsection.
The assessments about high expectations are generally rated as highly satisfactory, from (M = 3.31) to (M = 3.99). The various techniques instructors used to keep students highly motivated may contribute significantly to learning. At the beginning of the course, the instructor clearly explained his expectations about assignments and he stated that he would evaluate participation in discussions in the virtual classroom. Also, he defined the criteria about the student performance clearly. He also declared that he would evaluate how long a student was on the system. This was rated on the "instructor expected students to perform well" as successful (M = 3.83). Learner responses showed that the instructor encouraged them in their abilities by affording special attention to challenging assignments. The instructor was reported to have kept learners highly motivated by encouraging them to create new ideas and to state authentic answers to questions. Learners evaluated this item as satisfactory (M = 3.47). On writing programming codes in order to reach possible best solutions, learners considered the instructor's expectations. Another way in which the instructor relayed his high expectations to the students was by providing examples of previous students who were found highly satisfactory.
Practices related to "learning"
Students' responses regarding active learning are shown in Table 6.
Moore (1989:1-6) described student-content interactions as "changes in the learner's comprehension, the learner's perspective, or the cognitive structures of the learner's mind". So, one of the most important issues in online environments is managing the student-content in learning activities (Bender, Wood & Vredevoogd, 2004). Most of the students found the instructor successful in coordinating the learning activities on the system (M = 4.04). In the virtual classroom, instructors used presentations, documents, code pieces, and video or other formats of contents synchronously. Participants evaluated the item that the instructor used different kinds of instructional materials as highly satisfactory (M = 4.16). Instructor could encourage learners by participating in the lessons according to their learning styles by watching, talking, writing and discussing. To increase the active participation of learners, the instructor encouraged them to use the whiteboard and the chat setting, especially when writing sample programme pieces. Learners rated this item as highly satisfactory.
Writing programmes requires thinking time, so during this time, learners may be seen as passive. To prevent the learners from becoming passive listeners, instructors put a great deal of effort into finding authentic examples and to bringing these to the attention of the students. But learners did not think that the instructor was successful in this regard (M = 2.96). Some students carried out different activities via Facebook, but the instructor did not make it obligatory. Furthermore, he required the students not to use these settings during lessons, in order to keep them focused. As a result, learners reported the availability and use of supplementary internet tools as merely satisfactory (M = 2.61).
When talking, writing or presenting on the subjects of the course, the instructor could not physically see the learners and a huge effort was made to keep them actively engaged in the lectures. Almost all items are assessed as satisfactory in active learning subsection, except for the subjects being passive listeners. This is generally viewed as a limitation in this manner of synchronous session.
Diverse Talents and Ways of Learning
The student responses regarding diverse talents and ways of learning are shown in Table 7.
The synchronous setting used in this study offers various types of materials for learning (video, text, audio, multimedia, etc.). The use of different instructional materials was convenient for learners for presenting their own talents, and was rated as having been excellent (M = 4.31). In some lessons, the instructor used examples that can offer more than one solution or view for a particular problem. So, presenting distinct points of view about the problems during the lesson was assessed as having been satisfactory (M = 3.56). Learners chose appropriate projects and used their own methods to solve problems. They had the opportunity to show their talents on the system by video, text, graphics and audio formats, and were instructed on how to share applications both inside and outside the class. For example, they designed algorithms; explained their views about codes; tried to find errors in codes; followed the code pieces; and estimated the efficiencies of codes. In this regard, Hannafin, Hill, Oliver, Glazer and Sharma (2003) stated that the implementation of online media for teaching staff ought to become both familiar with the functionality of new instruments, and to specify new ways of working. In addition, instructor lesson plans were assessed as satisfactory when it came to the way in which it catered for a diverse range of learning preferences. As a result, the learner responses mean value about showing their own talents is evaluated as having been highly satisfactory (M = 3.88). In parallel to this study Bangert (2004) found that, the majority of students felt that the instructor created instructional activities that allowed several different ways for students to demonstrate understanding of critical course concepts.
The mean value and standard deviations in three main dimensions addressed in synchronous DL are listed in Table 8.
It is observed that though the system has some benefits, there are still challenges with regards to cooperation among students. Active learning, which is directly associated with learning, was evaluated as having been quite low. Unlike the results of this study, Gomez Alvarez (2005) found that active learning was the best predictor in both criterion variables, and prompt feedback and high expectations comes after active learning. A promising result can be seen in the student-faculty contact, diverse talents and high expectations subsections. The mean values of evaluations showed that the synchronous setting was evaluated by students as having been highly satisfactory with regard to interaction (M = 3.53), teaching (M = 3.55) and learning (M = 3.24). Taylor (2002) also concluded that instructors were self-reporting the use of the principles in their online courses in six of the seven principles (contact between faculty and student, feedback, ways of learning, expectations, learning techniques, and relations among students), which ranged from 3.10 to 3.78.
In this manner, despite the limitations related to system, students or teachers, good practices can be ensured in accordance with the seven principles framework within an established learning setting. In this regard, Wang et al. (2010) assert that instructors who intend designing effective online course tasks, should implement their seven principles.
Learner perspectives may be shaped by the nature of course, as computer programming as a subject mainly concerns abstractions. Learner perspectives support the constructivist-based teaching practices that are suggested by the SPGP. In addition, the questionnaire developed for this study provided some valuable experience for the creation of an instrument that can be used by students to examine the quality of synchronous courses. While it is recommended to use the SPGP in conventional higher education courses, this study puts forward new evidence about the applicability of the SPGP for DL courses. In this study, SPGP is used as a framework for evaluation in teaching, learning and interaction dimensions. The results indicate that it can also be used as a guide for the design and delivery of DL courses. Minor revisions may be required depending on the nature of the courses or on the technical features of the given online environment. As is known for emerging economies, a major argument for DL as a way for promoting higher education is its lower marginal cost per student when compared with face-to-face applications. But while gaining cost-effectiveness, emerging countries should not be willing to compromise the quality of instruction. For this reason, investigating the quality of DL applications and revealing the limitations and advantages is crucial for stating standards for DL.
Conclusion and Implications
SPGP have been accepted by academicians for evaluating quality of process in undergraduate education (Graham et al., 2001; Bangert, 2004). This study provides further evidence that these principles can be evident in virtual classroom settings. Positive correlations were found between the use of the seven principles and interaction, learning and teaching.
In the constructivist perspective, interaction proves important for both instructors and students and in order to facilitate supportive and corrective feedback, instructors must design highly interactive settings. Student responses regarding the activities in the virtual classroom and the other components reflect on comprehension of introductory programming. In this context the perspectives regarding overall learning were "highly satisfactory" while active learning sub-section was evaluated as "satisfactory" and diverse talents and ways was evaluated as "highly satisfactory". Learners reported thinking that the instructor used the system to give prompt feedback, highlighted the time to be spent on tasks, and described high expectations as "highly satisfactory". So, the "teaching" dimension of SPGP was considered "highly satisfactory". The dimension "interaction" was rated as "satisfactory". It was interesting to note that cooperation among students was evaluated at the lowest assessment rate as "merely satisfactory".
The improved features of the synchronous system played an important role in learners' positive perceptions of the questionnaire based on the SPGP. The synchronous system offered learners online webcam, desktop and document sharing, presentations and whiteboards, and the ability to work on the same task collaboratively. The system's improved communication features contributed to positive learner views on the "interaction" dimension, which were addressed as student-faculty contact and co-operation among students. Meeting in virtual classrooms and getting efficient feedback were adherence to feedback sub-dimension of SPGP. In synchronous lessons, time management differs from traditional lessons when it comes to the use of technical functions. Therefore, planning and managing the reactions of unexpected positions in the lessons can overcome wasted time. In traditional classrooms or in virtual classrooms, instructors generally have high expectations from the students. In DL settings, it is quite difficult to motivate distance learners through high expectations, because learners may have different future goals. Considering the features of the system, the activities of the instructor and the nature of the course, it can be observed that the necessary principles for good practice in higher education can be satisfied.
Certain broader implications were found for DL in higher education. For instance, when instructors become increasingly familiar with synchronous technologies, they will organise the learning environments more effectively. Instructors also need to be pioneers in terms of having the flexibility to make adjustments when the technology does not work as expected. Managers should choose software with the flexibility to support different levels of course design (Wang et al., 2010). Furthermore, learners should be taught how to use DL systems and be able to gain experience in new tasks such as researching, solving problems, and making collaborative studies in new settings.
Ultimately, the results of this study show that learner perspectives about DL can be obtained through a SPGP-based evaluation instrument. This provides insight when using similar instruments, in order to evaluate the quality of DL instructional practices.
Bangert AW 2004. The seven principles of good practice: a framework for evaluating online teaching. The Internet and Higher Education, 7(3):217-232. http://dx.doi.org/10.1016/j.iheduc.2004.06.003 [ Links ]
Bender DM, Wood BJ & Vredevoogd JD 2004. Teaching time: Distance education versus classroom instruction. American Journal of Distance Education, 18(2):103-114. doi: 10.1207/s15389286ajde1802_4 [ Links ]
Buckley K 2003. How principles of effective online instruction correlate with student perceptions of their learning. Orlando, FL: University of Central Florida. [ Links ]
Chaney BH, Eddy JM, Dorman SM, Glessner L, Green BL & Lara-Alecio R 2007. Development of an instrument to assess student opinions of the quality of distance education courses. American Journal of Distance Education, 21(3):145-164. Available at http://libres.uncg.edu/ir/uncg/f/J_Eddy_DevelopmentOfAn_2007.pdf. Accessed 2 April 2014. [ Links ]
Chickering AW & Ehrman SC 1996. Implementing the seven principles: Technology as a lever. American Association for Higher Education Bulletin, 10:3-6. Available at http://sphweb.bumc.bu.edu/otlt/teachingLibrary/Technology/seven_principles.pdf. Accessed 2 April 2014. [ Links ]
Chickering AW & Gamson ZF 1987. Seven principles for good practice in undergraduate education. AAHE Bulletin, 39:3-7. Available at http://www.elmhurst.edu/~richs/EC/SPS/UsefulDocuments/7%20Principles%20of%20Good%20Practice%20in%20Undergrad%20Ed-ChickeringGamson.pdf. Accessed 2 April 2014. [ Links ]
Chiu CH, Yang HY, Liang TH & Chen HP 2010. Elementary students' participation style in synchronous online communication and collaboration. Behaviour & Information Technology, 29(6):571-586. doi: 10.1080/01449291003686195 [ Links ]
Conceição SCO 2006. Faculty lived experiences in the online environment. Adult Education Quarterly, 57(1):26-45. doi: 10.1177/1059601106292247 [ Links ]
Dahl J 2003. How much are distance education faculty worth? Distance Education Report, 7:5-7. [ Links ]
Dillman DA 2000. Mail and internet surveys: The tailored design method. New York, John Wiley & Sons. [ Links ]
Fuks A, Gerosa MA & Lucena CJP 2002. The development and application of distance learning courses on the internet. The Journal of Open and Distance Learning, 17(1):23-38. Available at http://184.108.40.206/public/papers/openlearning.pdf. Accessed 2 April 2014. [ Links ]
Gökta?Y 2009. Incorporating blogs and the seven principles of good practice into preservice ICT courses: a case study. The New Educational Review, 19(3-4):29-44. Available at http://www.academia.edu/205773/Incorporating_Blogs_and_the_Seven_Principles_of_Good_Practice_into_Preservice_ICTs_Courses_A_Case_Study. Accessed 2 April 2014. [ Links ]
Goldwater PM & Fogarty TJ 2012. Location does not have to be destiny: student evaluation and integrity controls in a management accounting class. Behaviour & Information Technology, 31(12):1173-1179. doi: 10.1080/0144929X.2010.526149 [ Links ]
Gomez Alvarez LDC 2005. Seven principles of good teaching practice: Predictors of perceived learning and satisfaction with online courses. ETD collection for University of Nebraska-Lincoln. Paper AAI3186855. Available at http://search.proquest.com/docview/305427413. Accessed 22 May 2010. [ Links ]
Graham C, Cagiltay K, Lim BR, Craner J & Duffy TM 2001. Seven Principles of Effective Teaching: A Practical Lens for Evaluating Online Courses. The Technology Source. Available at http://technologysource.org/article/seven_principles_of_effective_teaching/. Accessed 24 March 2011. [ Links ]
Graham C, Cagiltay K, Craner J, Lim BR & Duffy TM 2000. Teaching in a web based distance learning environment (CRLT Technical Report No. 13-00). Bloomington, IN: Indiana University. Available at http://www.academia.edu/302270/Teaching_In_a_Web_Based_Distance_Learning_Environment. Accessed 10 March 2011. [ Links ]
Hannafin M, Hill JR, Oliver K, Glazer E & Sharma P 2003. Cognitive and learning factors in web-based distance learning environments. In MG Moore & WG Anderson (eds). Handbook of distance education. Mahwah, NJ: Lawrence Erlbaum Associates. [ Links ]
Hoskins BJ 2010. The art of E-teaching. The Journal of Continuing Higher Education, 58(1):53-56. doi: 10.1080/07377360903524641 [ Links ]
Keeton MT 2004. Best online instructional practices: Report of phase1 of an ongoing study. Journal of Asynchronous Learning Networks, 8(2):75-100. Available at http://sloanconsortium.org/jaln/v8n2/best-online-instructional-practices-report-phase-iongoing-study. Accessed 3 April 2014. [ Links ]
Kiggundu E & Nayimuli S 2009. Teaching practice: A make or break phase for student teachers. South African Journal of Education, 29:345-358. Available at http://www.ajol.info/index.php/saje/article/viewFile/45174/28664. Accessed 3 April 2014. [ Links ]
Loniie AL & Andrews T 2009. Creating a rich learning environment for remote postgraduate learners. Education in Rural Australia, 19(1):3-13. [ Links ]
Lowrie T 2007. Learning engagement in distance and rural settings: Four Australian cases. Learning Environments Research, 10(1):35-51. doi: 10.1007/s10984-007-9020-5 [ Links ]
Mabrito M 2006. A study of synchronous versus asynchronous collaboration in an online business writing class. American Journal of Distance Education, 20(2):93-107. doi: 10.1207/s15389286ajde2002_4 [ Links ]
Mayisela T 2013. The potential use of mobile technology: enhancing accessibility and communication in a blended learning course. South African Journal of Education, 33:1-18. Available at http://www.ajol.info/index.php/saje/article/view/85004. Accessed 3 April 2014. [ Links ]
Mohono-Mahlatsi L & Van Tonder F 2006. The effectiveness of mentoring in the Distance Teacher Education Programme at the Lesotho College of Education: Student teachers' and tutors' perceptions. South African Journal of Education, 26:383-396. Available at http://www.ajol.info/index.php/saje/article/view/25077. Accessed 6 April 2014. [ Links ]
Moore M 1989. Three types of interaction. The American Journal of Distance Education, 3:1-6. Available at http://aris.teluq.uquebec.ca/portals/598/t3_moore1989.pdf. Accessed 6 April 2014. [ Links ]
Moore M & Kearsley G 1996. Distance education: a systems view. Belmont, CA: Wadsworth. [ Links ]
Newlin MH & Wang AY 2002. Integrating technology and pedagogy: Web instruction and seven principles of undergraduate education. Teaching of Psychology, 29(4):325-330. doi: 10.1207/S15328023TOP2904 15 [ Links ]
OLN 2002. Quality learning in Ohio and at a distance: A report of the Ohio learning network task force on quality in distance learning. Ohio: Ohio Learning Network. [ Links ]
Owens J, Hardcastle LA & Richardson B 2009. Learning from a distance: The experience of remote students. The Journal of Distance Education, 23(3):53-74. Available at http://www.jofde.ca/index.php/jde/article/view/596. Accessed 6 April 2014. [ Links ]
Palloff RM & Pratt K 2009. Assessing the online learner: Resources and strategies for faculty. San Francisco, CA: Jossey Bass. [ Links ]
Puzziferro M 2008. Online technologies self-efficacy and self-regulated learning as predictors of final grade and satisfaction in college-level online courses. American Journal of Distance Education, 22(2):72-89. doi: 10.1080/08923640802039024 [ Links ]
Rhode JF 2009. Interaction equivalency in self-paced online learning environments: an exploration of learner preferences. The International Review of Research in Open and Distance Learning, 10(1):1-23. Available at http://www.irrodl.org/index.php/irrodl/article/view/603/1178. Accessed 3 April 2014. [ Links ]
Richardson JC & Newby T 2006. The role of students' cognitive engagement in online learning. The American Journal of Distance Education, 20(1):23-37. doi: 10.1207/s15389286ajde2001_3 [ Links ]
Spangle M, Hodne G & Schierling D 2002. Approaching value-centered education through the eyes of an electronic generation: Strategies for distance learning. Paper presented at the meeting of the National Communication Association, New Orleans, LA. [ Links ]
Stewart AR, Harlow DB & DeBacco K 2011. Students' experience of synchronous learning in distributed environments. Distance Education, 32(3):357-381. doi: 10.1080/01587919.2011.610289 [ Links ]
Taylor J 2002. The use of principles for good practice in undergraduate distance education. MEd dissertation. Blacksburg: Virginia Polytechnic Institute and State University. Available at http://scholar.lib.vt.edu/theses/available/etd05162002-121245/unrestricted/JMTthesisbegin.pdf. Accessed at 12 June 2011. [ Links ]
Tricker M, Rangecroft M, Long P & Gilroy P 2001. Evaluating distance education courses: the student perception. Assessment & Evaluation in Higher Education, 26(2):165-177. doi: 10.1080/02602930020022002 [ Links ]
Tsai CW 2012. The role of teacher's initiation in online pedagogy. Education + Training, 54(6):456-471. [ Links ]
Wang J, Solan D & Ghods A 2010. Distance learning success - a perspective from sociotechnical systems theory. Behaviour & Information Technology, 29(3):321-329. doi: 10.1080/01449290903544645
Watson SW & Rutledge VC 2005. Online course delivery and student satisfaction. [ Links ]
Williams JB & Jacobs J 2004. Exploring the use of blogs as learning spaces in the higher education sector. Australasian Journal of Educational Technology, 20(2):232-247. Available at http://its.lmu.edu/academictechnology/instructionaltechnology/educationaltechnologyresearchreview/blog-learning-spaces/. Accessed 6 April 2014. [ Links ]
Young S 2006. Student views of effective online teaching in higher education. American Journal of Distance Education, 20(2):65-77. doi: 10.1207/s15389286ajde2002_2 [ Links ]
Zhang J & Walls R 2006. Instructors' self-perceived pedagogical principle implementation in the online environment. The Quarterly Review of Distance Education, 7(4):413-426. [ Links ]