On-line version ISSN 2310-3833
Print version ISSN 0038-2337
S. Afr. j. occup. ther. vol.45 n.1 Pretoria Jan./Apr. 2015
Caryn GreenI; Kerry HudsonI; Minkateko WichtI; Claire WillowsI; Helen BuchananII
IO T (UCT). 4th year Occupational therapy students at the University of Cape Town at the time the research was conducted
IIBSc OT (UCT); MSc OT (UCT); PhD (UCT).Senior Lecturer, Department of Health & Rehabilitation Sciences, University of Cape Town
INTRODUCTION: The first year occupational therapy course at the University of Cape Town focusses on developing an understanding of occupation. Two first semester modules form the foundation for this understanding. This study aimed to describe the impact of these modules on first year students' knowledge of, and attitudes towards, the core constructs of occupation.
METHODOLOGY: A pre-experimental one-group pre-test post-test design was used with a convenience sample recruited from the 2013 first year occupational therapy class. A self-administered questionnaire was developed for the study based on an extensive literature review and consultation with international occupational therapy experts. Data were gathered before and after participating in the modules. Content and construct validity, test-retest and inter-rater reliability were determined using the expert panel and a pilot test. Data were analysed with STATISTICA.
RESULTS: Forty-five (N=60) participants completed pre-test and post-test questionnaires and were included in the analysis. Knowledge improved significantly (p<0.001) between pre-test and post-test, and positive attitudinal changes were noted.
CONCLUSION: Knowledge and attitudes improved after completing the modules suggesting that students were equipped with a sound foundational understanding of the core constructs of occupation.
Key words: Occupation; core constructs; knowledge; attitudes; education; occupational therapy
Occupational therapy is a dynamic profession that continues to evolve and adapt depending on the culture and society in which it is practised. In the last 30 years there has been a global shift in the profession, from a focus on performance components to an occupation-based approach1,2. The University of Cape Town (UCT) Division of Occupational Therapy sought to align with these trends while continuing to develop an African orientation to the practice of occupational therapy. This decision necessitated an intense process of curriculum review, and, in 2009, a new undergraduate curriculum was introduced starting at first year level. The first year curriculum consists of two semester courses which focus on developing an understanding of occupation as central to the profession. The first semester course "... introduces students to the basic concepts that underlie occupational therapy principles, values and modes of practice"3:46 and consists of four modules, two of which (Basic concepts of Human Occupation and Artforms)focus on occupation. The learning outcomes for these modules are shown in Appendix 1.
Basic Concepts of Human Occupationexposes students to occupation and its constructs for the first time. Utilising a didactic teaching approach, the module provides a foundation for understanding occupation through exposure to several theorists but with particular emphasis on Nelson's conceptualisation of occupation4,5. Nelson4:633 defines occupation as the "... relationship between occupational form (external circumstances) and occupational performance (the active behaviour)" and highlights active engagement in occupations within a specific context. Artforms,on the other hand, takes an experiential learning approach to consolidate the theoretical constructs from the Basic Concepts of Human Occupationmodule. An artform is understood as 'an activity or a piece of artistic work that can be regarded as a medium of artistic expression'6. This module affords an opportunity to explore and experience an artform as an occupation within two different contexts, using Nelson's4,5 constructs.
In 2013, the new first year curriculum was in its fifth year and the educators wished to evaluate its success in meeting its educational outcomes. This study therefore aimed to describe the impact of the Basic Concepts of Human Occupation and Artformsmodules on knowledge and attitudes to the core constructs of occupation in first year students. The purpose of the research was firstly, to evaluate the modules and establish their effectiveness in meeting the learning outcomes, and secondly, to inform further development of the first year curriculum by identifying areas that were effective and those requiring revision.
Occupational therapy is founded upon a holistic approach to healthcare which aligns with the World Health Organization (WHO) definition of health as 'a state of complete physical, mental and social well-being and not merely the absence of disease or infir-mity'7. The fundamental belief that occupation is a determinant of health informs practice which aims to enhance well-being through engagement in meaningful occupations8.
According to Kielhofner2, the profession has undergone two paradigm shifts. The first paradigm focused on occupation and the benefit of occupational engagement. The medical model influenced the second paradigm shift that took a more scientific, reductionist approach emphasising performance component remediation. Currently, within the third paradigm, the profession has returned to occupation with a more complex and holistic understanding of humans as occupational beings1. The current paradigm has enabled occupational therapists to realign their practice towards an occupation-based approach to enhance the health and wellbeing of individuals, groups and communities.
With the shift to an occupation-based approach, occupational therapy researchers have sought to understand the complexity of occupation and articulate its constructs clearly1,9. While different theorists understand the term 'occupation' from varying angles, all highlight similar aspects within their definitions, namely who is involved, where it takes place, what is done and how it is experienced. These aspects align with Nelson's4,5 constructs of occupation which he terms 'developmental structure', 'occupational form', 'occupational performance' and 'meaning'. However, ambiguity continues to surround the term 'occupation'10 which creates uncertainty about professional identity and blurs the boundaries between occupational therapy and other professions11,12. As students are particularly susceptible to this confusion, occupation-based practice should be emphasised in educational curricula to ensure the development of a strong professional identity and a sound understanding of the importance of occupation12. To this end, learning tasks to assist the exploration of occupation and its multiple constructs are introduced from first year to ensure that students develop the necessary knowledge, skills and attitudes required for practice. To this end, first year occupational therapy students at UCT are exposed to a variety of definitions and theories of occupation within the Basic Concepts of Human Occupation and Artformsmodules, with an emphasis on Nelson's work. However, as Nelson argued that his conceptualisation of occupation aligns with that of other theorists5, it is possible that these modules may equip students with a broad understanding of occupation that allows them to explore their own conceptualisation of the constructs thereby shaping their professional identity.
A pre-experimental one-group pre-test post-test design was employed.
The population comprised first year UCT occupational therapy students in 2013 (N = 60). Convenience sampling ensured the inclusion of as many participants as possible. The minimum sample size was calculated at 30 participants. This was based on estimated average pre-test and post-test knowledge scores (section B of the questionnaire) of 30% and 75% respectively, a standard deviation of 10% and a hypothesised average improvement of 45% (with 90% power and a 0.05 level of significance).
As this was the first occupational therapy study of its kind, a questionnaire to evaluate knowledge and attitudes before and after exposure to the modules had to be developed. Given the time and resource constraints, a self-administered paper-based questionnaire was selected for its likelihood of producing a higher response rate13-15.
Development of the questionnaire
The process of questionnaire development included an extensive literature review, consultation with international occupational therapy experts, and a pilot test. Nelson's4,5 constructs were used to guide the content, and the questionnaire adhered to sound design principles in length16 and varying response formats17. Formats included multiple choice questions (MCQs), which produce efficient, reliable results, and allow comparison of performance levels18,19, dichotomous response options, and 5-point Likert Scales which are commonly used to assess attitudes20. Close- and open-ended questions were included to increase reliability and scoring consistency while producing individualised responses that allowed participants to elaborate18,21,22. Response bias was minimised by including positively and negatively worded statements that encouraged active engagement for accurate comprehension20.
The questionnaire consisted of four sections (see Table 1 above for a summary).
Demographic information in Section A included aspects such as age, gender and home language. Sections B and C evaluated knowledge of Nelson's4,5 conceptualisation of occupation and the core constructs of 'developmental structure', 'occupational form', 'occupational performance' and 'meaning' through open-ended questions and MCQs. The MCQs had a single-best answer and tested knowledge application by requiring participants to identify the core constructs of occupation within two short case studies. The case studies were structured on the outcomes of the Artformsmodule and entailed identifying aspects of occupational engagement in urban and informal contexts. This combination of case studies with single-best answer questions have been shown to be effective and reliable in assessing knowledge application from a first year level23. Section D contained questions related to attitudes towards the constructs of 'occupation' 'meaning', 'person' and 'environment'. Participants were asked to justify their answers to provide a deeper understanding of their responses19,24. Examples of questions in sections B to D are presented in Table 2 on page 65.
Scoring the questionnaires
Marking guides were developed for the study. The open-ended questions (section B) were scored with a rubric25 and the MCQs (sections C and D) with a marking memorandum. The rubric contained four levels outlining the essential components for correctly defining each construct to enable raters to readily select the appropriate level for each response26. Levels were assigned a score from zero to four. A 'strong' response required a comprehensive description of each construct, whilst 'competent', 'basic competence' and 'weak' responses demonstrated lessening degrees of understanding. The levels provided an objective way to rate the open-ended responses, thus enhancing intra- and inter-rater reliability (IRR)25. While the criteria for each level were primarily guided by Nelson4,5, other theorists' included in the lecture content were incorporated to ensure that participants were not penalised if they demonstrated an understanding of the constructs but did not draw on Nelson's exact definitions. The marking memorandum listed the correct answers for the MCQs (Section C) and desired responses for Likert scale items (Section D)25. Desired responses for attitude questions were based on the perspectives and values regarding the relationship between occupation and its core constructs within the profession.
A pilot test to assess test-retest reliability, face validity and utility of the questionnaire, and identify and resolve errors within the marking rubric, was conducted with 12 second year occupational therapy students prior to data collection. Participants completed the questionnaire on the agreed date and again two days later. The administration procedure of the pilot test mirrored that of the main study. Questionnaires were completed under test conditions and participants were asked not to discuss or research their responses to the pre-test until they had completed the post-test. After the post-test, participants engaged in a structured discussion to share their views about the length, format, wording, and ease of completing the questionnaire27,28. Feedback from the pilot study resulted in the following changes to the questionnaire:
♦ Wording of particular questions was simplified and MCQ response options adjusted to improve clarity;
♦ Negatively worded statements in Section D were written in bold to make them more noticeable, and an instruction added to 'read the questions carefully';
♦ Formatting was changed to allow sufficient space for responses and to improve the readability of the questionnaire.
Validity and reliability
The questionnaire was sent to a panel of seven occupational therapy experts to evaluate its content and construct validity. Panel members were chosen for their acknowledged expertise within the profession based on their publications and research in the area of human occupation. The panel indicated that 'developmental structure'4 should be included in sections B and C and 'occupational form' should be expanded in section C to include all aspects of the environment, rather than focussing purely on the physical component. This feedback was used to revise the questionnaire. The questionnaire is available on request.
Pilot test questionnaires were marked independently by two raters using the first draft of the rubric. Issues relating to the comprehensiveness of the rubric and ease of marking during this process necessitated some revisions to the rubric (draft 2), which were discussed with the research supervisors and revised further (draft 3). Pilot questionnaires were re-marked using draft 3. Feedback from this process led to the development of draft 4 of the rubric which was sent to two members of the expert panel for input. Their feedback was used to further refine the rubric and to re-mark the pilot questionnaires. The marking guides are available from the authors on request.
Test-retest reliability using data from the first and second pilot tests revealed that agreement for Section B was satisfactory ("good" to "excellent" for questions 1 - 4 (ICC=0.604-0.879), and "fair to moderate" for question 5 (ICC=0.566))29. Test-retest reliability for Sections C and D was less than satisfactory however ("poor" to "substantial" for section C (Kappa: -0.13; 0.63) and "poor" to "almost perfect" for section D (Kappa: -0.09; 0.82))30. To determine the IRR of the marking guides, two raters independently marked the pilot study questionnaires with the final rubric and marking memorandum. IRR for Sections B (ICC=0.760-0.950), C and D (Kappa: 1.0 respectively) was excellent29,30.
Data collection procedure
The pre-test was conducted at the end of the first lecture of the Basic Concepts of Human Occupation module. The post-test was administered three months later, on completion of the Basic Concepts of Human Occupation and Artformsmodules. The three month time-span between tests along with changes in the ordering of the MCQ response options for the post-test, assisted in reducing the practice effect31. The same questionnaire was used for the pre- and post-tests except that six questions covering attitudes to the content and the teaching methods employed in the modules were added (these are not reported in this article). Pre-tests and post-tests were administered in a maximum time of 30 minutes and under the same conditions to reduce respondent error32. Questionnaires were marked independently by two raters with the final marking guides. Any discrepancies were discussed and consensus reached on the final scores.
Data management and analysis
Each participant received a numbered questionnaire which corresponded to their number on the list of participants for tracking purposes. Data were entered into STATISTICA™ immediately after data collection and double checked to ensure accuracy. Electronic data were password protected and encrypted to allow access by the researchers only.
Analysis was conducted with STATISTICA™. As numerical data were not normally distributed, medians and ranges were calculated. Frequencies and proportions were determined for all categorical data. Responses to open-ended questions were analysed post-hoc33 and frequencies and proportions calculated for each category and theme. Changes in Section B (questions 1 to 5) knowledge scores from pre-test to post-test were compared with Wilcoxon's matched pairs test. McNemar's test was used to detect significant differences for Section C knowledge items between pre-test and post-test.
Ethical approval was obtained from the UCT Human Research Ethics Committee (HREC ref: 020/2013). Informed consent was obtained from participants prior to data collection.
Fifty-eight participants (N=60) completed the pre-test and 45 completed the post-test (see Figure 1 for the study flow diagram). Only data for participants who completed both tests (n=45) were analysed; this represented 75% of the population. There were 39 females and six males with a median age of 18.0 (range: 17.0, 27.0) years. English was the home language of 26 participants (57.8%). Twenty-five participants (55.6%) had chosen occupational therapy as their first choice of study.
Knowledge increased significantly (p<0.00l) between pre-test and post-test for all Section B questions except question 4 (p=0.073) (see Table 3 on page 67).
Similarly, there was a significant increase in knowledge scores in Section C from pre-test to post-test for all questions except question 4.3 for both scenarios (What is the 'occupational form' in this scenario? (Cultural) and question 2 for scenario 2 (What is the 'occupational performance' in this scenario?) (see Table 4 on page 67).
Positive attitudinal changes occurred between pre-test and posttest as shown by the increased number of participants selecting the desired response option for each question at the post-test (see Table 5 on page 67 - increases shown in bold).
Themes emerging from the analysis of the open-ended questions for questions II ('I feel that the environment does not play a significant role in what a person does') and 12 ('I feel that occupation is an important part of life') give additional insights into participants understanding of the core constructs of occupation (see Tables 6 and 7 on page 68).
The study results indicate that the Basic Concepts of Human Occupation and Artformsmodules were successful in meeting the learning outcomes of the first year course. Significant improvements in knowledge of the core constructs occurred with attitudinal shifts towards a greater appreciation of occupation and its dimensions. Participants' justifications for their responses to the attitude questions revealed impressive depth and understanding for this stage of their course. Changes in knowledge and attitudes for each construct are discussed further in separate sub-sections.
Occupation is a complex term and challenging to define1,9. The marking rubric required participants to provide a comprehensive definition of occupation by highlighting its four constructs. It was encouraging that participants were able to draw from a variety of theorists to explain their understanding of occupation. Despite being in their first year, the majority of participants understood that occupations involve engagement in an activity by an individual. A greater understanding of 'meaning' as an integral part of occupation was also seen at post-test. Understanding of the role of 'occupational form' was however limited, as only fourteen participations utilised this construct to define 'occupation' in the post-test. Considering the learning outcomes of these modules, teaching related to the relationship between the environment and the occupation should be strengthened as this is crucial for developing a holistic understanding of occupation34.
Participants' attitudes towards occupation deepened by the end of the first semester. Most already displayed a sound appreciation of the importance of occupation within everyday life at the pre-test, and by the post-test, were able to link 'occupation' and 'meaning' while appreciating the centrality of occupations within daily life. Many of the themes emerging from the open-ended questions aligned directly with the philosophy underpinning the profession that occupations are an integral part of life1,2,35.
While significant increases in the knowledge scores for 'developmental structure' were observed at the end of the modules, the low scores for the open-ended questions and MCQs suggest that this construct was not well understood. Examination of participants' responses indicated that while they understood the construct of 'person or doer', they seemed to have limited understanding of this as 'developmental structure' as described by Nelson. When 'person' instead of 'developmental structure' was used in the attitude questions, many participants were able to highlight the influence of various aspects within the person (for example, personal capacities, knowledge and emotional state) on occupational performance. Thus it seems that the term 'person' was better understood than 'developmental structure'.
Participants' were able to highlight how competence shapes occupational choices and experiences, showing a clear alignment between their attitudes and the knowledge component of the modules. Participants' growing appreciation of the role of the 'person' within the occupation serves as a strong basis for further exploring the therapeutic value of occupations and how these can be tailored for different people to shape their development.
The definition of 'occupational form' used in the rubric drew on an understanding of several theorists1,2,4,5,34. While the results indicate that understanding improved significantly, participants displayed only a basic knowledge of this construct at the post-test. However, due to the comprehensiveness of the highest level of response, participants were not expected to achieve maximum scores at this level of study.
Although there was an increase in understanding of the physical and social components of 'occupational form', knowledge of the cultural component was limited as seen by the small number of students who included culture in their open-ended responses in Section B, and who identified the cultural component of the occupational form in Section C. A basic understanding of culture within occupation is necessary to developing cultural competence which is essential for practice within a multicultural society such as South Africa1,35.
With regard to attitudes, the common theme 'environment influences occupational performance' that emerged at the pre-test and post-test revealed that students had an appreciation of the role of occupational form in 'doing'. Their attitudes also focused on the way in which the environment influences 'developmental structure', by identifying decision-making and thought processes as aspects of the person that may be influenced by the environment. This appreciation of 'occupational form' may have been influenced by the Artforms module in which students experienced the impact of different contexts on occupational performance. It is encouraging to note that at this stage in their education, students were beginning to grapple with the influence of occupational form, and its various dimensions, on occupation.
At the post-test, most participants only utilised the 'doing' aspect to describe 'occupational performance' and failed to include the 'person' and 'context' in their responses. This resulted in participants being penalised for not explicitly stating the criteria outlined in the rubric, and thus the lower marks in the post-test may not have been a true reflection of the change in participants' understanding, but rather due to their choice of wording.
It was interesting to note at the post-test that few participants made reference to the role of the environment in 'occupational performance', and that there was a decrease in the number of participants including the 'person' in their answers. This may suggest that the modules may not be explicitly highlighting the transactional relationship between occupation, person and environment resulting in an incomplete understanding of 'occupational performance'. It is important for students to grasp that 'doing' is the combination of an individual or group actively engaging in an occupation within a particular context as this will influence how they engage with clients and how they adapt the task or environment to suit the person.
Occupational performance is focussed on in the second semester.
The number of participants demonstrating the desired attitude towards 'meaning' (Section D) increased from pre-test to post-test suggesting that students developed a greater appreciation of 'meaning' as a key construct of occupation36. The findings suggested, however that they had not yet developed a comprehensive understanding of this construct at the post-test. Christiansen36 emphasised the importance of 'meaning' within occupational therapy but recognised that understanding the process of meaning-making is a long-term endeavour. First year students' cannot therefore be expected to fully comprehend the multiple aspects of this construct, but the subsequent years of study should ensure that students are given further opportunities to develop their understanding of meaning within occupational therapy.
Strengths and limitations
The sample size represented 75% of the population which exceeded the minimum sample required. As a result the study findings can be generalised to the population of first year students at UCT in 2013. The research design quantified the students' knowledge and attitudes and compared these before and after their engagement in the modules. This has provided some evidence of the impact of these modules in meeting the first year learning outcomes. Using a purely quantitative methodology, however, limited the depth of data gathered, particularly with regard to attitudes. As a result, more emphasis was placed on knowledge. As a control group could not be used, confounding variables, such as participants' self-directed learning and lecture attendance, may have influenced the results. The timing of the pre-test after the first Human Occupation lecture, and the practice effect, may also have confounded the results.
Although the questionnaire was designed for the study and underwent an extensive review process, limitations in its development and use may have negatively influenced the accuracy of the results. Time constraints did not permit piloting of the final questionnaire and therefore it is not known whether the test-retest reliability for section C improved after revisions were made following the pilot study. The use of multiple choice questions limited the ability of the questionnaire to capture the complexity of occupation as it reduced the correct response to a single best answer17,37. Some questions were leading in nature, and responses may therefore not have been a true reflection of participants' knowledge and attitudes37. A further concern arose during the marking process, where the expectancy effect38 may have influenced the reliability of scores assigned by raters. The rubric may have had an influence on the study results as the educational outcomes only required students to display a basic understanding of occupation and its constructs, but the rubric required comprehensive responses which may have placed students at a disadvantage. Furthermore, while other theorists' understanding and definitions of constructs were incorporated into the rubric, placing such strong emphasis on Nelson's understanding may have disadvantaged students who preferred to use other theorists.
The study revealed a significant increase in knowledge of the core constructs of occupation, and a slight shift in attitudes by the end of the two modules. Although improvements in knowledge were apparent for most constructs, there were some gaps in understanding. These included the role of the environment within occupation, the cultural component of 'occupational form' as an integral part of the environment, and 'developmental structure' as relating to the person. Appropriate to their level of study, participants could describe 'occupational performance' and 'meaning' reflecting a basic understanding of these constructs. It is anticipated that as students' progress through the course, they will be provided with further opportunities to engage with the core constructs and develop a more comprehensive understanding of occupation. Assessing attitudinal changes over such a short period is very difficult, particularly with complex concepts. Attitudes did, however, appear to be aligned with the work of various occupational therapy theorists.
With the increased emphasis on the core constructs of occupation within the Minimum Standards for the Training of Occupational Therapists39, it was encouraging to note that within the first few months of their course, the first year occupational therapy students at UCT had the necessary understanding of an occupation-based approach to occupational therapy.
Recommendations for education
For first year students to develop a holistic understanding of occupation some aspects of the current course content should be strengthened. Firstly, students should be familiarised with the terminology relating to Nelson's conceptualisation of occupation. Secondly, greater emphasis should be placed on the role of the environment within occupation with further explanation and clarification of culture as an environmental component. Thirdly, opportunities should be provided for further discovery of how 'occupation' and 'occupational form' influence each other, and the impact they may have on occupational engagement. Lastly, students should be assisted in exploring the transactional relationships between the occupation, the person and the environment, and to grapple with the influences that these may have on occupational performance. To this end, the emphasis in teaching and learning activities should be placed on ensuring students understand and become confident in describing and applying concepts related to human occupation within a variety of contexts.
Recommendations for research
Future studies should take a mixed methods approach to capture students' learning experiences more fully while obtaining objective data to measure changes in knowledge and attitudes. The questionnaire and marking guides (rubric and memorandum) need to be reviewed and undergo further testing and validation to improve their validity and reliability. Once the questionnaire and marking guides have been strengthened, they should be used in a further study to re-assess the impact of the Basic Concepts of Human Occupation and Artformsmodules. Such a study will provide evidence for the effectiveness of these two modules in meeting the first year learning outcomes and inform curriculum improvement.
Acknowledgements to the expert panel (Madeleine Duncan, Matthew Molineux, Mapheyeledi Motimele, David Nelson, Nicholas Pollard, Elelwani Ramugondo, Clare Wilding) for feedback on the measurement tool.
1. Hagedorn R. Occupational therapy: perspectives and processes. London: Churchill Livingstone, 1995. [ Links ]
2. Kielhofner G. Conceptual foundations of occupational therapy practice, 4th ed. Philadephia: FA Davis Company, 2009. [ Links ]
3. Division of Occupational Therapy University of Cape Town. Self-review report for Health Professions Council of South Africa (HPCSA) Evaluation: 2012. [ Links ]
4. Nelson D. Occupation: Form and Performance. American Journal of Occupational Therapy. 1988; 42: 633-41. [ Links ]
5. Nelson D. Therapeutic Occupation: A Definition. American Journal of Occupational Therapy. 1996; 50: 775-82. [ Links ]
6. Oxford Dictionaries. Oxford University Press, 2014. [ Links ]
7. Grad F. The Preamble of the Constitution of the World Health Organization. Bulletin of the World Health Organisation. 2002; 80: 982. [ Links ]
8. Law M, Steinwender S and Leclair L. Occupation, health, and well-being. Canadian Journal of Occupational Therapy. 1998; 65: 81-91. [ Links ]
9. Royeen C. Occupation reconsidered. Occupational Therapy International. 2002; 9: 111-20. [ Links ]
10. Wu C and Lin K. Defining occupation: A comparative analysis. Journal of Occupational Science. 1999; 6: 5-12. [ Links ]
11. Pierce D. Untangling occupation and activity. American Journal of Occupational Therapy. 2001; 55: 138-46. [ Links ]
12. Ikiugu M and Rosso H. Facilitating professional identity in occupational therapy students. Occupational Therapy International. 2003; 10: 206-25. [ Links ]
13. Bowling A. Mode of questionnaire administration can have serious effects on data quality. Journal of Public Health. 2005; 27: 281-91. [ Links ]
14. Kaplan R, Sieber W and Ganiats T. The quality of well-being scale: Comparison of the interviewer-administered version with a self administered questionnaire. Psychology and Health. 1997; 12: 783-91. [ Links ]
15. Wright D, Aquilino W and Supple AJ. A comparison of computerassisted and paper-and-pencil self-administered questionnaires in a survey on smoking, alcohol, and drug use. Public Opinion Quarterly. 1998; 62: 331-53. [ Links ]
16. Sahlqvist S, Song Y, Bull F Adams E, Preston J and Ogilvie D. Effect of questionnaire length, personalisation and reminder type on response rate to a complex postal survey: randomised controlled trial. BMC Medical Research Methodology. 2011; 11: 1-8. [ Links ]
17. Gendall P and Hoek J. A question of wording. Marketing Bulletin.1990;1: 25-36. [ Links ]
18. Centre for Teaching and Learning. Improving multiple choice questions. Centre for Teaching and Learning.1990; 8: 1-4 ( accessed August 20, 2013). [ Links ]
19. Momin Mujeeb A, Pardeshi M and Ghongane B. Comparative assessment of multiple choice questions versus short essay questions in pharmacology examinations. Indian lournal of Medical Science. 2010; 64: 118-24. [ Links ]
20. Croasmun J and Ostrom L. Using Likert-type scales in the social sciences. Journal of Adult Education. 2011; 40: 19-22. [ Links ]
21. Funk S and Dickson L. Multiple choice and short-answer exam performance in a college classroom. Teaching of Psychology. 2011; 38: 273-7. [ Links ]
22. Palmer E and Devitt P Assessment of higher order cognitive skills in undergraduate education: modified essay or multiple choice questions? BMC Medical Education. 2007; 7: 1-7. [ Links ]
23. National Board of Medical Examiners. Constructing written test questions for the basic and clinical sciences, 3rd ed. Philadelphia, USA: National Board of Medical Examiners, 2002. [ Links ]
24. Reja U, Manfreda K, Hlebec V and Vehovarl V Open-ended vs. close-ended questions in web questionnaires. Developments in Applied Statistics. 2003; 19: 159-77. [ Links ]
25. Allen D and Tanner K. Rubrics: Tools for making learning goals and evaluation criteria explicit for both teachers and learners. CBE Life Science Education. 2006; 5: 197-203. [ Links ]
26. Luft J. Design your own rubric. Science Scope. 1997; 20: 25-7. [ Links ]
27. Radhakrishna RB. Tips for developing and testing questionnaires/instruments. Journal of Extension. 2007; 45: accessed 04 February 2013). [ Links ]
28. Taylor-Powell E. "Pilot test your questionnaire." n.d. <https://www.team-psa.com/brfss/20l2/pres/K_Trepanier_questionnaire.pdf> (23 October 2014. [ Links ]
29. Cicchetti D and Sparrow SA. Developing criteria for establishing interrater reliability of specific items. American Journal of Mental Deficiency. 1981; 86: 127-37. [ Links ]
30. Landis J and Koch G. The measurement of observer agreement for categorical data. Biometrics. 1977; 33: 159-74. [ Links ]
31. Falleti M, Maruff P Collie A and Darby D. Practice effects associated with the repeated assessment of cognitive function using the CogState battery at 10-minute, one week and one month test-retest intervals. Journal of Clinical and Experimental Neuropsychology. 2006; 28: 1095-112. [ Links ]
32. Fecso R and Pafford B. Response errors in establishment surveys with an example from an agribusiness survey: (n.d., accessed August 20, 2013 ). [ Links ]
33. Depoy E and Gitlin LN. Introduction to research: Understanding and applying multiple strategies, 3rd ed. St. Louis, MD: Elsevier Mosby, 2005. [ Links ]
34. Law M, Cooper B, Strong S, Stewart D, Rigby P and L L. The Person-Environment-Occupation Model: A transactive approach to occupational performance. Canadian lournal of Occupational Therapy. 1996; 63: 9-23. [ Links ]
35. Pierce D. Occupation by Design: Building therapeutic power. Philadelphia: FA Davis, 2003. [ Links ]
36. Christiansen C. Defining lives: occupation as identity: an essay on competence, coherence, and the creation of meaning. American Journal of Occupational Therapy. 1999; 53: 547-58. [ Links ]
37. Rocha E, Marche T and Briere J. The effect of forced-choice questions on children's suggestibility: a comparison of multiple choice questions and yes/no questions. Canadian Journal of Behavioural Science. 2012); 45: l-ll. [ Links ]
38. Cozby P Methods in behavioural research, 9th ed. USA: McGraw-Hill Companies, 2005. [ Links ]
39. Health Professions Council of South Africa (HPCSA). Regulations relating to the registration of occupational therapy students and the minimum standards for the training of occupational therapy students: 2003. [ Links ]
APPENDIX 1 : FIRST YEAR LEARNING OUTCOMES RELATED TO THE BASIC CONCEPTS OF HUMAN OCCUPATION AND ARTFORMS MODULES
By the end of the course, students will be able to:
❖ Describe the concept of 'occupation' and begin to understand its dimensions.
❖ Discuss the experience of doing an occupation.
❖ Describe the role that environment plays in an occupation.