SciELO - Scientific Electronic Library Online

 
vol.6Development of wheelchair caster testing equipment and preliminary testing of caster modelsUse of a design challenge to develop postural support devices for intermediate wheelchair users author indexsubject indexarticles search
Home Pagealphabetic serial listing  

Services on Demand

Article

Indicators

Related links

  • On index processCited by Google
  • On index processSimilars in Google

Share


African Journal of Disability (Online)

On-line version ISSN 2226-7220
Print version ISSN 2223-9170

Afr. j. disabil. (Online) vol.6  Durbanville  2017

http://dx.doi.org/10.4102/ajod.v6i0.318 

ORIGINAL RESEARCH

 

Wheelchair services and use outcomes: A cross-sectional survey in Kenya and the Philippines

 

 

Eva S. BazantI; Elizabeth J. Himelfarb HurwitzI; Brenda N. OngutiII; Emma K. WilliamsI; Jamie H. NoonIII; Cheryl A. XavierIV; Ferdiliza D.S. GarciaV; Anthony GichangiII; Mohammed GabbowVI; Peter MusakhiVII; R. Lee KirbyVIII

IJhpiego, Baltimore, United States
IIJhpiego, Nairobi, Kenya
IIINoon Design, Cerrillos, United States
IVPrivate Sector, Matale, Sri Lanka
VCollege of Allied Medical Professions, University of the Philippines, Manila, Philippines
VINational Council for Persons With Disabilities, Government of Kenya, Kenya
VIIMinistry of East African Community (EAC), Labour and Social Protection, Government of Kenya, Kenya
VIIIDivision of Physical Medicine & Rehabilitation, Dalhousie University, Canada

Correspondence

 

 


ABSTRACT

BACKGROUND: The World Health Organisation recommends that services accompany wheelchair distribution. This study examined the relationship of wheelchair service provision in Kenya and the Philippines and wheelchair-use-related outcomes.
METHOD: We surveyed 852 adult basic manual wheelchair users. Participants who had received services and those who had not were sought in equal numbers from wheelchair-distribution entities. Outcomes assessed were daily wheelchair use, falls, unassisted outdoor use and performance of activities of daily living (ADL). Descriptive, bivariate and multivariable regression model results are presented.
RESULTS: Conditions that led to the need for a basic wheelchair were mainly spinal cord injury, polio/post-polio, and congenital conditions. Most Kenyans reported high daily wheelchair use (60%) and ADL performance (80%), while these practices were less frequent in the Philippine sample (42% and 74%, respectively). Having the wheelchair fit assessed while the user propelled the wheelchair was associated with greater odds of high ADL performance in Kenya (odds ratio [OR] 2.8, 95% confidence interval [CI] 1.6, 5.1) and the Philippines (OR 2.8, 95% CI 1.8, 4.5). Wheelchair-related training was associated with high ADL performance in Kenya (OR 3.2, 95% CI 1.3, 8.4). In the Philippines, training was associated with greater odds of high versus no daily wheelchair use but also odds of serious versus no falls (OR 2.5, 95% CI 1.4, 4.5.
CONCLUSION: Select services that were associated with some better wheelchair use outcomes and should be emphasised in service delivery. Service providers should be aware that increased mobility may lead to serious falls.


 

 

Introduction

An estimated 20 million people worldwide in 2003 needed a wheelchair for mobility and lacked one (World Health Organization [WHO] 2008). In less resourced settings, access to appropriate wheelchairs is limited. An appropriate wheelchair allows the user to meet his or her mobility needs in the local environment, providing postural support with proper fit and is durable, safe, available, affordable and maintainable by the user (WHO 2008). Globally, charitable, governmental and service organisations provide wheelchairs. However, users in less resourced settings often receive inappropriate wheelchairs or wheelchairs with inadequate services. Awareness is increasing wheelchair provision by trained personnel increases the chance that wheelchair users receive appropriate wheelchairs (Toro, Eke & Pearlman 2016).

The WHO Guidelines on the Provision of Manual Wheelchairs in Less Resourced Settings calls for the components of wheelchair service delivery to include referral and appointment, assessment, prescription (selection), funding and ordering, product preparation, fitting, user training, follow-up, maintenance and repairs (WHO 2008). Few studies have assessed whether users in less resourced settings have received these services and user outcomes (Borg et al. 2012; Greer, Brasure & Wilt 2012; Toro et al. 2016).

Lack of service provision may be one of the reasons for wheelchair abandonment. In 2005 in West Bengal, India, over half of 162 hand rim-propelled manual wheelchairs distributed to individuals with lower-limb dysfunction went unused because of pain, fatigue, discomfort and lack of habitat adaptability (Mukherjee & Samanta 2005). It is not known if the users who abandoned these wheelchairs had received any supportive services.

Wheelchairs need to be rugged to withstand use in challenging terrain (Rispin &Wee 2014). In Nepal, two-thirds of donated standard wheelchairs in one study needed replacement within two years, leaving users unable to access the community independently (Scovil et al. 2012). Even in the United States, about half of wheelchairs need repair within six months of issue (Worobey et al. 2012).

User involvement in wheelchair selection has seen positive effects. In Bangladesh, measuring a user for a wheelchair increased the likelihood of wheelchair satisfaction, and wheelchair training was associated with the user reporting fewer activity limitations and participation restrictions (Borg et al. 2012). The effectiveness of wheelchair skills training is well documented (for instance Best et al. 2005, 2016; Kirby et al. 2016a; MacPhee et al. 2004; Ozturk & Ucsular 2011; Routhier et al. 2012; Worobey et al. 2016; Tu et al. 2017). However, greater wheelchair use in varied terrain can lead to falls and injury (Berg, Hines & Allen 2002; Calder & Kirby 1990; Gaal et al. 1997; Kirby et al. 1994; Nelson et al. 2010; Xiang, Chany & Smith 2006).

The objective of this study was to examine whether wheelchair service receipt is associated with successful wheelchair use among adult, basic manual wheelchair users in less resourced settings. The hypothesis was that wheelchair service receipt is associated with high daily wheelchair use, independent outdoor mobility and high performance of activities of daily living (ADL) and with fewer reports of serious falls.

 

Research methods and design

Design and locations

This was a cross-sectional survey of wheelchair users in Kenya and the Philippines. The two-country study was done in sub-Saharan Africa and Asia at the request of the funder. Wheelchair sector stakeholders advised the research team on the study location. Priority was placed on countries with high wheelchair distribution, countries with organisations providing wheelchair services and a country where the institution of the lead author of this article had an office. In each country, investigators met with stakeholders in the field of disability and wheelchairs to discuss the study purpose and methods.

Dissemination of information about the study to organisations, sampling and recruitment

We aimed to enrol a sample that would be composed equally of participants who had received services with the current wheelchair and those who did not.

Eligible wheelchair users were age 18 or older, did not require postural support and those who received their current or most recently acquired wheelchair within the past five years but greater than three months before the survey date to ensure experience with the current chair. Exclusion criteria were being a temporary wheelchair user or a user of an arm-crank-propelled tricycle, inability to communicate in either English, Swahili in Kenya or Filipino in the Philippines; or inability to understand the questions. In the Philippines, it was difficult to find users who had received services. In the last month of data collection, the study protocol was amended to include wheelchair users who had received the current wheelchair in the last 10 years.

The screening question to potential participants was: 'When you received your current or most recent chair, did a wheelchair provider help you choose the right wheelchair? The provider might have measured your body, checked the fit of the wheelchair, or made adjustments to the wheelchair.'

In Kenya, residents of urban and peri-urban areas were sampled from lists provided by wheelchair-providing organisations that were faith-based, non-governmental, community-based, related to disabled person's rights or government hospitals and schools. In the Philippines, Greater Manila residents were sampled through lists of wheelchair users provided by five local government units that provided wheelchairs to citizens, a wheelchair charity and a non-governmental organisation that employed wheelchair users. In addition, in both countries, snowball sampling occurred, in which study participants referred members of their personal networks. Participants and up to one caregiver received locally appropriate participation and travel reimbursements in the Philippines. In Kenya, local investigators considered reimbursement inappropriate and it was not given in Kenya, per the study protocol and this was approved by the ethical review boards.

Sample size

The sample size calculation was specified to detect a difference of 15% points on the primary outcome of high daily wheelchair use between wheelchair users who reported receiving services with the current chair and those who did not. The hypothesis was that the outcome would be 50% among those in the service group, a percentage that would yield the largest and most conservative sample size. The power was set at 80%, alpha level of significance was set at 0.05 and intra-cluster correlation was set at 0.002. The sample size calculation called for 500 per country with 10 clusters or groupings.

Data collection and management

Data collection occurred from December 2014 to June 2015 in Kenya and from February to May 2015 in the Philippines. In Kenya, the authors' institutional staff collected data. In the Philippines, a local organisation with experience in disability sector research was selected through a competitive process. Data collection was conducted by 8 surveyors and 4 field supervisors in Kenya and 15 surveyors and 7 field supervisors in the Philippines. Surveyors had secondary education and data collection experience in the Philippines and college/university education in Kenya. In each country, surveyors received one week of training on data collection procedures, including use of the instruments, informed consent and research ethics.

The paper-based tool was digitised using Open Data Kit (https://opendatakit.org/ and Brunette et al. 2013) and collected on Android tablet computers in each country. Data were exported to a Microsoft Excel 2013 database. Data cleaning was conducted in Kenya using Excel and in the Philippines in IBM Statistical Product and Service Solutions version 20 for Windows (Armonk, NY, 2011). This step was to ensure that study identification numbers for the participants were captured correctly and were not repeated and that snowballed participants were assigned to the index participant's cluster for analysis.

Instrument development

The development of the survey instrument occurred in phases. Firstly, the investigators sought out published instruments and 22 instruments were found. Secondly, the content of the questions in the instruments was reviewed for the main themes and sub-themes. Many of the existing instruments were not considered to be readily adaptable to the setting and research questions of this study within the time frame of the project. Some questions used in the survey were informed by the existing instruments. These instruments include the Wheelchair Adapted International Outcome Inventory for Hearing Aids (Borg et al. 2012); the Wheelchair Skills Test Questionnaire (Kirby et al. 2016b); the Wheelchair Use Confidence Scale for Manual Wheelchair Users (Version 3.0) (Rushton et al. 2013); the Efficiency of Assistive Technology and Services 6D Forms (Andrich et al. 1998); and Life Space Assessment (Peel et al. 2005). Throughout the process, wheelchair stakeholders advised on the survey instrument development.

Thirdly, this study developed a conceptual framework to guide measurement (Figure 1-A1; Accelovate 2015). It was informed by two main published frameworks, a framework of public health intervention researchers (Bryce et al. 2011) and the wheeled mobility framework of Routhier et al. (2003). The study framework covered the environmental context and actors and programme inputs, outputs, outcomes and impact.

Fourthly, pilot testing of the instrument occurred during field visits in April 2014 in Manila, Philippines, and May 2014 in Dar es Salaam and Moshi, Tanzania, possible locations for the study (Figure 2-A1; Accelovate 2015). Investigators met with organisations providing wheelchairs and services. The draft survey instrument was discussed with wheelchair organisation stakeholders and through a focus group with wheelchair users to discuss the instrument and gather feedback on the relevance of questions to their lives. After the field visits, the survey instrument questions were refined.

The survey instrument asked about past receipt of the steps of wheelchair service recommended by WHO considered most amenable to self-reporting: assessment, fitting, training and maintenance, repair and follow-up (WHO 2008). The survey's questions were related to sociodemographic and other personal characteristics, the experience and receipt of wheelchair services with the current wheelchair or any wheelchair ever received during the lifetime. The survey questions were also related to the wheelchair characteristics and acquisition. Lastly, the questions inquired about the outputs of daily wheelchair use and experience of severe falls and the outcomes of high performance of ADL and unassisted outdoor mobility. The survey instrument was translated into Swahili in Kenya and Filipino in the Philippines and back-translated to English.

Variables and analysis

We collected sociodemographic, clinical and wheelchair data, specifically age, gender, county (in Kenya), educational level, marital status, employment type, wealth quintile, condition that led the user to need a wheelchair, number of wheelchairs acquired in last five years, source of wheelchair and whether or not the wheelchair was donated or received at no cost to the user. The question on the type of wheelchair had response categories of 'basic indoor chair', 'rough terrain wheelchair with long wheel-base', 'wheelchair unavailable' and 'don't know'. Household wealth was based on a module of standard questions from large household surveys (Kenya National Bureau of Statistics and ICF Macro 2010).

The survey asked whether the user received one of many services with the current wheelchair, as well as services ever received during the participant's lifetime. In the analysis, the answer of 'yes' to several questions was used to create a composite or summary variable to describe assessment, fitting and training. Maintenance, repair, follow-up and other services were assessed in a single item. Details on creation of the service variables are presented in Table 1-A1.

To measure the output of daily wheelchair use, participants were asked how long they used or occupied their wheelchairs from the time they woke up to midday and from midday to the time of going to bed, to arrive at the total number of hours. Responses were categorised as 'not daily', '1-7 hours daily' and ' 8 hours daily'. This was based on the distribution of responses to the continuous variable.

To measure the output of falls, the survey asked, 'With your current wheelchair have you ever fallen?'. The next question was 'Was this a serious fall? By serious, I mean a fall that left you with pain or soreness that lasted more than one hour, bruising, skin cuts or abrasions, or injuries to your bones or joints'. This variable was analysed as a three-level variable of 'no falls', 'non-serious falls' and 'serious falls'.

To measure the outcome of unassisted outdoor mobility, three survey questions were used. Users were coded as 'yes' on this outcome if they reached an area outside their home in a wheelchair in the last month and did not need help in doing so. Those who did not have another area to go to were excluded. Those who reached another area but not in a wheelchair were coded 'no'.

To measure the outcome of high performance of ADL, participants were told, 'For each activity that I read, please let me know if you perform it independently or assisted'. Items were bathing, dressing, eating and toilet hygiene. Response categories were 'Independently' and 'Assisted'. If the activity was performed independently or unassisted, this variable was coded 1 and if not, 0. Performance was considered 'high' if at least three of the four items were carried out unassisted and 'low' for zero-two items.

Analysis was carried out for each country separately and data were not combined across countries because of differences in sampling strategies and geographic coverage. Descriptive results are frequencies and tabulations. In bivariate analysis, each wheelchair service variable was assessed for its association with the output or outcome. Logistic regression was used for dichotomous variables yielding odds ratios (ORs). Multinomial logistic regression was used for three-level outcomes. These models produce relative risk ratios, which can be interpreted as ORs. The models accounted for within-cluster correlation of outcomes (Rogers 1993) using the 'vce(cluster)' option in Stata software (StataCorp 2013). In Kenya, the organisation from which the investigators received the contact information of the wheelchair users was designated the cluster. In Philippines, a neighbourhood unit called a barangay within the local government unit from which we received the contact information of the wheelchair users was designated the cluster. In both countries, 'snowballed' wheelchair users who were referred by another participant to the survey team were assigned the cluster of the index participant.

To answer the research questions, wheelchair service items as well as participants' sociodemographic or wheelchair user variables significantly associated with wheelchair use outputs and outcomes at p < 0.10 in the bivariate analyses were entered into multivariable models. Multivariable regression models controlled for potential confounders of the relationship of wheelchair services and wheelchair outputs or outcomes.

Models in Kenya were adjusted for number of wheelchairs acquired in the last five years, county, age category, educational level, marital status, employment type, condition that led the user to need a wheelchair, source of wheelchair, wealth quintile, whether or not the wheelchair was donated and type of wheelchair. Models in Philippines were adjusted for number of wheelchairs acquired in last five years, region, age category, educational level, gender, condition that led user to need a wheelchair, any employment, source of wheelchair, and whether or not the wheelchair was donated. Models for performance for ADL and falls were also adjusted for the three-level daily wheelchair use level.

A few variables had some missing data. In Kenya, between 10 and 12 respondents were missing data for age and marital status. In the Philippines, the source of the wheelchair was missing for 10 respondents and for 'current wheelchair donated', 13 are missing. For 'current wheelchair has a cushion', the interviewer was unable to record this information for 60 respondents in Kenya and 5 respondents in the Philippines. Wheelchair services significantly associated with each outcome were identified by the 95% confidence interval (CI) of the adjusted ORs that did not cross 1.0. All analyses were conducted in Stata 13.0 (StataCorp, College Station, TX).

Ethical consideration

This study received ethical approval from the institutional review boards of Johns Hopkins University Bloomberg School of Public Health in Baltimore, MD, United States (#5839); Kenya Medical Research Institute in Nairobi, Kenya (Non-SSC Determination #457); and University of Philippines Manila Research Ethics Board (#2014-351-01). All study participants provided informed consent immediately prior to the survey participation. Consent was oral in Kenya, according to an approved consent script. At the request of the University of Philippines, consent included participant signature. Interviews were carried out in spaces allowing for audio and visual privacy.

 

Results

Samples achieved

In Kenya, after removing duplicate names from a list of 1764 wheelchair users, potentially eligible participants were 1612; of these participants, 671 could not be reached. Of the 941 participants screened, 512 were eligible and 429 ineligible. Of the eligible, 72 participants were unavailable. In Kenya, 440 participants were included. Twenty participants were younger than age 18 according to the birthdate in the survey and their data were not analysed, yielding 420 participants whose data were analysed.

In the Philippines, of the 1490 wheelchair user names, 575 potential participants could not be screened because they were inaccessible by phone or because they had died. Of the 915 participants reached and screened, 497 were eligible and 417 ineligible because they used a non-basic wheelchair, they were younger than age 18, were unable to communicate or had received current wheelchair more than five years ago. However, this criterion was relaxed in the last month of survey data collection to reach enrolment goals. In the Philippines, 56 participants were unavailable and 9 declined. Overall, 432 participants were included. Figure 3-A1 depicts the locations of the study participants in each country.

Descriptive results

Sample characteristics

In Kenya, participants were primarily men, younger than age 50 and employed (Table 1). The most commonly reported conditions requiring the need for wheelchairs were spinal cord injury, polio or post-polio and congenital issues. The most common sources of the current wheelchairs were charity, government and family or friend. Current wheelchair types were basic indoor wheelchairs for the majority of the sample, while others had rough-terrain wheelchairs or unknown types. For 54% of participants, the current wheelchairs had a cushion at the time of the interview.

 

 

In the Philippines, participants were about equally split by gender, mostly age 50 or older and unemployed, and nearly half were married or cohabiting. Conditions related to the need for wheelchairs included old age, arthritis and bone problems; polio or post-polio and spinal cord injury plus old age or arthritis or bone problems, and stroke, nerve- or clot-related problems. Most received their wheelchairs from government, charity or family or friend. For most users, the current wheelchairs were basic indoor wheelchairs (91%) and few wheelchairs had cushions (28%). In both countries, most users received the wheelchair at no cost. Because of a concerted effort to find users who received services and the expansion of eligibility criterion, 16% of the sample in the Philippines had received their chair more than 5 and less than 10 years before the survey.

Wheelchair services received

In each country, approximately 40% of the participants were classified in the service-received category according to the response to the screening question. In Kenya, for the current wheelchair, a third of participants received wheelchair assessment (31%), a third of participants received wheelchair fitting (34%) and 42% were fitted while the user propelled the wheelchair (Table 2). Few participants received any other services with the current wheelchair. Regarding services ever received in the lifetime, just over a quarter of participants received wheelchair training; similarly, 26% ever received instructions in taking care of the wheelchair; 41% reported that a provider had ever helped choose the right wheelchair. Few participants had ever been told where to seek help with repairs (15%) or had ever been contacted by the provider in follow-up (15%). The question on skin problems is not reported on because of an issue with the programming of this item in the software.

 

 

In the Philippines, for the current wheelchair nearly a third of participants received wheelchair assessment (31%), a quarter received wheelchair fitting (26%), and 39% were fitted while the user propelled the wheelchair. Few participants (15%) reported that a provider had asked about or physically checked the user for skin problems or pressure sores; 10% were checked for unsafe seat pressure. Regarding services ever received in the lifetime, 17% of participants had received wheelchair-related training, a quarter of participants received provider instructions in taking care of the wheelchair and 40% reported that a provider had ever helped choose the right wheelchair. Few participants had been told where to seek help with repairs (18%) or were contacted by the provider (20%).

Wheelchair-related outputs and outcomes

In Kenya, most participants (60%) reported using the wheelchair daily for 8 h or more and 80% independently performed at least three of the four assessed ADL (Table 3). Only 25% of participants used their wheelchairs outdoors unassisted in the past month. Falls were common; 22% had ever had a serious fall, while 37% reported a non-serious fall.

 

 

In the Philippines, 42% of participants used their wheelchairs for 8 h or more and 16% used it 1-7 h daily. Most participants (73%) independently performed at least three of four ADL. A third (33%) of participants used their wheelchairs outdoors unassisted. Two-thirds of Filipino users had not fallen (66%).

Bivariate results

Daily wheelchair use was associated at p < 0.05 with one service variable in Kenya, 'provider ever instructed user in taking care of wheelchair'. In the Philippines, daily wheelchair use was associated at p < 0.05 with 10 service variables: 'assessment with current chair', 'fitting', 'assessment of wheelchair fit while user propelled wheelchair', 'provider asking or physically checking user for skin problems, sensation or pressure sores', 'assessment duration: < 30 minutes', 'training ever received', 'provider ever helped user choose the right wheelchair', 'provider ever instructed user in taking care of wheelchair', 'provider ever told user where to seek help with repairs' and 'peer group training'.

In Kenya, reporting at least a non-serious fall versus no falls at the bivariate level was associated with three service variables: 'assessment duration of less than 30 minutes', 'provider ever helped user choose the right wheelchair' and 'provider ever instructed user in taking care of wheelchair'. In the Philippines, reporting a non-serious fall versus no falls was associated with the same 10 service variables as for wheelchair use.

High performance of ADL was associated at p < 0.05 with three service variables in Kenya: 'provider assessed wheelchair fit while user propelled wheelchair', 'provider asked or physically checked user for skin problems, sensation or pressure sores' and 'training ever received'. High performance of ADL was associated with nine service variables in the Philippines. These were the same as for daily wheelchair use, except for 'provider ever helped user choose the right wheelchair'.

Outdoor unassisted wheelchair use was associated with three service variables in Kenya: 'assessment', 'assessment of wheelchair fit while user propelled wheelchair' and 'training ever received'. In the Philippines, outdoor unassisted wheelchair use was associated with the same 10 service variables as for wheelchair use.

Multivariable model results

The wheelchair use outputs associated with wheelchair service items in multivariable models are presented in Table 4.

In Kenya, one service item was associated with daily wheelchair use: the provider ever contacting the user about the wheelchair use was associated with reduced odds of daily wheelchair use (OR 0.4, 95% CI 0.2, 0.9). No service item was associated with odds of falls.

In the Philippines, four service items were associated with daily wheelchair use. Ever receiving wheelchair training was associated with 4-fold increased odds of high versus no daily use (95% CI 2.3, 7.0). A provider helping the user choose the right wheelchair ever was associated with 2.8-fold increased odds of high versus no daily use (95% CI 1.1, 6.9). However the provider of the current wheelchair asking about or checking user for skin problems, sensation or pressure sores was associated with reduced odds of high versus no daily use (OR 0.5, 95% CI 0.2, 0.97). Ever being instructed in taking care of wheelchair was also associated with reduced odds of high versus no daily use (95% CI 0.2, 0.91).

In the Philippines, four service items were associated with increased odds of falls. Ever being told where to seek repairs was associated with 6.1-fold increased odds of serious versus no falls (95% CI 2.0, 18.4). Longer assessment duration was associated with increased odds of serious versus no falls (95% CI 1.3, 4.5). Ever receiving wheelchair training was associated with 2.5-fold increased odds of serious versus no falls (95% CI 1.4, 4.5). Peer group training was associated with 2.1-fold increased odds of serious versus no falls (95% CI 1.1, 4.0).

Wheelchair service items associated with outcomes of high performance of ADL and unassisted outdoor use in multivariable models are presented in Table 5.

In Kenya, three service items were associated with the outcomes ever having been told where to seek repairs, was associated with 2.8-fold increased odds of unassisted outdoor use (95% CI 1.5, 5.0). Two service items were associated with odds of high performance of ADL. Ever being trained was associated with 3.2-fold increased odds of high ADL performance (95% 1.3, 8.4). Having the fit of the wheelchair assessed while the user propelled the current wheelchair was associated with 2.8-fold increased odds of high performance of ADL (95% CI 1.6, 5.1).

In the Philippines, two service items were associated with the outcomes. Having the fit of the current wheelchair assessed while propelling was associated with (1) 2.4-fold increased odds of using the wheelchair outdoors unassisted (95% CI 1.5, 4.1) and (2) 2.8-fold increased odds of high ADL (95% CI 1.8, 4.5), a similar finding to Kenya. However, the provider doing the assessment or fitting at the wheelchair user's home was associated with reduced odds of outdoor unassisted use (OR 0.40, 95% CI 0.4, 0.9).

 

Discussion

This study is one of the first to present survey findings from less resourced settings examining specific wheelchair services received and the relationship to user outcomes.

Documenting the effectiveness, efficiency and costs of wheelchair service and distribution programmes is an imperative for funders and programme managers to better meet client needs (Harris & Sprigle 2008). As governments consider how to meet the needs of wheelchair users under national insurance schemes, information on outcomes will be important in establishing coverage priorities. As recommended by Harris and Sprigle (2008), this study in Kenya and Philippines assessed unassisted outdoor mobility and independent performance of ADL and falls.

Findings, explanations and prior research

Large studies with wheelchair users are rare. In this study in Kenya and the Philippines, wheelchair users who received and did not receive services with their current wheelchairs or in their lifetime were recruited and it was difficult to find users who had received wheelchair services. Similarly, Zongjie et al. (2007) found that while 75% of disabled residents in a Beijing sample expressed a need for rehabilitation, only 27% had received any services. Where wheelchair services are more available, users may be more often informed about or referred to rehabilitation services.

The provider assessing the fit of the wheelchair while the user propelled the wheelchair was associated with greater odds of high ADL performance in both countries. Providers fit clients as they propel in order to determine how the wheelchair user performs certain functions in the wheelchair. When the wheelchair is tailored to the functional needs of the user, performance of ADL may be facilitated.

Training in wheelchair use ever was positively associated with high daily wheelchair use in the Philippines and performance of ADL in Kenya, adding to literature on the safety and effectiveness of wheelchair skills training (for instance Best et al. 2005, 2016; Kirby et al. 2016a; MacPhee et al. 2004; Ozturk & Ucsular 2011; Routhier et al. 2012; Worobey et al. 2016; Tu et al. 2017). Higher odds of reporting falls were associated with receipt of training in Philippines. It may be that trained users had greater confidence to use their wheelchair in new places on rougher terrain or for longer distances without adequate protection and, therefore, incurred more falls. However, it is possible that the nature or dose of the training was suboptimal or the competencies achieved were inadequate. Also, users may have been overconfident following training.

Three provider actions related to wheelchair assessment and fit were negatively associated with three outcomes in the Philippines even while controlling for user characteristics, and several factors may explain this finding. Firstly, in the cultural context, elderly people and people with disabilities may not be expected to be independent, the assistance of a family member or carer is expected, and using of wheelchair outdoors may be associated with stigma in the setting (Tanudtanud-Xavier 2013). Secondly, the environmental context and limited public transport may preclude independent wheelchair mobility. Thirdly, the provider's actions may have been a response to the user's low daily wheelchair use, outdoor wheelchair use or ADL performance. In a household survey conducted in Beijing, China, having received rehabilitation services was associated with a lower functional independence measure score (Zongjie et al. 2007). The authors concluded that Beijing residents in need of rehabilitation lacking functional independence were seeking out services to improve their situation.

In our study, the user being told where to seek repairs was associated with outdoor unassisted wheelchair use in Kenya and falls in Philippines. Outwardly oriented users may have sought out information on wheelchair repairs. In Philippines, advice on how to repair wheelchairs or get spare parts may have followed chair breakdowns and falls (Williams et al. 2016). Possible factors related to this outcome may be fewer accessible environments and more available compatible parts and repair services.

There were low levels of unassisted outdoor wheelchair use. Generally, in Philippines and urban Kenya, many residential communities for people of limited economic means are not wheelchair accessible. Communities with narrow walkways and small houses may have required wheelchair users to seek assistance from others for mobility.

 

Limitations

In a cross-sectional survey, the temporal order of events cannot be confirmed and causality cannot be determined. Questions referring to a past time period may be influenced by recall bias. This study's results are not directly comparable at this time to other studies. The survey instrument was informed by existing instruments and developed for the specific goals of the study, as was done in other studies of assistive technology (Borg et al. 2012).

Although the survey had many modules to answer key research questions and was comprehensive, certain questions in the survey had limited response possibilities. For example, the question on type of wheelchair's response category of indoor chair does not indicate if the chair was for short-term hospital transport or intended for longer term use. The outcome of daily wheelchair use does not reflect the users' functioning while in the wheelchair. It is not possible to know whether wheelchair falls are related to improper wheelchair use.

Generalisability of this study to the national populations of adult, basic wheelchair users is limited by the sampling strategy of recruiting in equal numbers users who received wheelchair services and those who did not. Reported levels of wheelchair services received in this study may be different than those of the national population of wheelchair users, and this can be assessed in a national survey.

Recommendations for practice or programmes

The study findings were disseminated back to local authorities, wheelchair user and service delivery organisation stakeholders in well-attended meetings in both the Philippines and Kenya, and wheelchair stakeholders were advisers to this study from the beginning. This active engagement of local wheelchair stakeholders and users led to an outpouring of ideas on how to improve policy and programmes.

Training in wheelchair use is related to better wheelchair use outcomes and should continue to be emphasised and delivered in an efficient and equitable manner (Tu et al. 2017). Opportunities should be sought to provide basic wheelchairs partly through peer group workshops, and peer group training should be evaluated (Best et al. 2016). For countries that have an established and working community strategy, engaging community health volunteers can be explored as a mechanism for training wheelchair users.

The provider assessing the fit of the wheelchair (e.g. using the objective version of the Wheelchair Skills Test [Kirby et al. 2016b]) while the user propelled the wheelchair should be an emphasised element of the WHO service package. The provision of wheelchairs and services needs to include a plan for wheelchair maintenance (Toro et al. 2016) and access to spare parts. Wheelchairs should be distributed with a user's manual and a basic toolkit. Local artisans can be trained to help with maintenance and repair of wheelchairs.

The need for follow-up of wheelchair users and an understanding of their home context and possibility for social and economic integration is paramount, and greater emphasis should be placed on service providers advocating for independent home accessibility for wheelchair users (Scovil et al. 2012. Providers can also engage existing community networks to aid in follow-up of wheelchair users.

Prevention of falls during wheelchair use can be promoted through use of durable chairs with the appropriate weight balance (Toro et al. 2016), fall-avoidance training (Kirby et al. 2016b) and advocacy to change the physical environment to be more manageable to independent wheeled mobility. Self-advocacy training should be added as an element of the WHO service package so that empowered wheelchair users can demand better quality services from service providers, and WHO managers training should be taken up by service managers.

Regarding ADLs, the access to safe water and sanitation affects all persons with special considerations for wheelchair users in less resourced settings (Scovil et al. 2012). WHO should add a service element of counselling in which providers' explore access to safe water and use of sanitation facilities as an element of activities of daily living.

In the policy domain, governments should establish an evidence-based minimum service package to be delivered along with wheelchairs. Wheelchairs produced locally and imports should be regulated to ensure that all wheelchairs meet specifications for less resourced areas. Providers should consider the costs of wheelchair services when budgeting and should explore public-private partnerships to strengthen the delivery of wheelchairs compliant with standards from the International Standards Organisation.

Tax relief should be enacted to make a wider range of wheelchairs more affordable. Governments should enforce current laws compelling public buildings and transport systems to be accessible to people with disabilities.

Because follow-up with wheelchair users has been largely overlooked, several approaches may be considered: enabling wheelchair provider-initiated contact by embracing eHealth and telemedicine and engaging with community health workers. It may be useful to set up a telephone hotline for wheelchair users. In Romania, a toll-free telephone hotline provides information and referrals to callers on appropriate wheelchairs and services (personal communication between Fundatia Motivation România staff and first author, 07 June 2016).

Providers can make efforts to fit every wheelchair user while the user is propelling the wheelchair. When a user is unable to propel, this may suggest difficulties with unassisted mobility and ADL performance in this wheelchair in the long run. Providers can discuss with clients who request or need at-home services and discuss maintenance and repair with clients. The availability of appropriate wheelchairs and spare parts is imperative at the national level.

Recommendations for future research

It is recommended for wheelchair service organisations or contracted evaluators to collect contact information from all persons in need of wheelchairs, those who receive wheelchairs and services and their support persons and to keep this information secure and confidential. With additional contact information, service organisations can follow-up with wheelchair recipients over years to ascertain outcomes of wheelchair use and satisfaction, health and well-being, and mortality (Scovil et al. 2012). A long-term study of wheelchair users' service exposure and outcomes may need to be achieved through funding mechanisms that fall outside that of a typical international development grant period (USAID 2014).

Future population-based surveys of persons with disability should use validated functional measures and plan to further validate scales in the local context, as done by Toro et al. (2016) in Indonesia. The Spinal Cord Independence Measure may be a useful instrument (Anderson et al. 2008) for persons with spinal cord injury. The Wheelchair Skills Test Questionnaire (Kirby et al. 2016b) allows for measurement of wheelchair skills capacity, performance and confidence. Use of Craig Handicap Assessment Recording Technique Short Form (CHART-SF) will allow for measurement of outcomes in multiple domains (Whiteneck et al. 1992).

Wheelchair use outcomes and ADL could be measured by additional means, such as user diaries about the use of different wheelchairs for different activities. Medical records or visits by a study nurse to study participants could help validate reports of adverse health outcomes. Wheelchair use could be measured by accelerometers or global positioning system for measurement of distance travelled or outdoor mobility (Sonenblum et al. 2012). Furthermore, observations by trained observers would provide additional information to understand outcomes (Rispin & Wee 2014).

Kenyan wheelchair stakeholders recommended that future research should incorporate questions targeting wheelchair users in national surveys. Kenyan wheelchair stakeholders would like a study to examine the impact of service receipt on children who use wheelchairs and the costs and affordability of chairs. In addition, questions on wheelchair users can be incorporated into existing standard reporting tools used by community health volunteers of the Ministry of Health. Stakeholders in the Philippines recommended creating a central repository data from various studies involving wheelchair users. It was emphasised that wheelchair users be involved in all phases of research. It is important to evaluate service delivery models as done by Toro et al. (2016).

 

Conclusion

In a two-country survey of over 800 adult basic wheelchair users, select services that were associated with some better wheelchair use outputs and outcomes should be emphasised in service delivery. Specifically, assessing the fit of the wheelchair while the user propelled the chair and training in wheelchair use are services associated with positive wheelchair use outcomes. Serious falls may be an unintended consequence of increased mobility. Efforts to provide wheelchairs and services need to include plans for wheelchair maintenance and repair and follow-up with wheelchair recipients.

 

Acknowledgements

The authors would like to thank Jhpiego staff Deepti Tanuku, Accelovate Director, and staff in Kenya and the Philippines, including Dr Bernabe Marinduque. The authors are grateful to the Institute for Health Policy and Development Studies, University of Philippines Manila, for leading the Philippines data collection and to the surveyors in both countries. This research would not have been possible without the many devoted representatives of organisations in Kenya and of local government units and barangays in the Philippines who helped the authors reach the wheelchair users. Finally, the authors express their gratitude to the more than 800 wheelchair users who were participants in this study, as well as the caregivers who supported their participation. The authors thank Mr Peter Mbuguah for advice on study location and comments on the article.

This study was made possible through the generous support of the American people through the US Agency for International Development (USAID), under the terms of the Technologies for Health award AID-OAA-A-11-00050. The contents are the responsibility of the authors and do not necessarily reflect the views of USAID or the US Government. The research was carried out by Jhpiego's Accelovate programme, whose goal is increasing the availability and use of life-saving innovations for low-resource settings. The funder was involved by receiving monthly updates from the research team, offering guidance and global knowledge of wheelchair service programmes and approving yearly work plans. The funder was not involved in data collection, analysis, interpretation or writing of the study report or the manuscript.

Competing interests

The authors declare that they have no financial or personal relationships that may have inappropriately influenced them in writing this article.

Authors' contributions

E.S.B. was the principal investigator of the study and was involved in all phases of the research from inception, led the analysis and was lead writer of this article. E.J.H.H. was involved in all phases of research from inception, participating in the study design, the oversight of data collection teams and the interpretation of findings. B.N.O. participated in all phases of the study from the study design, coordination of the study in Kenya, interpretation of findings and helped draft the manuscript. E.K.W. participated in the study design and implementation and helped draft the manuscript. J.H.N participated in all phases of the study from inception, study design and interpretation of findings. C.A.X. was the technical coordinator for the study in the Philippines and participated in the acquisition of data, analysis, interpretation and dissemination of findings to stakeholders.

F.D.S.G. helped in the acquisition of data and participated in the analysis and interpretation of the data. A.G. was responsible for achieving project objectives in Kenya including overall direction, including oversight over local dissemination of the results to stakeholders and contributed intellectual inputs to the manuscript. M.G. provided input on the policy implications of the research findings and added inputs to the manuscript. P.M. participated in the research consultative meeting and provided inputs on the policy implications of the research findings. R.L.K. participated in the study design, the interpretation of the findings and the drafting of the manuscript. All authors read and approved the final manuscript.

 

References

Accelovate, 2015, Wheelchair use and services in Kenya and Philippines: A cross-sectional study. Accelovate Final Report. Jhpiego, Baltimore, MD, viewed 19 April 2017, from http://reprolineplus.org/system/files/resources/wheelchair-study-report-2015Dec.pdf

Anderson, K., Aito, S., Atkins, M., Biering-Sørensen, F., Charlifue, S., Curt, A. et al., 2008, 'Functional recovery measures for spinal cord injury: An evidence-based review for clinical practice and research', Journal of Spinal Cord Medicine 31(2), 133-144. https://doi.org/10.1080/10790268.2008.11760704        [ Links ]

Andrich, R., Ferrario, M., Wessels, R., Witte, L., Persson, J., Oberg, B. et al., 1998, Assessing outcomes of assistive technology products and services: The EATS instruments, SIVA, Milan, viewed 19 April 2017, from http://www.siva.it/ftp/eats_deliverable3.pdf

Berg, K., Hines, M. & Allen, S., 2002, 'Wheelchair users at home: Few home modifications and many injurious falls', American Journal of Public Health 92, 48. https://doi.org/10.2105/AJPH.92.1.48        [ Links ]

Best, K.L., Kirby, R.L., Smith, C. & MacLeod, D.A., 2005, 'Wheelchair skills training for community-based manual wheelchair users: A randomized controlled trial', Archives of Physical Medicine and Rehabilitation 8, 2316-2323. https://doi.org/10.1016/j.apmr.2005.07.300        [ Links ]

Best, K.L., Miller, W.C., Huston, G., Routhier, F. & Eng, J.J., 2016, 'Pilot study of a peer-led wheelchair training program to improve self-efficacy using a manual wheelchair: A randomized controlled trial', Archives of Physical Medicine and Rehabilitation 97, 37-44. https://doi.org/10.1016/j.apmr.2015.08.425        [ Links ]

Borg, J., Larsson, S., Östergren, P.-O., Rahman, A.A., Bari, N. & Khan, A.N., 2012, 'User involvement in service delivery predicts outcomes of assistive technology use: A cross-sectional study in Bangladesh', BMC Health Services Research 12, 330. https://doi.org/10.1186/1472-6963-12-330        [ Links ]

Brunette, W., Sundt, M., Dell, N., Chaudhri, R., Breit, N. & Borriello G., 2013, 'Open data kit 2.0: Expanding and refining information services for developing regions', in HotMobile, Proceedings of the 14th workshop on mobile computing systems and applications, article no. 10, New York, viewed 19 April 2017, from http://dl.acm.org/citation.cfm?id=2444790

Bryce, J., Victora, C.G., Boerma, T., Peters, D.H. & Black, R.E., 2011, 'Evaluating the scale-up for maternal and child survival: A common framework', International Health 3(3), 139-146. https://doi.org/10.1016/j.inhe.2011.04.003        [ Links ]

Calder, C.J. & Kirby, R.L., 1990, 'Fatal wheelchair-related accidents in the USA', American Journal of Physical Medicine & Rehabilitation 69, 184-190. https://doi.org/10.1097/00002060-199008000-00003        [ Links ]

Gaal, R.P., Rebholtz, N., Hotchkiss, R.D. & Pfaelzer, P.F., 1997, 'Wheelchair rider injuries: Causes and consequences for wheelchair design and selection', Journal of Rehabilitation Research and Development 34, 58-71.         [ Links ]

Greer, N., Brasure, M. & Wilt, T.J., 2012, 'Wheeled mobility (wheelchair) service delivery: Scope of the evidence', Annals of Internal Medicine 156, 141-146. https://doi.org/10.7326/0003-4819-156-2-201201170-00010        [ Links ]

Harris, F. & Sprigle, S., 2008, 'Outcomes measurement of a wheelchair intervention', Disability and Rehabilitation: Assistive Technology 3(4), 171-180. https://doi.org/10.1080/17483100701869784        [ Links ]

Kenya National Bureau of Statistics (KNBS) & ICF Macro, 2010, Kenya demographic and health survey 2008-09, KNBS and ICF Macro, Calverton, MD, viewed 19 April 2017, from http://dhsprogram.com/pubs/pdf/fr229/fr229.pdf

Kirby, R.L., Ackroyd-Stolarz, S.A., Brown, M.G. & Kirkland, S.A., 1994, 'Wheelchair-related accidents caused by tips and falls among non institutionalized users of manually propelled wheelchairs in Nova Scotia', American Journal of Physical Medicine & Rehabilitation 73, 319-330. https://doi.org/10.1097/00002060-199409000-00004        [ Links ]

Kirby, R.L., Mitchell, D., Sabharwal, S., McCranie, M. & Nelson, A.L., 2016a, 'Manual wheelchair skills training for community-dwelling veterans with spinal cord injury: A randomized controlled trial', PLoS One 11(12), e0168330. https://doi.org/10.1371/journal.pone.0168330        [ Links ]

Kirby, R.L., Smith, C., Parker, K., McAllister, M., Boyce, J., Rushton, P.W. et al., 2016b, The wheelchair skills program manual, published electronically at Dalhousie University, Halifax, Nova Scotia, viewed 27 May 2016, from http://www.wheelchairskillsprogram.ca/eng/manual.php/

MacPhee, A.H., Kirby, R.L., Coolen, A.L., Smith, C., MacLeod, D.A. & Dupuis, D.J., 2004, 'Wheelchair skills training program: A randomized clinical trial on wheelchair users undergoing initial rehabilitation', Archives of Physical Medicine and Rehabilitation 85, 41-50. https://doi.org/10.1016/S0003-9993(03)00364-2        [ Links ]

Mukherjee, G. & Samanta, A., 2005, 'Wheelchair charity: A useless benevolence in community-based rehabilitation', Disability and Rehabilitation 27(10), 591-596. https://doi.org/10.1080/09638280400018387        [ Links ]

IBM Corporation, 2011, IBM SPSS Statistics for Windows [computer software], version 20.0, IBM Corporation, Armonk, NY.

Nelson, A.L., Groer, S., Palacios, P., Mitchell, D., Sabharwal, S., Kirby, R.L. et al., 2010, 'Wheelchair-related falls in veterans with spinal cord injury residing in the community: A prospective cohort study', Archives of Physical Medicine and Rehabilitation 91, 1166-1173. https://doi.org/10.1016/j.apmr.2010.05.008        [ Links ]

Ozturk, A. & Ucsular, F.D., 2011, 'Effectiveness of a wheelchair skills training programme for community-living users of manual wheelchairs in Turkey: A randomized controlled trial', Clinical Rehabilitation 25, 416-424. https://doi.org/10.1177/0269215510386979        [ Links ]

Peel, C., Sawyer Baker, P., Roth, D.L, Brown, C.J., Bodner, E.V., Allman, R.M., 2005, 'Assessing mobility in older adults: The UAB Study of Aging Life-Space Assessment', Physical Therapy 85, 1008-1019.         [ Links ]

Rispin, K. & Wee, J., 2014, 'Comparison between performances of three types of manual wheelchairs often distributed in low-resource settings', Disability Rehabilitation Assistive Technology 10(4), 316-322. https://doi.org/10.3109/17483107.2014.1002541        [ Links ]

Rogers, W.H., 1993, 'Regression standard errors in clustered samples', Stata Technical Bulletin 13, 19-23. Reprinted in Stata Technical Bulletin Reprints 3, 88-94.         [ Links ]

Routhier, F., Kirby, R.L., Demers, L., Depa, M. & Thompson, K., 2012, 'Efficacy and retention of the French-Canadian version of the wheelchair skills training program for manual wheelchair users: A randomized controlled trial', Archives of Physical Medicine and Rehabilitation 93(6), 940-948. https://doi.org/10.1016/j.apmr.2012.01.017        [ Links ]

Routhier, F., Vincent, C., Desrosiers, J. & Nadeau, S., 2003, 'Mobility of wheelchair users: A proposed performance assessment framework', Disability and Rehabilitation 25(1), 19-34. https://doi.org/10.1080/dre.25.1.19.34        [ Links ]

Rushton, P.W., Miller, W.C., Kirby, R.L. & Eng, J.J., 2013, 'Measure for the assessment of confidence with manual wheelchair use (WheelCon-M) Version 2.1: Reliability and validity', Journal of Rehabilitation Medicine 45, 61-67. https://doi.org/10.2340/16501977-1069        [ Links ]

Scovil, C.Y., Ranabhat, M.K., Craighead, I.B. & Wee, J., 2012, 'Follow-up study of spinal cord injured patients after discharge from inpatient rehabilitation in Nepal in 2007', Spinal Cord 50, 232-237. https://doi.org/10.1038/sc.2011.119        [ Links ]

Sonenblum, S.E., Sprigle, S., Caspall, J. & Lopez, R., 2012, 'Validation of an accelerometer-based method to measure the use of manual wheelchairs', Medical Engineering & Physics 34, 781-786. https://doi.org/10.1016/j.medengphy.2012.05.009        [ Links ]

StataCorp, 2013, Stata Statistical Software: Release 13 [computer software], StataCorp LP, College Station, TX.

Tanudtanud-Xavier, C.A., 2013, An analysis of the situation of mobility device provision in the Philippines, unpublished report.

Toro, M.L., Eke, C. & Pearlman, J., 2016, 'The impact of the World Health Organization 8-steps in wheelchair service provision in wheelchair users in a less resourced setting: A cohort study in Indonesia', BMC Health Services Research 16, 26. https://doi.org/10.1186/s12913-016-1268-y        [ Links ]

Tu, C.-J., Liu, L., Wang, W., Du, H.-P., Wang, Y.-M., Xu, Y.-B., et al., 2017. Effectiveness and safety of wheelchair skills training program in improving the wheelchair skills capacity: a systematic review. Clin Rehabil. Doi : 10.1177/0269215517712043.

United States Agency for International Development, 2014, USAID Scientific Research Policy, Washington, DC, viewed 16 September 2016, from https://www.usaid.gov/policy/scientific-research

Whiteneck, G., Brooks, C.A., Charlifue, S., Gerhart, K.A., Mellick, D., Overholser, D. et al., 1992, Guide for use of the CHART: Craig handicap assessment and reporting technique, Craig Hospital, Englewood.

Williams, E., Hurwitz E.H., Obaga I., Onguti B., Sy, T.R., Rivera, A. et al., 2016, Understanding wheelchairs users' perspectives on wheelchair services in Kenya and Philippines: Implication for increasing access, unpublished manuscript, submitted in September 2016.

World Health Organization (WHO), 2008, Guidelines on the provision of manual wheelchairs in less resourced settings, World Health Organization, Geneva, viewed 27 May 2016, from http://www.who.int/disabilities/publications/technology/wheelchairguidelines/en

Worobey, L., Kirby, R.L., Heinemann, A., Krobot, E., Dyson-Hudson, T., Cowan, R. et al., 2016, 'Effectiveness of group wheelchair skills training for people with spinal cord injury: A randomized control trial', Archives of Physical Medicine and Rehabilitation 97(10), 1777-1784. https://doi.org/10.10.1016/j.apmr.2016.04.006        [ Links ]

Worobey, L., Oyster, M., Nemunaitis, G., Cooper, R. & Boninger, M.L., 2012, 'Increases in wheelchair breakdowns, repairs, and adverse consequences for people with traumatic spinal cord injury', American Journal of Physical Medicine & Rehabilitation 91, 463-469. https://doi.org/10.1097/PHM.0b013e31825ab5ec        [ Links ]

Xiang, H., Chany, A.-M. & Smith, G.A., 2006, 'Wheelchair related injuries treated in US emergency departments', Injury Prevention 12, 8-11. https://doi.org/10.1136/ip.2005.010033        [ Links ]

Zongjie, Y., Hong, D., Zhongxin, X. & Hui, X., 2007, 'A research study into the requirements of disabled residents for rehabilitation services in Beijing', Disability and Rehabilitation 29(10), 825-833. https://doi.org/10.1080/09638280600919657        [ Links ]

 

 

Correspondence:
Eva Bazant
Eva.Bazant@jhpiego.org

Received: 22 Sep. 2016
Accepted: 03 Apr. 2017
Published: 20 Oct. 2017

 

 

Appendix 1

 


Table 1 -A1 - Click to enlarge

 

 


Figure 1-A1 - Click to enlarge

 

 

 

 

Creative Commons License All the contents of this journal, except where otherwise noted, is licensed under a Creative Commons Attribution License