ORIGINAL RESEARCH

 

Discriminatory validity of the Aspects of Wheelchair Mobility Test as demonstrated by a comparison of four wheelchair types designed for use in low-resource areas

 

 

Karen L. Rispin^I; Elisa Hamm^II; Joy Wee^III

^IDepartment of Biology, Tourneau University, United States
^IIKinesiology Department, LeTourneau University, United States
^IIISchool of Rehabilitation Therapy, Queens University, Canada

Correspondence

 

 

---

ABSTRACT

BACKGROUND: Comparative effectiveness research on wheelchairs available in low-resource areas is needed to enable effective use of limited funds. Mobility on commonly encountered rolling environments is a key aspect of function. High variation in capacity among wheelchair users can mask changes in mobility because of wheelchair design. A repeated measures protocol in which the participants use one type of wheelchair and then another minimises the impact of individual variation.
OBJECTIVES: The Aspects of Wheelchair Mobility Test (AWMT) was designed to be used in repeated measures studies in low-resource areas. It measures the impact of different wheelchair types on physical performance in commonly encountered rolling environments and provides an opportunity for qualitative and quantitative participant response. This study sought to confirm the ability of the AWMT to discern differences in mobility because of wheelchair design.
METHOD: Participants were wheelchair users at a boarding school for students with disabilities in a low-resource area. Each participant completed timed tests on measured tracks on rough and smooth surfaces, in tight spaces and over curbs. Four types of wheelchairs designed for use in low-resource areas were included.
RESULTS: The protocol demonstrated the ability to discriminate changes in mobility of individuals because of wheelchair type.
CONCLUSION: Comparative effectiveness studies with this protocol can enable beneficial change. This is illustrated by design alterations by wheelchair manufacturers in response to results.

---

 

 

Introduction

Research directly comparing different health-related interventions is essential to confirm that the goals of those interventions are achieved (Horn & Gassaway 2007; Jutai et al. 2005). Comparative effectiveness research for wheelchairs intended for use in resource-limited environments is needed (Borg & Khasnabis 2008; WHO 2011).

The ability to move over different surfaces encountered in daily routine is a key aspect of wheelchair effectiveness (Kirby 2011; Mortenson, Miller & Auger 2008). Wheelchair users and family members have often placed highest priority on mobility and the psychosocial benefits that result from it (Hosseini et al. 2012). In fact, wheelchairs are provided specifically to those people who are unable to get around in their daily environment effectively by walking. Therefore, comparative effectiveness studies on the mobility facilitated by different wheelchair types on commonly encountered rolling environments are needed (American Medical Association 1994; Borg & Khasnabis 2008; Matter et al. 2016).

Wheelchairs intended for use in low-resource areas should enable good mobility on commonly encountered rolling surfaces. Wheelchairs designed for use in the United States and Europe may not provide adequate mobility because of the differences in the environments of daily life. In developed areas, populations spend more time indoors on smooth surfaces than they typically do in low-resource areas; therefore there is more need for rough terrain wheelchairs for low-resource areas (Winter et al. 2010). Ramps and wheelchair friendly public transportation are also more likely to be available in wealthier regions (Borg, Lindström & Larsson 2011b). In contrast, wheelchair users in low-resource areas often spend considerable time outdoors where they and their wheelchairs encounter rough terrain, and where public transportation is difficult (Blanford et al. 2012; Borg et al. 2011b; Monk & Wee 2008; Sietchiping, Permezel & Ngomsi 2012). In low-resource areas, living spaces such as houses and schools may be small and sometimes crowded; therefore, the ability to move a wheelchair through tight spaces is also crucial; building codes may not require ramps and other modifications that make wheelchair access easy; thus, coping with curbs is necessary (Borg et al. 2011b; Matter et al. 2016). The environment is so different at some locations that donated wheelchairs from more developed settings have been found to be nearly useless (Mukherjee & Samanta 2005). Wheelchair centre of gravity, caster and wheel sizes, wheelbase length and other design characteristics may impact the ease of movement in different rolling environments quite differently (Cowan et al. 2009). Characteristics of casters and tires including the quality, texture, firmness and condition of the bearings and wheels also impact ease of rolling (Frank & Abel 1989; Kauzlarich & Thacker 1985; VanderWiel et al. 2016).

Organisations manufacturing and providing wheelchairs for low-resource areas face tight financial constraints that are addressed by different organisations in different ways (USAID/WHO 2012). Often, wheelchair availability in low-resource areas may limit the ability of therapists to ideally fit wheelchair users. For example, active users may be put into a range of more or less ideally appropriate wheelchairs depending on what is available (Gartz et al. 2016). The type of wheelchair provided often simply depends on which type is available when one is needed. Studies carried out in the environments where the wheelchairs are used are essential to provide feedback to maximise effective use of limited funds (Jutai et al. 2005).

One of the challenges of comparative studies is the great variation in capability among wheelchair users (Hoenig, Giacobbi & Levy 2007; May 1997; Mortenson et al. 2008). Variations among wheelchair users in skill and capability level can mask the negative impact of a poor wheelchair design. Unless a protocol is used in a repeated measures study design in which the user completes a test in one wheelchair and then another, the impact of wheelchair design on mobility may not be apparent (Hoenig et al. 2015; Mortenson et al. 2008; Rispin & Wee 2015). This type of repeated measures study protocol minimises the effect of individual variation because a participant is compared only with himself or herself (Coutinho, Neto & Beraldo 2014; Neto, Coutinho & Beraldo 2014; Walpole et al. 2006).

Even in a repeated measures protocol, a strongly skilled wheelchair user may be able to roll in most environments in almost any wheelchair; therefore, the ability to discern the effect of different wheelchair designs requires high discriminatory validity. Study design impacts discriminatory validity in several ways. Objectively measured data such as velocity may be considerably lower in one chair type than another when rolling on rough ground, but a study design which only uses a limited categorical response or completion score would indicate the task was completed successfully in both chairs. Objectively measured physical performance data such as velocity and heart rate also minimise variation because of raters' perceptive frames (May 1997). In addition, unlike categorical data, objectively measured data is often suitable for powerful parametric statistical tools such as analysis of variance (ANOVA) (May 1997; Walpole et al. 2006). The length of a timed test impacts discriminatory power with longer tests amplifying differences in velocity (Kosak & Smith 2005). Longer timed roll tests are also more likely than shorter tests to discern differences. A change in the ease of rolling which impacts energy cost is more evident as participants move into aerobic exercise about 2 min into a test (Berne et al. 2004; Kosak & Smith 2005).

Direct questionnaire feedback from wheelchair users provides insights on capability and mobility not available any other way (Neale & Strang 2015; Reeve et al. 2013). Questionnaire design can enhance or reduce the ability to discriminate differences (May 1997; Reips & Funke 2008). Visual analogue scale (VAS) question format produces continuous data which has been considered suitable for parametric statistical analysis (Philip 1990; Walpole et al. 2006). Qualitative comments directly provide the wheelchair user's understanding of the reasons for ease or difficulty (Neale & Strang 2015). Discriminatory validity is enhanced by a mixed methods protocol which includes qualitative data, allowing wider scope of understanding and triangulation (Fielding 2012). The Quebec User Evaluation of Satisfaction with Assistive Technology obtains user feedback on their satisfaction with any assistive device (Demers et al. 2002). It can and has been used in comparative effectiveness studies assessing user satisfaction with assistive technology (Deems-Dluhy et al. 2016; Sadiya, Pattnaik & Mohanty 2016). However, it is not a physical performance measure and does not supply information specific to wheelchair mobility.

Questionnaires aimed at assessing individual capability and physical performance include Functional Independence Measure and the Barthel Index (Kumar et al. 2013; Ottenbacher et al. 1996; Wade & Collin 1988). Wheelchair-specific questionnaires include the Wheelchair Skills Test Questionnaire and Functioning Every Day in a Wheelchair questionnaire (Kirby et al. 2004; Mills et al. 2002).

Directly measured or observed physical performance measures intended to assess a wheelchair user's capabilities are often called skills tests (Kirby 2011; Oyster et al. 2012). They include the Wheelchair Skills Test, the Wheelchair Propulsion Test, the Wheelchair Users Functional Assessment, the Wheelchair Circuit, the Obstacle Course Assessment of Wheelchair User Performance and the Wheelchair Physical Functional Performance (Askari et al. 2013; Cress et al. 2002; Fliess-Douer et al. 2010; Kirby et al. 2004; Mortenson, Miller & Miller-Pogar 2007; Routhier et al. 2004; Rushton et al. 2013; Stanley et al. 2003). The above measures are not primarily designed for use in repeated measures studies assessing differences in mobility because of wheelchair design. In spite of its focus on the evaluation of individual wheelchair user's skills and capacity, the Wheelchair Skills Test has been used in studies comparing design changes in tilt in space and anti-tip devices. In the tilt in space study, the Quebec User Evaluation of Satisfaction with Assistive Technology and a VAS question regarding perceived exertion were also completed (Kirby et al. 2008a, 2008b).

Objective quantitative data on mobility have also been obtained in laboratory settings (Askari et al. 2013; Coutinho et al. 2014; Cowan et al. 2008; Cress et al. 2002; Neto et al. 2014; Yang et al. 2006). However, a laboratory setting does not perfectly mimic the conditions of daily use. It is important that effectiveness studies are also done in the environment where wheelchairs are used (Jutai et al. 2005; Toro et al. 2012; WHO 2015).

The Aspects of Wheelchair Mobility Protocol (AWMP) was developed to be used in low-resource areas in a repeated measures format to discern differences in mobility because of wheelchair design (Rispin & Wee 2015). There is a tension between every rolling environment that may be of interest, and keeping a protocol short, simple and usable. Because smooth and rough surfaces, tight spaces and low curbs are commonly encountered, and because each interacts somewhat differently with the wheelchair design, these surfaces were included in the AWMP (Rispin & Wee 2015). Face validity is the logical subjective expectation that a protocol will test its target construct (Jerosch-Herold 2005). To that end, mobility was directly measured using timed roll tests similar to the long validated timed walk test protocols (Enright 2003; Rispin & Wee 2015).

Methods were selected with the intention that quantitative data would be continuous and suitable for powerful parametric statistical tools such as ANOVA (Rispin & Wee 2015; Walpole et al. 2006). Performance tests were of sufficient duration to include the transition to aerobic respiration (Neto et al. 2014; Rispin & Wee 2015). Visual analogue scale responses and comments were solicited from participants, and exercise and resting heart rate were monitored using research grade heart rate monitors (Crapo et al. 2002; Rispin & Wee 2015). The format of the participant response questions in AWMP was based on that used in the Lower Limb Function Questionnaire. This format was selected because VAS format is very likely to provide data suitable for parametric statistical analysis tools, and because each question includes an opportunity to write a comment providing qualitative explanatory information (Funk et al. 2016).

Measurements of heart rate or oxygen consumption provide continuous objective data on the energy cost of movement (Coutinho et al. 2014; Neto et al. 2014). In earlier iterations of the AWMP, the physiological cost index (PCI) was calculated rather than directly comparing exercise heart rate (Rispin & Wee 2015). Slowing down when encountering difficulty or awkwardness is the strategy that has enabled timed walk tests to be validated by measuring difficulty in ambulation (Holland et al. 2014). However, slowing down is not the only response to a greater difficulty in moving. Continuing at the same pace and spending, more energy per unit time is the strategy of dealing with difficulty that underlies monitoring heart rate and oxygen consumption per unit time as a measure of difficulty of movement (Conger & Bassett 2011). PCI calculation includes velocity, and thus includes both strategies of dealing with difficulty; however, this makes it difficult to tell which strategy is most commonly used (Ijzerman & Nene 2002). Circadian rhythm, the cost of digestion, body temperature and other factors have a larger proportional impact on non-exercise heart rate than on exercise heart rate. Because PCI calculation includes non-exercise heart rate, these factors would likely impact PCI more than they would do the direct measurement of exercise heart rate (Berne et al. 2004).

The objective of this study was to obtain data that sheds light on the mobility provided by wheelchairs designed for low-resource areas as they roll on surfaces and in situations commonly encountered there. Our hypothesis was that an updated version of the AWMP which used exercise heart rate instead of PCI would have the discriminatory validity to provide comparative effectiveness data on four types of wheelchairs commonly provided to wheelchair users with strong upper bodies at our study site. Specifically, we hypothesised that ANOVA results for velocity, heart rate and participant response VAS scores would indicate significant differences between wheelchair types. Participant comments would shed light on the perceived reasons for ease or difficulty. Meaningful discriminatory validity would be confirmed by results which would enable wheelchair manufacturers to make responsive changes.

 

Methods

Study site

This study was conducted in partnership with an organisation that provides rehabilitation to students at a boarding school for students with disabilities in Kenya. The location included a primary and secondary school, and participants were drawn from both. Because students with disabilities in Kenya are often not able to attend local schools, some had begun school at an older age. This resulted in a wide age range in study participants. Wheelchair users at the site regularly traverse paved and unpaved areas, curbs and tight spaces.

Participants

A convenience sample of participants was recruited from wheelchair using students. Local therapists identified students of appropriate size and disability to use the study wheelchairs safely, and who had the ability to self-propel a manual wheelchair without stress on unpaved surfaces. The second criterion was added with the presupposition that strong wheelchair users would provide more complete data sets for all tracks, and would therefore increase the statistical power of ANOVA analysis across tracks and wheelchairs. Participation was voluntary, and participants could withdraw at any time or choose not to complete any task.

Wheelchairs tested

The study utilised four wheelchair types intended for provision in low-resource areas. All four types were commonly provided to wheelchair users with strong upper bodies at our study site, and were available at our study site. They included the Free Wheelchair Mission Generation 2 (FG2) manufactured by Free Wheelchair Mission (Free Wheelchair Mission), the Hope Haven KidChair (HKC) manufactured by Hope Haven (Hope Haven International), the Whirlwind RoughRider (WRR) manufactured by Whirlwind (Whirlwind) and the Motivation Rough Terrain (MRT) wheelchair manufactured by Motivation (Motivation, 2011). Additional information on characteristics of the wheelchair types such as dimensions, weight and so on is available through the manufactures whose websites are cited above. Because AWMP is intended to provide real-world comparative effectiveness data, the wheelchairs were set up in the configuration most commonly used for active wheelchair users at our study site. Photos of the four wheelchairs in the configurations used in this study are given in Figure 1. The width of the seat of the wheelchairs used in this study was the option closest to 33 cm for all chair types. This was chosen because this width was suitable to a large group of wheelchair users at our study site.

 

 

This study was part of a long-term study focused on FG2 and HKC wheelchairs. Broader comparison with other wheelchair options for active users at our study site was desired; therefore, MRT and WRR were also included. However, there was no sufficient time to compare all four wheelchairs on all tracks; therefore, only the curb track, the most challenging, was chosen for use with all four wheelchairs.

Testing protocol

On arriving at the study location, researchers looked for areas appropriate to set up measured tracks incorporating rough, smooth, tight spaces and curbs. For each of the four rolling environments, a looped track was set up and measured using a survey wheel. Rough and smooth tracks were to be of 6 min duration similar to the 6 min timed walk test. Curb and tight tracks were of 3 min duration because of greater difficulty of the curb track and repeated turns on the tight track. Curb and rough rolling environments were included partly to prevent a ceiling effect. HKC and FG2 wheelchairs were used on the tight, rough and smooth surface tracks. All four wheelchair types were used on the curb track to provide a broader comparison for wheelchair function on that track.

Each participant was asked to attempt to complete each track in each wheelchair utilised on that track. A low discrepancy shifting pattern of wheelchairs and rolling environments was used to avoid skewing of results by the order of testing. If the study wheelchair was not their own wheelchair type, participants were given a few minutes to accommodate to the wheelchair before testing began. To avoid fatigue, data collection for different wheelchairs was done on different days, and participants were pushed between track locations. Distance travelled was measured by counting the number of times the loop was completed, and using a survey wheel to measure the length of the final incomplete loop. Velocity was calculated by dividing distance travelled by test time. After each track, participants were asked to rate the ease or difficulty of movement on a 10-cm VAS and to provide a qualitative explanatory comment (see Figure 2 for question format). Participants wore PolarPro 800 heart rate monitors and watches. Non-exercise heart rate was taken while the participants sat quietly for 5 min before testing began. Each subsequent test was started only when a participant's heart rate had returned to their initial non-exercise heart rate. Heart rate monitor data were downloaded to a computer, the time period after the first 2 min of each test was selected and the mean heart rate for that time period was calculated.

 

 

Analysis

MiniTab statistical analysis program was utilised for the Anderson-Darling test for normality, and repeated measures ANOVA with Tukey's simultaneous comparison of means. If a proportion of participants withdrew from a test on a particular track, a chi-squared analysis of proportions test was calculated. Qualitative comments were coded into categories using an open-ended conventional content analysis method in which the content of the comments guided the formation of categories. The number of comments for each category was counted across wheelchair types and tests.

Ethical consideration

The study protocol was approved by the authors' universities and by the partner organisations. Participants over 18 years of age provided informed written consent. Those under 18 years of age provided informed written assent and their guardians provided informed written consent.

 

Results

Track characteristics

The rough track was 31.2 m in length on an earth and gravel road around a cul-de-sac with a central circular garden. The smooth track was 60.2 m in length on the paved deck around the school's outdoor swimming pool. Outside the dining hall, on a cement surface, there was a square area 1.5 m wide, raised 9 cm above the rest of the surface; the curb track was 10 m in length and traversed the raised area twice. For the tight track, four straight-backed school chairs were set in a row 1 m apart on an indoor cement floor. The 12 m track was a figure eight pattern around the middle two of the four chairs. The length of each track was measured using a survey wheel.

Participants

In total, 30 participants joined the study (age 13.5, SD 3.5, gender 17 male and 13 female). See Table 1 for numbers of participants whose long term wheelchair was one of the types of wheelchairs included in this study, and for diagnoses as provided by our partner organisation.

 

 

 

 

Completion rates

All 30 participants completed the two-way comparison on rough, smooth and tight tracks in HKC and FG2 wheelchairs. On the rough track, heart rate and velocity data for two participants were lost when a researcher's computer crashed. All participants attempted the curb track in all four wheelchair types; however, 18 participants chose not to complete it in HKC, 10 in FG2, 6 in MRT and 5 in WRR. Explanatory comments for those who did not complete indicated difficulty and fatigue.

Results for two-way comparison

On rough, smooth and tight tracks, participants used both the HKC and FG2 wheelchairs. Anderson-Darling analysis indicated that distributions of data for velocity, mean exercise heart rate, and VAS participant response scores were statistically normal and suitable for parametric statistical analysis using ANOVA. Repeated measures ANOVA indicated significant differences in participant velocity (F(1,29) = 61.2, p < 0.001), and VAS scores (F(1,29) = 43.1, p < 0.001). Interaction plots for the ANOVA wheelchair factor showing mean values are given in Figure 3. Comparison of means indicated that the differences were driven by participants' low velocity and low ratings for HKC (Figure 3). Although there were significant differences in exercise heart rate between tracks, there were no significant difference rates between wheelchairs. Of the participants, 40% provided qualitative comments. Comment topics as coded and counted across wheelchairs and tests are provided in Table 2.

 

 

Results for four-way comparison

On the curb track, participants used all four wheelchair types. Chi-squared analysis indicated the proportion of participants able to complete the curb test did not differ between WRR, MRT and FG2 chairs, but was significantly lower for HKC chairs. Repeated measures ANOVA on data from the 12 participants capable of completing the test in all four wheelchair types indicated significant differences between wheelchairs for velocity (F(3,26) = 27.1, p < 0.001), VAS scores (F(3,26) = 5.80, p = 0.003) and exercise heart rate (F(3,26) = 63.26, p = 0.037). Main effects plots showing mean values are given in Figure 4. For all participants who completed a curb test in any of the wheelchairs, comments were coded and counted. Of the participants, 59% provided comments. Comment topics across wheelchairs are given in Table 3.

 

 

Discussion

Discriminatory validity of the AWMP was confirmed through ANOVA analysis which discerned significant differences between wheelchair types for velocity and participant response scores. The numbers and types of comment topics explained ANOVA results and added other qualitative information. Results from this study led to responsive design change confirming the value of the AWMP in providing comparative effectiveness data.

We had decided to use mean exercise heart rate in analysis instead of PCI for two reasons. We wanted to differentiate between two strategies of dealing with increased physiological difficulty, and reduce the effect of other factors that impact basal metabolic rate. Although mean exercise heart rate differentiated between rolling environments, we could see clearly that exercise heart rate, a measure of energy cost per minute, did not significantly differ between wheelchair types on the rough, smooth and tight tracks. If a wheelchair was more difficult to use, participants seemed to simply slow down. The only test for which ANOVA indicated a significant difference in exercise heart rate was the curb track for the 12 strong and skilled participants able to complete this test in all four chair types. This significant difference was because of higher mean heart rate in the WRR chair than in the other types. However, the significantly higher heart rate in WRR did not seem to impact perceived difficulty much, because visual analogue scores for WRR were not significantly different from those of the MRT wheelchair (Figure 2), and score patterns paralleled velocity more closely than heart rate. This seems to indicate that participants' perception of difficulty was more closely related to velocity than heart rate. It would seem that by dropping the use of heart rate monitors from the protocol, we could simplify the AWMP considerably without much loss of discriminatory validity.

Qualitative results

Open-ended qualitative conventional analysis methods resulted in the ability to elucidate explanatory topic categories. The relatively young age of the participants, with a mean age of 13 years, may have been a factor in the fact that fewer than 50% of the completed questions included explanatory comments. There was also no attempt to require that a comment be provided. In future studies, there could be more encouragement to provide explanatory comments. That said, the comments which were provided were helpful in understanding factors behind objective and subjective quantitative data. On the curb track, nine comments regarding the HKC indicated the footplate support framework hit the ground on descent from a curb unless the user was in a wheelie position. The slower velocities and lower completion rates likely reflect the greater difficulty of getting into a wheelie position before descending, a step unnecessary in the other wheelchair types - a finding which encouraged the development of the Bee line wheelchairs. Qualitative comments also resulted in responsive change in design by Free Wheelchair Mission. Participants who commented seemed to mention anything about the wheelchair that bothered them as they moved through the different rolling environments. This may have been something that did not slow them down. Although participants' velocity was higher in FG2 than in HKC, many comments mentioned about the difficulty with the push rims on the FG2 chairs. When counted across all tracks, 12 comments mentioned discomfort from the bars which held push rims to wheel, and six comments mentioned push rims that caused forearms to brush the tire. Free Wheelchair Mission has responded with push rim modifications intended to address both issues.

For tests focused on the assessment of an individual's mobility, four rolling environments may not be needed. Because of the very high individual variation in capability, a shorter test in one rolling environment such as the Wheelchair Propulsion Test differentiates between individuals (Askari et al. 2013). However, the goal of the AWMP is to assess the comparative effectiveness of mobility facilitated by different wheelchair designs. For that purpose, the four rolling environments were needed because design does not interact with each environment in the same way and there are multiple commonly encountered rolling environments.

Although the focus of this article is on the discriminatory ability of the AWMP rather than a direct comparison of the wheelchairs, a brief discussion of the factors which may be behind the evident differences may be of interest. Because the height of an obstacle that stops a wheel rolling is proportional to wheel diameter, and rolling resistance is inversely proportional to wheel size, one might have expected that the MRT chair with the largest wheels and caster would have done better than the other wheelchairs (Mason et al. 2012). However, centre of gravity relative to the axle position is also known to have an impact with a centre of gravity closer to the axle resulting in a lower rolling resistance partly because it offloads the smaller front caster (Lemaire et al. 1991). HKC has an anterior centre of gravity in comparison with the other three wheelchairs. It is interesting that results for velocity and participant response seemed to reflect this difference in centre of gravity more than the difference in wheel or caster size. However, HKC is the only chair of the four which includes options for head, trunk and hip supports; therefore, although it has often been distributed to active users at our study site, this may not be its ideal population. That said, the increase in rolling resistance is also present for pushers of wheelchairs, a factor that is of greater importance in low-resource areas with very little access to power wheelchairs (Sasaki & Rispin 2016).

The repeated measures protocol was key to enabling discriminatory validity in spite of wide variation among participants. The impact of differences because of disability characteristics, strength, gender, general outlook on life and age are minimised in a within subjects repeated measures protocol because each participant is only compared with themselves. For example, on the rough surface track, velocity among participants varied from 20 m/min to 70 m/min. The fastest participants travelled faster than the slowest participants in all chairs. However, repeated measures analysis could discern that there was a consistent pattern in which most participants travelled more slowly when in one wheelchair type. Data collection protocols that produced continuous statistically normal data was also important to discriminatory validity because it enabled ANOVA comparisons across wheelchairs and rolling environments. For example, ANOVA analysis enabled the communication of clear objective results showing that velocity and VAS responses were lower for HKC than the other wheelchair types (Figure 2). This was a key factor in Hope Haven's exploration of other wheelchair design options. This study was completed in 2014. Hope Haven deployed the three wheeled 'Bee-line' wheelchairs in 2016 with the intention of facilitating better mobility in all commonly encountered rolling environments.

 

Limitations and future work

Results of this study are specific to the conditions at our study site. Although it has much in common with other sites in low-resource areas, it is of course unique as are all locations. Tracks would not be identical at other study sites, and data from other study sites could not be directly compared with this study. For example, a rough ground track on an unpaved road at one location would not be exactly like a rough ground track at a different location. A low curb which is available and often encountered at one location might be 8 cm tall, whereas a curb at another location might be 10 cm tall. In studies carried out in North America, standardised rough surfaces have been developed and used (Sasaki & Rispin 2016). However, these standardised rough surfaces are large and not easily transported to field locations in low-resource areas. In addition, they would not perfectly model conditions encountered by wheelchair users. With the AWMP, study design, each participant is compared with themselves in their community location. AWMP could be used in many locations as long as there was no intention of considering the data exactly equivalent to data collected at another location. This flexibility is necessary in real-world research and is of key importance in studies carried out in low-resource areas. The use of letter grades as anchors for the VAS tends to standardise subject response and provide an understandable value to participants, researchers and manufactures (Funk et al. 2016; Rispin et al. 2017). However, the letter grades would need to be modified by whatever grading scale is in use in the culture in which a study is carried out.

Study wheelchairs were in the configuration most often utilised at our study site for those who can self-propel strongly. A broader comparison would have been provided if all four wheelchair types could have been included on all tracks, but this was not possible because of time constraints. Both the MRT and WRR chairs have the ability to be adjusted into less stable configurations with the centre of gravity closer to the rear axle, which, for skilled users, is thought to provide enhanced mobility (Motivation 2011; Whirlwind). Most wheelchairs at our study location had not been changed into this less stable but more energy efficient configuration. Therefore, we set the study WRR and MRT wheelchairs to a more stable configuration. Configurations of the same wheelchairs may routinely be set up differently at other study locations. However, additional studies at other locations are needed.

Results are specific to our study population of school age participants able to self-propel on rough surfaces. This population is not typical of the global population of wheelchair users, especially because obesity and age-related disability is becoming more prevalent in low-resource areas (WHO 2015). Validation is needed for the AWMP for other populations and cultures. However, it does seem likely that a wheelchair which is challenging for strong adolescent users will be even more challenging for older and more disabled users.

Wheelchair users were selected based on their identification by local therapists as having size and disability characteristics appropriate for the study wheelchairs. However, wheelchairs were not finely adjusted to each participant. Wheelchairs were of course not identical, and would have fit different participants somewhat differently. For each individual, this would impact results because appropriate seating is known to impact mobility (Borg, Larsson & Östergren 2011a). In this study, the sample size of 30 participants and the repeated measures format would have reduced the impact of the individual variation, unless the seating system of a wheelchair type was less suitable for most participants. In that case, the results were still likely of interest because the population of users with the types of wheelchairs in our study at our study location had the characteristics of our participant population. Results can be generalised only to the extent that other study sites may resemble our study site.

Wheelchair or user centre of gravity was not measured for each wheelchair and would have shifted somewhat for users of differing individual morphologies and resultant personal centres of gravity. However, body structure of individuals that resulted in a shifted centre of gravity would have remained the same for that individual in all chairs, so the within subjects protocol should have minimised the impact on comparative results.

All wheelchairs except HKC had inflatable tires. Before each data collection session, tire pressure was informally checked by pinching the tire, but was not formally checked using a tire gauge. A tire gradually losing air may not have been noticed and could have impacted results. In future studies, it would be wise to formally check tire pressure before each run.

The weather and other differences between days could have impacted our data. We chose to do each chair type on a different day because we felt that the fatigue which would result from attempting to do multiple wheelchairs on one day would have had a greater impact than any difference because of variations between days.

Accommodation to unfamiliar wheelchair types may also have impacted our data. Participants utilised multiple wheelchair types that included wheelchair types they had never used. A short accommodation period was included in the protocol; however, accommodation may take longer than a few minutes. If accommodation had affected results, FG2 results in this study could have been negatively impacted. A portion of participants were long-term users of each of the types of study wheelchairs. More participants were HKC users than any other chair, and yet all other study chairs outperformed the HKC chair. FG2 had the fewest long-term users.

Future work

The use of research grade heart rate monitor and the ability to download data to a computer to calculate mean exercise heart rate could make the AWMP impractical at many locations. Because heart rate rarely differentiated between wheelchair types, in future studies, the use of exercise heart rate could be eliminated to make AWMP more broadly useful in low-resource areas. Modifications to the duration of the timed tests are also planned. Longer tests enable more sampling time for velocity; however, the added time can tire participants and challenge schedules (Kosak & Smith 2005). Studies indicate that for participants in self-propelling wheelchairs, the aerobic threshold is often considered to be reached 2 min from the initiation of exercise (Coutinho et al. 2014; Neto et al. 2014; Rispin & Wee 2015). Often, the impact of difficulty in propulsion may not be fully felt until a participant has passed this aerobic threshold. Four-minute tests would still include 2 min after this typical aerobic threshold, and should enable sufficient length of test for high discriminatory ability. The use of 4 min timed tracks on all rolling environments would also simplify data collection and analysis. This would allow a standard time across all tests, and would reduce the total time constraint on participants and researchers. Further testing is planned to confirm the benefit of the above changes.

Although face validity for this protocol is high, formal reliability testing and validity testing had not been performed at the time of this study. Test retest reliability and construct validity testing has now been carried out for the updated AWMP and results are presented in a companion study in this journal.

 

Conclusion

The good discriminatory validity of the AWMP enables its use in comparative effectiveness studies that can provide much needed feedback enabling wheelchair manufacturers to optimise wheelchair design. Organisations that design and manufacture wheelchairs intended for use in low-resource settings are almost always not-for-profit and have a strong commitment to meeting the overwhelming global need for wheelchairs. Designs that hinder users' abilities to roll forward on commonly encountered rolling environments limit the positive impact of wheelchair provision. The AWMP can be used in comparative effectiveness studies for other wheelchair types to inform beneficial design change. If AWMP studies are performed with locally available wheelchairs in locations where wheelchair users live, results could enable informed choices for wheelchair provision. Other stakeholders such as granting or charitable agencies providing funding could also benefit from comparative effectiveness data to inform wheelchair selection choices for different locations.

 

Acknowledgements

The authors thank universities, their partner organisations and those who assisted with statistical analysis.

Competing interests

The authors declare that they have no financial or personal relationships that may have inappropriately influenced the writing of this article.

Authors' contributions

K.L.R., Associate Professor at LeTourneau University, leads the Wheels Project www.letu.edu/Wheels. Her contributions were primary conception, study design, important intellectual content, interpretation and analysis of data, revising and redrafting and final approval. E.H., undergraduate student at LeTourneau University, was involved in data collection, data analysis, initial drafting and editing. Dr J.W., member of the Colleges of Physicians and Surgeons of B.C. and Ontario; fellow of Royal College of Physicians and Surgeons of Canada, was involved in study design, intellectual content, drafting, revising critically and editing.

 

References

American Medical Association, 1994, Guidelines for the use of assistive technology: Evaluation referral prescription, AMA, Chicago, IL.

Askari, S., Kirby, R.L., Parker, K., Thompson, K. & O'Neill, J., 2013, 'Wheelchair propulsion test: Development and measurement properties of a new test for manual wheelchair users', Archives of Physical Medicine and Rehabilitation 94, 1690-1698. https://doi.org/10.1016/j.apmr.2013.03.002        [ Links ]

Berne, R., Levy, M., Koeppen, B. & Stanton, B., 2004, Whole body metabolism physiology, 5th edn., Elsevier Health Sciences.

Blanford, J.I., Kumar, S., Luo, W. & MacEachren, A.M., 2012, 'It's a long, long walk: Accessibility to hospitals, maternity and integrated health centers in Niger', International Journal of Health Geographics 11(1), 1-15. https://doi.org/10.1186/1476-072X-11-24        [ Links ]

Borg, J. & Khasnabis, C., 2008, Guidelines on the provision of manual wheelchairs in less-resourced settings, World Health Organization, Geneva.

Borg, J., Larsson, S. & Östergren, P.O., 2011a, 'The right to assistive technology: For whom, for what, and by whom?', Disability & Society 26(2), 151-167. https://doi.org/10.1080/09687599.2011.543862        [ Links ]

Borg, J., Lindström, A. & Larsson, S., 2011b, 'Assistive technology in developing countries: A review from the perspective of the convention on the rights of persons with disabilities', Prosthetics and Orthotics International 35(1), 20-29. https://doi.org/10.1177/0309364610389351        [ Links ]

Conger, S.A. & Bassett, D.R., 2011, 'A compendium of energy costs of physical activities for individuals who use manual wheelchairs', Adapted Physical Activity Quarterly: APAQ 28(4), 310-325. https://doi.org/10.1123/apaq.28.4.310        [ Links ]

Coutinho, A.C., Neto, F. & Beraldo, P.S., 2014, 'Validity of heart rate indexes to assess wheeling efficiency in patients with spinal cord injuries', Spinal Cord 52(9), 677-682. https://doi.org/10.1038/sc.2014.107        [ Links ]

Cowan, R.E., Boninger, M.L., Sawatzky, B.J., Mazoyer, B.D. & Cooper, R.A., 2008, 'Preliminary outcomes of the SmartWheel Users' Group database: A proposed framework for clinicians to objectively evaluate manual wheelchair propulsion', Archives of Physical Medicine and Rehabilitation 89(2), 260-268. https://doi.org/10.1016/j.apmr.2007.08.141        [ Links ]

Cowan, R.E., Nash, M.S., Collinger, J.L., Koontz, A.M. & Boninger, M.L., 2009, 'Impact of surface type, wheelchair weight, and axle position on wheelchair propulsion by novice older adults', Archives of Physical Medicine and Rehabilitation 90(7), 1076-1083. https://doi.org/10.1016/j.apmr.2008.10.034        [ Links ]

Crapo, R.O., Casaburi, R., Coates, A., Enright, P., MacIntyre, N., McKay, R. et al., 2002, 'ATS statement: Guidelines for the six-minute walk test', American Journal of Respiratory and Critical Care Medicine 166(1), 111-117. https://doi.org/10.1164/ajrccm.166.1.at1102        [ Links ]

Cress, M.E., Kinne, S., Patrick, D.L. & Maher, E., 2002, 'Physical functional performance in persons using a manual wheelchair', Journal of Orthopaedic & Sports Physical Therapy 32(3), 104-113. https://doi.org/10.2519/jospt.2002.32.3.104        [ Links ]

Deems-Dluhy, S.L., Jayaraman, C., Green, S., Albert, M.V. & Jayaraman, A., 2016, 'Evaluating the functionality and usability of two novel wheelchair anti-rollback devices for ramp ascent in manual wheelchair users with spinal cord injury', PM & R 9(5), 483-493. https://doi.org/10.1016/j.pmrj.2016.09.007        [ Links ]

Demers, L., Moniette, M., Lapierre, Y., Arnold, D.L. & Wolfson, C., 2002, 'Reliability, validity and applicability of the Quebec User Evaluation of Satisfaction with assistive Technology (QUEST 2.0) for adults with multiple sclerosis', Disability and Rehabilitation 24, 21-30. https://doi.org/10.1080/09638280110066352        [ Links ]

Enright, P., 2003, 'The six-minute walk test', Respiratory Care 48(8), 783-785.         [ Links ]

Fielding, N.G., 2012, 'Triangulation and mixed methods designs data integration with new research technologies', Journal of Mixed Methods Research 6(2), 124-136. https://doi.org/10.1177/1558689812437101        [ Links ]

Fliess-Douer, O., Vanlandewijck, Y.C., Manor, G.L. & Van der Woude, L.H.V., 2010, 'A systematic review of wheelchair skills tests for manual wheelchair users with a spinal cord injury: Towards a standardized outcome measure', Clinical Rehabilitation 24(10), 867-886. https://doi.org/10.1177/0269215510367981        [ Links ]

Frank, T. & Abel, E., 1989, 'Measurement of the turning, rolling and obstacle resistance of wheelchair castor wheels', Journal of Biomedical Engineering 11(6), 462-466. https://doi.org/10.1016/0141-5425(89)90040-X        [ Links ]

Free Wheelchair Mission, viewed January 2016, from http://www.freewheelchairmission.org.

Funk, L., Thiessen, D., Wright, V., Andrysek, J. & Rispin, K., 2016, 'Reliability and validity of the lower limb function questionnaire when completed by young adult orthotic and prosthetic device users', Disability and Rehabilitation: Assistive Technology- 12(3), 262-271.         [ Links ]

Gartz, R., Goldberg, M., Miles, A., Cooper, R., Pearlman, J., Schmeler, M. et al., 2016, 'Development of a contextually appropriate, reliable and valid basic Wheelchair Service Provision Test', Disability and Rehabilitation: Assistive Technology 12(4), 333-340.         [ Links ]

Hoenig, H., Giacobbi, P. & Levy, C.E., 2007, 'Methodological challenges confronting researchers of wheeled mobility aids and other assistive technologies', Disability and Rehabilitation: Assistive Technology 2(3), 159-168. https://doi.org/10.1080/17483100701374405        [ Links ]

Hoenig, H., Morgan, M., Montgomery, C., Landerman, L.R. & Caves, K., 2015, 'One size does not fit all - Mobility device type affects speed, collisions, fatigue, and pain', Archives of Physical Medicine and Rehabilitation 96(3), 489-497. https://doi.org/10.1016/j.apmr.2014.07.420        [ Links ]

Holland, A.E., Spruit, M.A., Troosters, T., Puhan, M.A., Pepin, V., Saey, D. et al., 2014, 'An official European Respiratory Society/American Thoracic Society technical standard: Field walking tests in chronic respiratory disease', European Respiratory Journal 44(6), 1428-1446. https://doi.org/10.1183/09031936.00150314        [ Links ]

Hope Haven International, viewed February 2016, from http://www.hopehaveninternational.org.

Horn, S.D. & Gassaway, J., 2007, 'Practice-based evidence study design for comparative effectiveness research', Medical Care 45(10), S50-S57. https://doi.org/10.1097/MLR.0b013e318070c07b        [ Links ]

Hosseini, S.M., Oyster, M.L., Kirby, R.L., Harrington, A.L. & Boninger, M.L., 2012, 'Manual wheelchair skills capacity predicts quality of life and community integration in persons with spinal cord injury', Archives of Physical Medicine and Rehabilitation 93(12), 2237-2243. https://doi.org/10.1016/j.apmr.2012.05.021        [ Links ]

Ijzerman, M.J. & Nene, A.V., 2002, 'Feasibility of the physiological cost index as an outcome measure for the assessment of energy expenditure during walking', Archives of Physical Medicine and Rehabilitation 83(12), 1777-1782. https://doi.org/10.1053/apmr.2002.35655        [ Links ]

Jerosch-Herold, C., 2005, 'An evidence-based approach to choosing outcome measures: A checklist for the critical appraisal of validity, reliability and responsiveness studies', The British Journal of Occupational Therapy 68(8), 347-353. https://doi.org/10.1177/030802260506800803        [ Links ]

Jutai, J., Fuhrer, M., Demers, L., Scherer, M. & DeRuyter, F., 2005, 'Toward a taxonomy of assistive technology device outcomes', American Journal of Physical Medicine & Rehabilitation 84(4), 294-302. https://doi.org/10.1097/01.PHM.0000157313.88732.DC        [ Links ]

Kauzlarich, J.J. & Thacker, J.G., 1985, 'Wheelchair tire rolling resistance and fatigue', Journal of Rehabilitation Research and Development 22(3), 25-41. https://doi.org/10.1682/JRRD.1985.07.0025        [ Links ]

Kirby, R.L., 2011, 'Survey of wheelchair skills tests: Making the case for broadening the search and assessment criteria', Clinical Rehabilitation 25(3), 287. https://doi.org/10.1177/0269215510380833        [ Links ]

Kirby, R.L., Corkum, C.G., Smith, C., Rushton, P., MacLeod, D.A. & Webber, A., 2008a, 'Comparing performance of manual wheelchair skills using new and conventional rear anti-tip devices: Randomized controlled trial', Archives of Physical Medicine and Rehabilitation 89(3), 480-485. https://doi.org/10.1016/j.apmr.2007.08.163        [ Links ]

Kirby, R.L., Dupuis, D.J., MacPhee, A.H., Coolen, A.L., Smith, C., Best, K.L. et al., 2004, 'The Wheelchair Skills Test (version 2.4): Measurement properties', Archives of Physical Medicine and Rehabilitation 85(5), 794-804. https://doi.org/10.1016/j.apmr.2003.07.007        [ Links ]

Kirby, R.L., MacDonald, B., Smith, C., MacLeod, D.A. & Webber, A., 2008b, 'Comparison between a tilt-in-space wheelchair and a manual wheelchair equipped with a new rear anti-tip device from the perspective of the caregiver', Archives of Physical Medicine and Rehabilitation 89(9), 1811-1815. https://doi.org/10.1016/j.apmr.2008.01.019        [ Links ]

Kosak, M. & Smith, T., 2005, 'Comparison of the 2-, 6-, and 12-minute walk tests in patients with stroke', Journal of Rehabilitation Research & Development 42(1), 103-107.         [ Links ]

Kumar, A., Schmeler, M.R., Karmarkar, A.M., Collins, D.M., Cooper, R., Cooper, R.A. et al., 2013, 'Test-retest reliability of the functional mobility assessment (FMA): A pilot study', Disability and Rehabilitation: Assistive Technology 8(3), 213-219. https://doi.org/10.3109/17483107.2012.688240        [ Links ]

Lemaire, E.D., Lamontagne, M., Barclay, H.W., John, T. & Martel, G., 1991, 'A technique for the determination of center of gravity and rolling resistance for tilt-seat wheelchairs', Journal of Rehabilitation Research & Development 28(3), 51-58. https://doi.org/10.1682/JRRD.1991.07.0051        [ Links ]

Mason, B.S., Van der Woude, L.H., Tolfrey, K., Lenton, J.P. & Goosey-Tolfrey, V.L., 2012, 'Effects of wheel and hand-rim size on submaximal propulsion in wheelchair athletes', Medicine & Science in Sports & Exercise 44(1), 126-134. https://doi.org/10.1249/MSS.0b013e31822a2df0        [ Links ]

Matter, R., Harniss, M., Oderud, T., Borg, J. & Eide, A.H., 2016, 'Assistive technology in resource-limited environments: A scoping review', Disability and Rehabilitation: Assistive Technology 12(2), 105-114.         [ Links ]

May, L., 1997, 'The challenge of measuring change: Responsiveness of outcomes measurements', Canadian Journal of Rehabilitation 10(1), 15-24.         [ Links ]

Mills, T., Holm, M., Trefler, E., Schmeler, M., Fitzgerald, S. & Boninger, M., 2002, 'Development and consumer validation of the Functional Evaluation in a Wheelchair (FEW) instrument', Disability and Rehabilitation 24(1-3), 38-46. https://doi.org/10.1080/09638280110066334        [ Links ]

Monk, J. & Wee, J., 2008, 'Factors shaping attitudes towards physical disability and availability of rehabilitative support systems for disabled persons in rural Kenya', APDRJ 19(1), 93-113.         [ Links ]

Mortenson, W.B., Miller, W.C. & Auger, C., 2008, 'Issues for the selection of wheelchair-specific activity and participation outcome measures: A review', Archives of Physical Medicine and Rehabilitation 89(6), 1177-1186. https://doi.org/10.1016/j.apmr.2008.01.010        [ Links ]

Mortenson, W.B., Miller, W.C. & Miller-Pogar, J., 2007, 'Measuring wheelchair intervention outcomes: Development of the wheelchair outcome measure', Disability and Rehabilitation: Assistive Technology 2(5), 275-285. https://doi.org/10.1080/17483100701475863        [ Links ]

Motivation, 2011, Motivation rough terrain wheelchair product summary, viewed 12 December 2013, from http://www.motivation.org.uk/documents/WM3-01%20Summary%20v5%20NRS110617.pdf.

Mukherjee, G. & Samanta, A., 2005, 'Wheelchair charity: A useless benevolence in community-based rehabilitation', Disability and Rehabilitation 27(10), 591-596. https://doi.org/10.1080/09638280400018387        [ Links ]

Neale, J. & Strang, J., 2015, 'Blending qualitative and quantitative research methods to optimize patient reported outcome measures (PROMs)', Addiction 110(8), 1215-1216. https://doi.org/10.1111/add.12896        [ Links ]

Neto, F., Coutinho, A. & Beraldo, P., 2014, 'Reproducibility and responsiveness of heart rate indexes to assess wheeling efficiency in patients with spinal cord injuries', Spinal Cord 52(9), 683-688. https://doi.org/10.1038/sc.2014.108        [ Links ]

Ottenbacher, K.J., Hsu, Y., Granger, C.V. & Fiedler, R.C., 1996, 'The reliability of the functional independence measure: A quantitative review', Archives of Physical Medicine and Rehabilitation 77(12), 1226-1232. https://doi.org/10.1016/S0003-9993(96)90184-7        [ Links ]

Oyster, M.L., Smith, I.J., Kirby, R.L., Cooper, R.A., Groah, S.L., Pedersen, J.P. et al., 2012, 'Wheelchair skill performance of manual wheelchair users with spinal cord injury', Topics in Spinal Cord Injury Rehabilitation 18(2), 138-139. https://doi.org/10.1310/sci1802-138        [ Links ]

Philip, B.K., 1990, 'Parametric statistics for evaluation of the visual analog scale', Anesthesia & Analgesia 71(6), 710. https://doi.org/10.1213/00000539-199012000-00027        [ Links ]

Reeve, B.B., Wyrwich, K.W., Wu, A.W., Velikova, G., Terwee, C.B., Snyder, C.F. et al., 2013, 'ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research', Quality of Life Research 22, 1889-1905. https://doi.org/10.1007/s11136-012-0344-y        [ Links ]

Reips, U.-D. & Funke, F., 2008, 'Interval-level measurement with visual analogue scales in Internet-based research: VAS generator', Behavior Research Methods 40(3), 699-704. https://doi.org/10.3758/BRM.40.3.699        [ Links ]

Rispin, K., Dittmer, M., McLean, J. & Wee, J., 2017, 'Preliminary reliability and internal consistency of the wheelchair components questionnaire for condition', Disability and Rehabilitation: Assistive Technology 12(8), 1-8. https://doi.org/10.1080/17483107.2016.1277793        [ Links ]

Rispin, K. & Wee, J., 2015, 'Comparison between performances of three types of manual wheelchairs often distributed in low-resource settings', Disability and Rehabilitation: Assistive Technology 10(4), 316-332. https://doi.org/10.3109/17483107.2014.1002541        [ Links ]

Routhier, F., Vincent, C., Desrosiers, J., Nadeau, S. & Guerette, C., 2004, 'Development of an obstacle course assessment of wheelchair user performance (OCAWUP): A content validity study', Technology Disability 16, 19-31.         [ Links ]

Rushton, P.W., Miller, W.C., Kirby, R.L. & Eng, J.J., 2013, 'Measure for the assessment of confidence with manual wheelchair use (WheelCon-M) version 2.1: Reliability and validity', Journal of Rehabilitation Medicine 45(1), 61-67. https://doi.org/10.2340/16501977-1069        [ Links ]

Sadiya, A., Pattnaik, M. & Mohanty, P., 2016, 'Exploring the impact of manual wheelchair design on user's satisfaction and function in individuals with spinal chord injury', Asian Journal of Science and Technology 7(8), 3464-3472.         [ Links ]

Sasaki, K. & Rispin, K., 2016, 'Evaluation of wheelchair pushing performance on simulated rough pathways in under-resourced settings created with indoor modular units', paper presented at the Rehabilitation Engineering and Assistive Technology Society of North America, Arlington, VA, 12 July.

Sietchiping, R., Permezel, M.J. & Ngomsi, C., 2012, 'Transport and mobility in sub-Saharan African cities: An overview of practices, lessons and options for improvements', Cities 29(3), 183-189. https://doi.org/10.1016/j.cities.2011.11.005        [ Links ]

Stanley, R.K., Stafford, D.J., Rasch, E. & Rodgers, M.M., 2003, 'Development of a functional assessment measure for manual wheelchair users', Journal of Rehabilitation Research and Development 40(4), 301-307. https://doi.org/10.1682/JRRD.2003.07.0301        [ Links ]

Toro, M.L., Garcia, Y., Ojeda, A.M., Dausey, D.J. & Pearlman, J., 2012, 'Quantitative exploratory evaluation of the frequency, causes and consequences of rehabilitation wheelchair breakdowns delivered at a paediatric clinic in Mexico', Disability, CBR & Inclusive Development 23(3), 48-64. https://doi.org/10.5463/dcid.v23i3.167        [ Links ]

USAID/WHO, 2012, Resource list: Wheelchairs for less resourced settings, USAID/WHO, Washington, DC.

VanderWiel, J., Harris, B., Jackson, C. & Reese, N., 2016, 'Exploring the relationship of rolling resistance and misalignment angle in wheelchair rear wheels', paper presented at the RESNA, Arlington, VA, 12 July.

Wade, D. & Collin, C., 1988, 'The Barthel ADL index: A standard measure of physical disability?', Disability and Rehabilitation 10(2), 64-67. https://doi.org/10.3109/09638288809164105        [ Links ]

Walpole, R., Myers, R., Myers, S. & Ye, K., 2006, Probability & statistics for engineers & scientists, 8th edn., Pearson Prentice Hall, Upper Saddle River, NJ.

Whirlwind, Whirlwind product information sheet: Roughrider, viewed 12 December 2013, from http://www.whirlwindwheelchair.org/storage/roughrider/RR-Infosheet-sm.pdf/.

WHO, 2011, Joint position paper on the provision of mobility devices in less resourced settings, WHO, viewed from http://www.who.int/disabilities/publications/technology/jpp_final.pdf.

WHO, 2015, Global challenges in assistive technology-2, WHO, Budapest.

Winter, A.G., Bollini, M.A., DeLatte, D.H., Judge, B.M., O'Hanley, H.F., Pearlman, J.L. et al., 2010, 'The design, fabrication, and performance of the East African trial leveraged freedom chair', paper presented at the 15th design for manufacturing and the lifecycle conference, 7th Symposium on International Design and Design Education, Montreal, 15-18 August.

Yang, Y.S., Koontz, A.M., Triolo, R.J., Mercer, J.L. & Boninger, M.L., 2006, 'Surface electromyography activity of trunk muscles during wheelchair propulsion', Clinical Biomechanics 21(10), 1032-1041. https://doi.org/10.1016/j.clinbiomech.2006.07.006        [ Links ]

 

 

Correspondence:
Karen Rispin
karenrispin@letu.edu

Received: 24 Nov. 2016
Accepted: 02 May 2017
Published: 08 Sept. 2017