LESSONS FROM THE FIELD

 

Quality assurance for HIV point-of-care testing and treatment monitoring assays

 

 

Adrienne F.A. Meyers^{I, II, III}; Paul Sandstrom^{I, II}; Thomas N. Denny^IV; Mackenzie Hurlston^V; Terry B. Ball^{I, II, III, VI}; Rosanna W. Peeling^VII; Debrah I. Boeras^VII

^IQASI, National HIV & Retrovirology Laboratories, Public Health Agency of Canada, JC Wilt Infectious Diseases Research Centre, Winnipeg, Manitoba, Canada
^IIDepartment of Medical Microbiology and Infectious Diseases, University of Manitoba, Winnipeg, Manitoba, Canada
^IIIDepartment of Medical Microbiology, University of Nairobi, Nairobi, Kenya
^IVDuke University, Department of Medicine, Durham, North Carolina, United States
^VCenters for Disease Control and Prevention, Atlanta, Georgia, United States
^VIDepartment of Immunology, University of Manitoba, Winnipeg, Manitoba, Canada
^VIILondon School of Hygiene & Tropical Medicine, London, United Kingdom

Correspondence

 

 

---

ABSTRACT

In 2015, UNAIDS launched the 90-90-90 targets aimed at increasing the number of people infected with HIV to become aware of their status, access antiretroviral therapies and ultimately be virally suppressed. To achieve these goals, countries may need to scale up point-of-care (POC) testing in addition to strengthening central laboratory services. While decentralising testing increases patient access to diagnostics, it presents many challenges with regard to training and assuring the quality of tests and testing. To ensure synergies, the London School of Hygiene & Tropical Medicine held a series of consultations with countries with an interest in quality assurance and their implementing partners, and agreed on an external quality assessment (EQA) programme to ensure reliable results so that the results lead to the best possible care for HIV patients. As a result of the consultations, EQA International was established, bringing together EQA providers and implementers to develop a strategic plan for countries to establish national POC EQA programmes and to estimate the cost of setting up and maintaining the programme. With the dramatic increase in the number of proficiency testing panels required for thousands of POC testing sites across Africa, it is important to facilitate technology transfer from global EQA providers to a network of regional EQA centres in Africa for regional proficiency testing panel production. EQA International will continue to identify robust and cost-effective EQA technologies for quality POC testing, integrating novel technologies to support sustainable country-owned EQA programmes in Africa.

---

 

 

The need for quality assurance

It is estimated that 36.9 million people globally are living with HIV, with more than two-thirds of these individuals located in resource-limited regions.¹ The ambitious UNAIDS 90-90-90 targets, aimed to end the HIV epidemic within the next 15 years, place diagnostics in a key role for achieving these goals: by 2020, 90% of all people living with HIV will know their HIV status; 90% of all HIV-positive people will receive sustained antiretroviral therapy; 90% of all people receiving antiretroviral therapy will achieve viral suppression.² Recent estimates suggest that 15.8 million people are receiving antiretroviral therapy. With the new World Health Organization guidelines recommending test and treat, it is expected that 30 million people living with HIV will have access to treatment by 2020.³

The achievement of the 90-90-90 targets depends on the availability of tests for HIV case detection, including early infant diagnosis (EID) and viral load for monitoring viral suppression. CD4 enumeration is still used for treatment initiation in many countries as they move toward the World Health Organization guidelines of test and treat, and plan to scale up viral load testing. However, access to these tests is reduced in resource-limited settings. Recent efforts aimed at improving access to these assays have seen a large increase in novel technologies that can be performed at the point of care (POC). The rollout of rapid POC tests for HIV testing and treatment initiation has significantly reduced the time for patients to receive results and initiate therapy.^4,5 As testing is decentralised to hundreds of sites outside of the laboratory, and being performed by non-laboratory staff, ensuring test quality and accuracy of results have become key considerations in HIV programmes.⁶

 

Current point-of-care technologies for CD4, early infant diagnosis and viral load testing

To date, there are two approved (World Health Organization-prequalified) POC platforms for CD4 and two for EID, whereas POC viral load platforms are in the evaluation pipeline.⁷ Most of these POC technologies provide sample-in/answer-out diagnostic testing, making it possible for these tests to be performed with minimal training, outside of the traditional laboratory setting. Most of the devices can withstand extreme transport and environmental conditions, provide a test result in less than one hour and have data transmission capabilities. Some (and more are in development) can even operate on battery power.⁸

The rollout of CD4 POC devices in the last few years has provided us with lessons learnt in the implementation and quality management for POC testing. EID and viral load POC testing has not yet been fully implemented in the field, but will benefit from lessons learned from the CD4 experience to strengthen existing quality programmes and ensure integration of POC testing within these programmes.

 

Understanding quality assurance

Quality management is the entire process supporting the quality of testing, while quality assurance is the planned activities implemented to support the quality management system (Figure 1).^9,10 While it is highly recommended that a POC quality assurance plan address the entire quality assurance management cycle, in this report we focus on external quality assurance as a quality assurance activity relevant to POC testing, and the results serve as a strong indicator of laboratory quality.¹¹

POC devices have in-built internal quality controls to monitor in real time the performance of an instrument and, to some extent, the user. If any of the controls fail, the device should not provide a test result. In contrast, external quality assessment (EQA), often used interchangeably with proficiency testing, challenges the testing environment and allows for an external expert body to examine the processes and provide remedial action.^9,12,13

The three components of an effective EQA laboratory programme are site supervision, retesting of specimens, and proficiency testing.¹⁴ Supervision is integral to quality assurance and should be done routinely, but with minimal disruption to patient services. Retesting is rarely done due to costs and time constraints, and is especially challenging in the POC environment. Proficiency testing is the most widely-used approach to monitor the performance of the test used and the quality of testing. It involves blinded control material, meant to mimic patient specimens, sent from a reference laboratory to the testing site and results sent back for scoring. Participation in EQA programmes is often mandated for clinical laboratories performing regular testing of patient samples for HIV care and management.^15,16

A low proficiency testing score should alert the laboratory or testing site that there is a problem. Often, identifying the exact nature of the problem, and then correcting the problem, is difficult, even for skilled technicians. The error can be either an instrument error or an operator error. Investigation and remedial action should be taken immediately to correct the problem before patients' results are adversely affected.

 

Current external quality assessment schemes

A comprehensive external quality assurance programme consists of the following: proficiency testing panel design and production, EQA scheme/survey, results and reporting, customer service/technical support, and corrective action (Table 1).

An EQA survey or cycle consists of a panel of specimens intended to challenge or assess the testing event. EQA should, as far as possible, cover the entire range of tests, and the entire examination process, from sample reception, preparation and analysis to interpretation and reporting.¹⁷ The goal is to allow for regularity in testing that will highlight any changes or challenges a participant may encounter without having a long period of inaccurate testing going undetected. The reporting of results, as well as immediate corrective action to improve programmes, is the most critical component to any EQA programme. Reporting results is a major challenge in resource-limited settings due to various reasons that result in wasted resources and systematic problems going undetected. The number of specimens or members in each panel and frequency of EQA often varies by type of test and the EQA provider. Programmes often struggle to find an overall balance between 'necessary' and 'sufficient' in order to minimise costs and maximise resources.

 

External quality assessment for point-of-care CD4, early infant diagnosis and viral load testing

As new technologies are introduced, EQA needs to evolve to accommodate new testing strategies.¹⁸ In an effort to address the topic of quality of testing at hundreds, perhaps thousands of sites in a country, this section will consider what is necessary to ensure quality POC CD4, EID, and viral load testing.

Projected demands for point-of-care testing

With 'test and treat' and the scale up of viral load testing for monitoring patients, CD4 volumes are projected to remain the same in the short term and eventually decline as programmes transition to viral load testing. While POC testing for EID and viral load is currently not offered in some countries, planning for the rollout of these tests is ongoing and presents a critical time to develop strategies for quality assurance of these tests. To ensure synergies, the London School of Hygiene & Tropical Medicine established EQA International, bringing together EQA providers and implementers to develop a strategic plan for working with countries in Africa to establish national POC EQA programmes and estimate the cost of setting up and maintaining the programme. Members of EQA International include The Public Health Agency of Canada QASI programme, the US Centers for Disease Control and Prevention, Duke University External Quality Assurance Program Oversight Laboratory and Immunology Quality Assessment, South Africa National Health Laboratory Service, Zimbabwe National Quality Assurance Programme and Foundation Mérieux. EQA International is working closely with funders and implementing partners to remain one step ahead of the phased rollout of POC testing for EID and viral load in Africa.

How to deliver on the demands of quality-assured point-of-care testing

Assuming hundreds and possibly thousands of devices will be placed in Africa over the next five years, EQA International, in consultation with national HIV programme and laboratory managers from countries in Africa with an interest in participating in EQA programmes for POC testing, agreed on a work plan for the standardisation, production and distribution of proficiency testing panels and reporting mechanisms, to cover CD4, EID and viral load POC testing in Africa (Table 2).

 

 

External quality assessment technology

Ideally, EQA proficiency testing specimens can be used for both POC and laboratory testing. While the use of fresh whole blood samples most closely resembles clinical samples tested by a participant, if an EQA programme has several hundred participants or a participant base located over a wide geographical area, it may not be feasible to access enough material and distribute to participants within the time-frame that the material is stable and effective for proper evaluation. Commercially-stabilised whole blood products, while financially more challenging, are homogeneous and stable for weeks to months, which is beneficial for large EQA programmes.

Novel technologies are likely to be needed, given the volumes and potential logistical challenges, such as maintenance of sample integrity during transport. Several innovative cost-effective applications are being explored to provide stabilised EQA specimens for CD4, EID and viral load testing. A major challenge with CD4 has been the necessity for whole blood and therefore stabilisers are required as a means of extending pre-analytic capacity for CD4 T-cell enumeration.¹⁹ Considering POC sites, an ideal candidate would allow the EQA CD4 and EID specimens to remain stable for up to three weeks at ambient temperatures in-country.

Another innovative technology, the dried tube specimen (DTS) has been successfully used for EQA for HIV and syphilis rapid diagnostic tests and for automated viral load laboratory tests.^{20,21,22,23,24} DTS can likely be expanded for EQA of viral load POC tests as well as other tests. A study specifically looking at the relative impact of costs of implementing DTS EQA with the rollout of a rapid syphilis testing programme found the incremental costs of EQA relatively small and further cost reductions were possible through programme redesign.²⁵

EQA sample considerations for POC CD4, viral load and EID programmes are summarised in Table 3. EQA International is working to identify robust and cost-effective EQA technologies for quality POC testing and integrating novel technologies to support sustainable EQA programmes.

 

 

Regional external quality assessment coordination centres

Currently, the majority of proficiency testing panels are procured from commercial EQA providers outside Africa. Shipment of proficiency testing panels to individual laboratories is costly and logistical challenges are frequently encountered.

A regional approach would allow for distribution of a well-characterised panel of sufficient sample size to be used to compare performances across the region. The National Health Laboratory Service in South Africa is currently providing EQA for EID to more than 10 neighbouring countries. The AFRIQUALAB in Senegal supports EQA for CD4 and EID to more than 40 countries. The Zimbabwe National Quality Assurance Program is establishing a regional EQA centre to support CD4, EID and viral load testing. Finally, the African Society for Laboratory Medicine has recently established a network of six collaborating centres across Africa to strengthen laboratory medicine; these collaborating centres could also function as regional EQA centres.

A network of regional EQA coordinating centres can be set up to produce or procure proficiency testing materials from global providers, and coordinate distributions (Figure 2). These centres could also oversee the logistics and management of the EQA programme, providing timely corrective action and strengthening national quality assurance programmes and country capacity. Through technology transfer, these centres could produce panels at minimal cost, using locally-sourced material.

 

 

Regional EQA coordinating centres can also support other programmes and services. The World Health Organization Regional Office for Africa has linked EQA programmes for their laboratory networks for influenza, malaria, meningitis, enterics and other diseases.²⁶ The East African Regional External Quality Assessment Scheme supports EQA in five countries to improve the quality of essential diagnostic services in clinical laboratories at peripheral level. Future capacities of regional EQA centres could serve as biobanking facilities that support test performance evaluations and validations, post-market surveillance, global health surveillance, and facilitate new test development.

 

Benefits of external quality assessment programmes

There is strong evidence to indicate that participation in EQA programmes significantly improves testing performance.^23,26,27 The US Centers for Disease Control and Prevention has developed EQA programmes to help participating laboratories monitor the quality of laboratory-based viral load and EID testing in low- and middle-income countries. In an analysis of the reported EQA data from more than 114 participating laboratories in 44 countries in the viral load programme, and 136 participating laboratories in 41 countries in the EID programme, they found that with increased participation came increased performance.^23,27 The Public Health Agency Canada (QASI)-Quality Management System, designed to work globally, optimised its programme strategies in 2009 and immediately saw reduced error rates with their CD4 programme as well as significant reduction in inter-laboratory variability resulting from continuous participation in the QASI-quality management system.²⁸ QASI provides detailed, extensive technology transfer workshops to programme participants using a 'train-the-trainer' format, which significantly improves participation and performance. With CD4, improvements in performance of programmes can be directly linked to improvements in patient care.^4,11

Apart from insights into the participants' performance levels, EQA can also survey the overall national laboratory infrastructure and trace problems in processes. Examples of this include the sample transport network and supply chain management system. These two systems often go hand-in-hand and contribute to reagents/kit stock-outs and poor quality of specimens. A comprehensive, coordinated EQA programme can identify these gaps and bring them to the attention of the country's Ministry of Health and partners for immediate corrective action, strengthening the overall infrastructure of the country and thereby improving programmes and services. In addition, EQA programmes can also capture key indicators and document programme improvements over time.

EQA is an important tool for providing the educational stimulus that will improve overall performance and standards.²⁹ Other quality assurance activities, such as training and site evaluations, can support a quality-assured environment.^10,30 EQA also builds educational stimulus and promotes research capacity through technology transfer and trainings. The Institute of Public Health in Brussels, Belgium looked at EQA for malaria rapid diagnostic tests and found that EQA prompted educational incentives that boosted self-confidence and credibility.³¹ EQA can also provide valuable information to programmes and manufacturers though post-market surveillance.³² Post-market surveillance ensures that diagnostics continue to meet quality, safety and performance requirements. Often failures go unreported, but though a proactive EQA programme, these failures can be captured and reported appropriately.

Participation in an external quality assessment program provides many benefits and valuable data to health authorities (Figure 3):^30,33

• Comparison of performance and results among different test sites.

• Collection of data across different sites.

• Early warning for systematic problems.

• Objective evidence of testing quality.

• Indicates areas that need improvement.

• Survey the use of diagnostic algorithms.

• Potential to build health security through surveillance and monitoring.

 

 

A key feature of many of these POC molecular devices is that they are equipped with data transmission capacities. Apart from monitoring the quality of tests and testing to optimise supply chain management, data connectivity links data from diagnostic laboratories and POC test readers and devices to provide data on testing coverage, disease trends and timely information for early warning of infectious disease outbreaks.³⁴

 

Looking forward: Sustainable, country-owned external quality assessment programmes in Africa

Sustainability of EQA programmes requires country ownership. As countries in Africa plan the scale-up of POC technologies for CD4, viral load and EID testing, political commitment toward quality should be reflected in country policies and implementation plans. Putting in place EQA programmes that can identify gaps and challenges in the testing environment and address them immediately to increase the efficiency of healthcare systems and improve patient results, are urgent priorities.

The role of implementing partners and industry in support of EQA and quality assurance programmes is also a strong consideration for the sustainability of quality-assured testing. Partners and industry can bring numerous resources to these programmes. As an example, when Zimbabwe was establishing their national quality assurance programme, the Ministry of Health brought together stakeholders as well as quality assurance and POC partners to share their vision for a coordinated national programme that would identify redundancies and gaps and leverage partner resources and commitment. This process secures a sustainable country-owned quality assurance national policy.

 

Acknowledgements

CDC Disclaimer: The findings and conclusions in this article are those of the authors and do not necessarily represent the official position of the U.S. Centers for Disease Control and Prevention.

Open Review: This article underwent open peer review by Ben Cheng and David Mabey. The editors and authors are grateful for their comments and suggestions.

Competing interests

The authors declare that they have no financial or personal relationships which may have inappropriately influenced them in writing this article.

Sources of support

T.N. Denny was supported by NIAID DAIDS IQA, Contract No. HHSN272201400014C; NIAID DAIDS EQAPOL, Contract No. HHSN272201000045C.

Authors' contributions

R.W.P and D.I.B drafted the manuscript. A.F.A.M., P.S., T.N.D., M.H., and T.B.B. reviewed the manuscript for important intellectual content. All authors approved the final version.

 

References

1. Joint United Nations Programme on HIV/AIDS (UNAIDS). AIDS by the numbers. Geneva, Switzerland: UNAIDS; 2015.         [ Links ]

2. Joint United Nations Programme on HIV/AIDS (UNAIDS). 90-90-90: An ambitious treatment target to help end the AIDS epidemic [document on the Internet]. c2014 [cited 2014]. Available from: http://www.unaids.org/sites/default/files/media_asset/90-90-90_en_0.pdf        [ Links ]

3. World Health Organization. WHO guidelines on HIV/AIDS [page on the Internet]. n.d. [cited 2014]. Available from: www.who.int/publications/guidelines/hiv_aids/en/        [ Links ]

4. Jani IV, Sitoe NE, Alfai ER, et al. Effect of point-of-care CD4 cell count tests on retention of patients and rates of antiretroviral therapy initiation in primary health clinics: an observational cohort study. Lancet. 2011;378(9802):1572-1579. http://dx.doi.org/10.1016/S0140-6736(11)61052-0        [ Links ]

5. Bares S, Eavou R, Bertozzi-Villa C, et al. Expanded HIV testing and linkage to care: conventional vs . point-of-care testing and assignment of patient notification and linkage to care to an HIV care program. Public Health Rep. 2016;131(Suppl 1):107-120.         [ Links ]

6. Fonjungo PN, Osmanov S, Kuritsky J, et al. Ensuring quality: a key consideration in scaling-up HIV-related point-of-care testing programs. AIDS. 2016; 30(8):1317-1323. http://dx.doi.org/10.1097/QAD.0000000000001031        [ Links ]

7. World Health Organization. WHO list of prequalified in vitro diagnostic products [document on the Internet]. c2016 [cited 2016]. Available from: http://www.who.int/diagnostics_laboratory/evaluations/160714_prequalified_ product_list.pdf?ua=1        [ Links ]

8. UNITAID. Quality assurance of health products [document on the Internet]. c2014 [cited 2014]. Available from: http://unitaid.org/images/events/UNITAID_grantee_forum-2014/UNITAID_QA.pdf        [ Links ]

9. World Health Organization. Laboratory quality management system training toolkit [document on the Internet]. c2009 [cited 2011]. Available from: http://www.who.int/ihr/training/laboratory_quality/en/index.html        [ Links ]

10. World Health Organization. HIV diagnostics. Improving the quality of HIV-related point-of-care testing: ensuring the reliability and accuracy of test results [document on the Internet]. c2015 [cited 2015]. Available from: http://apps.who.int/iris/bitstream/10665/199799/1/9789241508179_eng.pdf?ua=1        [ Links ]

11. Fonjungo PN, Boeras DI, Zeh C, et al. Access and quality of HIV-related point-of-care diagnostic testing in global health programs. Clin Infect Dis. 2015; 62(3):369-374. http://dx.doi.org/10.1093/cid/civ866 Epub 2015 Sep 30.         [ Links ]

12. Clinical and Laboratory Standards Institute (CLSI). Using proficiency testing to improve the clinical laboratory; Approved guideline-Second edition. CLSI Doc GP27-A2. Wayne, PA: CLSI; 2007.         [ Links ]

13. International Organization for Standardization. ISO/IEC 17043:2010: Conformity assessment - General requirements for proficiency testing. Geneva, Switzerland: ISO; 2010.         [ Links ]

14. Westerman LE, Kohatsu L, Ortiz A, et al. A quality management systems approach for CD4 testing in resource-poor settings. Am J Clin Pathol. 2010;134(4):556-567. http://dx.doi.org/10.1309/AJCPP7MCHFYLX2FM        [ Links ]

15. Electronic Code of Federal Regulations. Part 493-Laboratory requirements [page on the Internet]. n.d. [cited 2016]. Available from: http://www.ecfr.gov/cgi-bin/text-idx?SID=1248e3189da5e5f936e55315402bc38b&node=pt42.5.493&rgn=div5        [ Links ]

16. International Organization for Standardization. ISO 15189:2012: Medical laboratories - Requirements for quality and competence. Geneva, Switzerland: ISO; 2012.         [ Links ]

17. International Organization for Standardization. ISO 15189:2012: Medical laboratories - Requirements for quality and competence. Geneva, Switzerland: ISO; 2012.         [ Links ]

18. Westgard JO. Managing quality vs. measuring uncertainty in the medical laboratory. Clin Chem Lab Med. 2010;48(1):31-40. http://dx.doi.org/10.1515/CCLM.2010.024        [ Links ]

19. Shott JP, Iga B, Makumbi F, et al. CD4 stabilization tubes provide improved accuracy of absolute CD4 T-cell counts compared to standard K3 EDTA tubes in human immunodeficiency virus immunologic monitoring in resource-poor settings. Clin Vaccine Immunol. 2008;15(10):1623-1624. http://dx.doi.org/10.1128/CVI.00176-08        [ Links ]

20. Parekh BS, Anyanwu J, Patel H, et al. Dried tube specimens: A simple and cost-effective method for preparation of HIV proficiency testing panels and quality control materials for use in resource-limited settings. J Virol Methods. 2010;163(2):295-300. http://dx.doi.org/10.1016/j.jviromet.2009.10.013 Epub 2009 Oct 28.         [ Links ]

21. Benzaken AS, Bazzo ML, Galban E, et al. External quality assurance with dried tube specimens (DTS) for point-of-care syphilis and HIV tests: experience in an indigenous populations screening programme in the Brazilian Amazon. Sex Transm Infect. 2014;90(1):14-18. http://dx.doi.org/10.1136/sextrans-2013-051181 Epub 2013 Sep 12.         [ Links ]

22. Smit PW, Mabey D, van der Vlis T, et al. The implementation of an external quality assurance method for point-of-care tests for HIV and syphilis in Tanzania. BMC Infect Dis. 2013;13(1):530. http://dx.doi.org/10.1186/1471-2334-13-530        [ Links ]

23. Nguyen S, Ramos A, Chang J, et al. Monitoring the quality of HIV-1 viral load testing through a proficiency testing program using dried tube specimens in resource-limited settings. J Clin Microbiol. 2015;53(4):1129-1136. http://dx.doi.org/10.1128/JCM.02780-14 Epub 2015 Jan 21.         [ Links ]

24. Scott L, Albert H, Gilpin C, et al. Multicenter feasibility study to assess external quality assessment panels for Xpert MTB/RIF assay in South Africa. J Clin Microbiol. 2014;52(7):2493-2499. http://dx.doi.org/10.1128/JCM.03533-13 Epub 2014 Apr 30.         [ Links ]

25. Sweeney S, Mosha JF, Terris-Prestholt F, et al. The costs of accessible quality assured syphilis diagnostics: informing quality systems for rapid syphilis tests in a Tanzanian setting. Health Policy Plan. 2014;29(5):633-641. http://dx.doi.org/10.1093/heapol/czt049 Epub 2013 Jul 27.         [ Links ]

26. Frean J, Perovic O, Fensham V, et al. External quality assessment of national public health laboratories in Africa, 2002-2009. Bull World Health Organ. 2012;90:191-199A. http://dx.doi.org/10.2471/BLT.11.091876        [ Links ]

27. Garcia A, Subbarao S, Zhang G, et al. Impact of proficiency testing program for laboratories conducting early diagnosis of HIV-1 infection in infants in low- to middle-income countries. J Clin Microbiol. 2014;52(3):773-780. http://dx.doi.org/10.1128/JCM.03097-13 Epub 2013 Dec 18.         [ Links ]

28. Bergeron M, Ding T, Elharti E, et al. Evaluation of a dry format reagent alternative for CD4 T-cell enumeration for the FACSCount system: a report on a Moroccan-Canadian study. Cytom Part B - Clin Cytom. 2010;78(3):188-193. http://dx.doi.org/10.1002/cyto.b.20501        [ Links ]

29. Sciacovelli L, Secchiero S, Zardo L, et al. Special issue: The role of the external quality assessment. Quality in laboratory diagnostics: from theory to practice. Biochemia Medica. 2010;20(2):160-164. http://dx.doi.org/10.11613/BM.2010.019        [ Links ]

30. World Health Organization. WHO manual for organizing a national external quality assessment programme for health laboratories and other testing sites. Geneva, Switzerland: WHO; 2016.         [ Links ]

31. Gillet P, Mukadi P, Vernelen K, et al. External quality assessment on the use of malaria rapid diagnostic tests in a non-endemic setting. Malar J. 2010;9:359. http://dx.doi.org/10.1186/1475-2875-9-359        [ Links ]

32. World Health Organization. Post-market surveillance of in vitro diagnostics [document on the Internet]. c2015 [cited 2015]. Available from: http://www.who.int/diagnostics_laboratory/postmarket/150819_pms_guidance_ final_version.pdf?ua=1        [ Links ]

33. Kettelhut MM, Chiodini PL, Edwards H, et al. External quality assessment schemes raise standards: evidence from the UKNEQAS parasitology subschemes. J Clin Pathol. 2003;56(12):927-932.         [ Links ]

34. Peeling RW. Diagnostics in a digital age: an opportunity to strengthen health systems and improve health outcomes. Int Health. 2015;7(6):384-389. http://dx.doi.org/10.1093/inthealth/ihv062        [ Links ]

 

 

Correspondence:
Adrienne Meyers
adrienne.meyers@phac-aspc.gc.ca

Received: 31 Aug. 2016
Accepted: 31 Aug. 2016
Published: 17 Oct. 2016