On-line version ISSN 2078-5135
Print version ISSN 0256-9574
SAMJ, S. Afr. med. j. vol.103 n.2 Cape Town Feb. 2013
H GeldenhuysI; A VeldsmanII; M TamerisIII; A LuabeyaIV; W HanekomV; H MahomedVI; M HatherillVII
ISouth African Tuberculosis Vaccine Initiative (SATVI), Institute of Infectious Disease and Molecular Medicine (IIDMM); and School of Child and Adolescent Health, Facutly of Health Sciences, University of Cape Town, MB ChB, MFamMed
IISouth African Tuberculosis Vaccine Initiative (SATVI), Institute of Infectious Disease and Molecular Medicine (IIDMM); and School of Child and Adolescent Health, Facutly of Health Sciences, University of Cape Town, N Nursing
IIISouth African Tuberculosis Vaccine Initiative (SATVI), Institute of Infectious Disease and Molecular Medicine (IIDMM); and School of Child and Adolescent Health, Facutly of Health Sciences, University of Cape Town, MB ChB
IVSouth African Tuberculosis Vaccine Initiative (SATVI), Institute of Infectious Disease and Molecular Medicine (IIDMM); and School of Child and Adolescent Health, Facutly of Health Sciences, University of Cape Town, MB ChB, MSc
VSouth African Tuberculosis Vaccine Initiative (SATVI), Institute of Infectious Disease and Molecular Medicine (IIDMM); and School of Child and Adolescent Health, Facutly of Health Sciences, University of Cape Town, MB ChB, DCH, FCPaed
VISouth African Tuberculosis Vaccine Initiative (SATVI), Institute of Infectious Disease and Molecular Medicine (IIDMM); and School of Child and Adolescent Health, Facutly of Health Sciences, University of Cape Town, MB ChB, MMed (Public Health)
VIISouth African Tuberculosis Vaccine Initiative (SATVI), Institute of Infectious Disease and Molecular Medicine (IIDMM); and School of Child and Adolescent Health, Facutly of Health Sciences, University of Cape Town, MD
BACKGROUND: Tuberculosis (TB) vaccine trials in South Africa must be approved by the Medicines Control Council (MCC) and by a human research ethics committee (HREC). Delays in regulatory and ethical approval may affect operational and budget planning and clinical development of the product.
AIM: Our aim was to analyse the time to regulatory and ethical approval for TB vaccine trials conducted by the South African Tuberculosis Vaccine Initiative (SATVI) and to evaluate factors that influence time to final approval.
METHOD: Sixteen new TB vaccine clinical trials conducted by SATVI between 2004 and 2012 on infants, children, and adults were included. The period between submission and final approval was determined for protocols submitted to the MCC and the University of Cape Town HREC.
RESULTS: Median approval time following first submission to the MCC was 122 days (IQR 112 - 168; range 71 - 350), and for protocol amendments 103 days (interquartile range (IQR) 76 - 141; range 23 - 191; n=30). Median time following first submission for HREC approval was 60 days (IQR 33 - 81; range 18 - 125), and for amendments 6 days (IQR 4 - 13; range 1 - 37; n=30). There was no significant difference in approval time by trial phase, year of submission, revisions required, study population, sample size, or whether a clinical research organisation (CRO) was used.
CONCLUSION: The time needed for regulatory and ethics approval was highly variable, but MCC approval for first submissions took twice as long as HREC approval and was the primary determinant of time to final approval. National regulatory capacity should be strengthened to facilitate the conduct of new TB vaccine trials in this country with its high burden of TB.
Regulatory and ethics review of clinical trial protocols is an important mechanism to ensure safe and ethical research on human participants. Such review processes are integral to the development of any new tuberculosis (TB) vaccine. Long delays in approval times may increase costs, complicate operational planning by sponsors and researchers, and lead to frustration and distrust in the system.1 Protracted regulatory processes can delay the development of critical new drugs and vaccines for high priority diseases such as TB and HIV.2 Furthermore, lengthy delays in the approval of clinical trials might create the perception that a particular research environment is not conducive to investigational product development, with the risk that sponsors might choose to conduct the trials elsewhere.
Clinical trials of investigational products, including new candidate TB vaccines, must be pre-approved by a regulatory organisation and at least one human research ethics committee (HREC) in most parts of the world. The statutory regulatory organisation in South Africa (SA) is the Medicines Control Council (MCC).3
The South African Tuberculosis Vaccine Initiative (SATVI) is an academic research unit within the University of Cape Town (UCT) that has been involved in clinical TB research for over 10 years.4 SATVI has conducted 18 registration-standard vaccine trials, including clinical trials of Bacille Calmette-Guerin (BCG) vaccine and 5 different novel TB vaccine candidates. These studies have contributed to answering critical questions in novel TB vaccine development, including methods to measure the mycobacterial immune response and immune correlates of risk and protection against TB.5-7 As a result of this work, the SATVI clinical research site in Worcester, Western Cape Province, is widely regarded as the leading TB vaccine research site in the world.4
The objective of this study was to quantify our experience of the time taken to achieve regulatory and ethics approval for TB vaccine trials as a reflection of the SA research regulatory environment for TB vaccine research.
We determined the length of time for regulatory and ethics approval for all TB vaccine trials conducted at SATVI between 2004 and 2012 on the part of both the MCC and UCT Faculty of Health Sciences HREC. All applications were submitted simultaneously to both the MCC and HREC.
Approval time was defined as the time between date of protocol submission and the date on the letter confirming approval. In the case of the MCC, applications were delivered via courier to the MCC offices in Pretoria, and the date of receipt by the MCC was used as the submission date. Applications submitted to the UCT HREC were hand-delivered, and the date of delivery was used as the submission date. The MCC and HREC stipulate deadlines for applications prior to each committee meeting, and all applications met those deadlines.
The regulatory and ethics submissions of all TB vaccine trial protocols conducted by SATVI since its first phase 1 trial of a novel TB vaccine in 2004 were included in this analysis. Data recorded for each protocol submission included whether this was a first application or a protocol amendment, the sponsor of the trial, the principal investigator (PI), phase of trial (I, II, III or IV), and the year and month of submission. Study population characteristics included the sample size and age group (infants, adolescents, adults). In certain instances, the application was submitted by SATVI in co-operation with the sponsor, and in other cases with the assistance of a clinical research organisation (CRO) in co-operation with SATVI and the sponsor. If the regulatory body or HREC requested a revised submission or further information before final approval, the number of protocol revisions required was recorded. In addition to the year of submission, approval time was compared before and after December 2008 to detect possible trends over time.
Data were analysed using Stata version 11 (Datacorp 2011). For MCC and HREC applications, median approval times were determined, with interquartile ranges (IQR) and minimum- maximum ranges. Data were stratified according to review body (MCC or HREC) and whether this was a first or amendment protocol submission. A Kruskal-Wallis test was used for non- parametric data to compare approval times between MCC and HREC, and to determine whether approval time was affected by trial phase, year of submission, month of submission, revisions required, age of study population, sample size, or whether a CRO was used. Statistical significance was defined as a probability level of <0.05.
A total of 92 applications were submitted to the MCC and HREC for 16 TB vaccine trial protocols. Of these, 32 were for first applications (16 to MCC and 16 to HREC) and 60 (30 each to MCC and HREC) were for subsequent protocol amendments.
Median approval time for first submission to MCC was 122 days (IQR 112 - 168; range 71 - 350) (Figs 1 and 2). Approval time for amendment submissions to the MCC was shorter than for first submissions (median 103 days; IQR 76 - 141, range 23 - 191), but this difference was not statistically significant (p=0.1). Two (12%) of first submissions received MCC approval within 3 months, 6 (38%) between 3 and 4 months, 3 (19%) between 4 and 5 months, and 5 (31%) longer than 5 months. Three (10%) of amendment submissions received MCC approval within 3 months, 18 (60%) between 3 and 4 months, and 9 (30%) longer than 4 months.
Median approval time for HREC first submissions was 60 days (IQR 33 - 81; range 18 - 125). For amendment submissions to HREC, this time was shorter (median 6 days; IQR 4 - 13; range 1 - 37; p<0.001) (Fig. 1). Four (25%) first submissions were approved by HREC within 1 month, 5 (31%) between 1 and 2 months, 5 (31%) between 2 and 3 months, and 2 (13%) between 3 and 4 months. For amendments, HREC approval was received in less than 1 month for 28 (93%) submissions, and within 1 - 2 months in 2 (7%) cases.
Median approval times for first and amendment submissions to the MCC were greater than for HREC (p=0.001) (Fig. 1). The median difference between MCC and HREC approval times was 69 days (IQR 62 - 86) for first submissions and 82 days (IQR 70 -138) for amendment submissions (Fig. 2).
There were no differences in approval time by clinical trial phase, year of submission, calendar month of submission, submission before or after December 2008, sponsor, PI, age of study population, sample size, or whether a clinical research organisation (CRO) was used, for either MCC or HREC submissions (Tables 1 and 2).
Of applications submitted to the MCC, 11/16 (68%) first submissions and 6/30 (20%) amendment submissions required revision or additional information before final approval. The number of resubmissions required did not affect approval times by the MCC for first or amendment submissions. Thirteen (81%) first HREC submissions and 1 (3%) amendment submission required revision or additional information. HREC approval time for first submissions was not greater for submissions that required revision.
Three trials took longer than 6 months for initial approval (Table 2; Fig. 2). In all 3 cases, HREC approval had been given in less than 2 months. The reason for the longer MCC approval times for these particular trials was not known.
We have described time to approval of TB vaccine trials by regulatory and ethics authorities and analysed the factors that influenced these approval times. MCC approval for first protocol submissions took twice as long as HREC approval and was the primary determinant of total time to final approval. There was considerable variability and unpredictability in the time required for the MCC approval process, which in the worst case took 12 months. HREC approved protocol amendments significantly more quickly than first submissions, but amendment approval time for the MCC was similar to first submissions.
To our knowledge, this is the first published analysis of regulatory approval times in the SA context for vaccine clinical trials. The South African Clinical Research Association (SACRA) has called for an online poll of research organisations to collect such data for all types of clinical trials on a wider scale, but these data have not yet been published.8
Time to approval by regulatory and ethics bodies may be affected by protocol factors, or by the capacity of the body to review and process the application. Our data suggest that approval time by the MCC is not significantly influenced by the complexity or safety risk associated with a particular protocol, such as the phase of trial, participant age group or sample size. The lack of correlation between approval time and protocol submissions that required clarification or resubmission is also noteworthy. It is likely, therefore, that capacity and administrative limitations are major drivers in approval delays by the MCC. The MCC has undergone structural changes and is committed to improving its systems and processes;3 although, in our experience, the trend in approval times did not improve over the 8-year period represented by our data.
Time for approval of amendments was significantly shorter for the HREC than for the MCC. Amendments typically involve specific targeted changes to a protocol and do not require a full review of a protocol that has been submitted previously; this may be an area where the MCC could develop more efficient mechanisms. Predictability and transparency of the review process is a key issue in regulatory and ethics approval, given that there was up to a five-fold variation in MCC approval times. Unpredictability of the approval process makes planning difficult for researchers and creates sponsor anxiety in the context of deadlines for grant funding or product development milestones. Greater transparency in the review process and a willingness to engage with investigators would improve stakeholder perceptions and create more confidence in the regulatory review system. For example, regulatory bodies such as the United States Food and Drug Administration (FDA) have made pro-active efforts to provide information about its ongoing performance on a continual basis, including backlogs in application approvals.9
Issues with regulatory capacity are not unique to SA, although approval times in Europe and the USA tend to be shorter. The European Union (EU) adopted the Clinical Trials Directive (EUCTD) in 2001 to improve the clinical research process.10 The directive aimed to streamline approval process for all clinical trials by, inter alia, defining the role of central and local research ethics committees, allowing parallel and not sequential submissions to HREC and a national regulatory authority, and stipulating that authorities provide decisions within 60 days. In the United Kingdom (UK), a similar reform process for HREC approvals was instituted by the Central Office for Research Ethics Committees (COREC) in 2007.11 In practice, these measures are not always effective, and end users of the system have expressed concern over inefficiencies.11,12 Nevertheless, compared with our SA experience, approval times for all types of clinical trials in the EU and UK are shorter (reported mean first approval times range from 43 to 75 days).10-13 In the USA, new products, including vaccine candidates, need to be approved as part of the Investigational New Drug approval process of the FDA before being approved by ethics committees for testing in clinical trials. Reported median approval times for all trials are significantly shorter in the USA (15 - 45 days).10 However, in other parts of Africa and the developing world, little has been published on regulatory approval times. Anecdotal evidence from our collaborating TB vaccine trial sites in Uganda and Mozambique indicate that approval times are longer - approximately 5 months for local and national HREC approval, and an additional 8 - 18 months for national authority approval (E Wobudeya and J Sacralal, 2012, personal communications). Therefore, it is noteworthy that SA regulatory approval times are appreciably shorter than in other developing countries.
This study is limited by a small sample size and therefore we were unable to perform meaningful sub-analysis of less common factors that might substantially affect approval times. Our analysis does create a useful platform for discussion, and invites other research sites and organisations to share their experiences. The fact that our analysis includes data from a single site and for a single group of investigational products (TB vaccines) is a particular strength, since our analysis naturally controls for heterogeneity in research site and investigational product.
In conclusion, we found that variability in regulatory and ethics approval, particularly by the MCC, is a significant factor in the SA clinical trial environment. Prolonged regulatory delays may impede the conduct of research in critical areas such as TB, and limit the ability of SA researchers to compete in the international arena. We acknowledge that the MCC is engaged in a process to optimise the regulatory pathway. We recommend that stakeholders in academia, industry and government engage in discussion to support the MCC in its planned restructuring. Furthermore, we call for state investment and capacity building for African regulatory bodies, to facilitate TB vaccine research in high TB burden countries where it is most needed.
1. Bollyky TJ, Cockburn IM, Berndt E. Bridging the gap: improving clinical development and the regulatory pathways for health products for neglected diseases. Clin Trials 2010;7(6):719-734. [http:// dx.doi.org/10.1177/1740774510386390] [ Links ]
4. Hanekom WA, Hawkridge A, Mahomed H, et al. SATVI - after 10 years closing in on a new and better vaccine to prevent tuberculosis. S Afr Med J 2012;102(6):438-441. [ Links ]
5. Kagina BM, Abel B, Scriba TJ, et al. Specific T cell frequency and cytokine expression profile do not correlate with protection against tuberculosis after bacillus Calmette-Guerin vaccination of newborns. Am J Respir Crit Care Med 2010;182(8):1073-1079. [http://dx.doi.org/10.1164/rccm.201003-0334OC] [ Links ]
6. Soares AP, Scriba TJ, Joseph S, et al. Bacillus Calmette-Guerin vaccination of human newborns induces T cells with complex cytokine and phenotypic profiles. J Immunol 2008;180(5):3569-3577. [ Links ]
7. Scriba TJ, Kalsdorf B, Abrahams DA, et al. Distinct, specific IL-17- and IL-22-producing CD4+ T cell subsets contribute to the human anti-mycobacterial immune response. J Immunol 2008;180(3):1962-1970. [ Links ]
9. Asamoah AK, Sharfstein JM. Transparency at the Food and Drug Administration. N Engl J Med 2010;362(25):2341-2343. [http://dx.doi.org/10.1056/NEJMp1005202]
10. Heerspink HJ, Dobre D, Hillege HL, Grobbee DE, De Zeeuw D. Does the European Clinical Trials Directive really improve clinical trial approval time? Br J Clin Pharmacol 2008;66(4):546-550. [ Links ]
12. Salman RA, Dennis MS, Sandercock PAG,White PM, Warlow C. Research governance impediments to clinical trials: a retrospective survey. J R Soc Med 2007;100:101-104. [http://dx.doi.org/10.1258/jrsm.100.2.101] [ Links ]
13. Chester P, Alaam S, Cooper P, Risley C, Dornhorst A. Local clinical trial approval times in the UK. International Journal of Pharmaceutical Medicine3 2006;20(5):317-20. [http://dx.doi.org/10.2165/00124363-200620050-00006] [ Links ]
Accepted 23 October 2012.
H Geldenhuys (email@example.com)