Randomized controlled trials in pediatric surgery: could we do better? Treatment of vulvar intraepithelial neoplasia with topical imiquimod: seven years median follow-up of a randomized clinical trial. The reporting quality of randomised controlled trials in surgery: a systematic review.
Randomized controlled trials (RCTs) are accepted as the gold standard for assessing the effectiveness of clinical interventions but are rarely reported in pediatric surgery. Have RCTs submitted to the British Association of Paediatric Surgeons (BAPS) Annual Congress during the last 5 years been adequately designed and large enough to produce a valid result?
                Abstracts accepted by the Annual BAPS Congress meetings between 1996 and 2000 were examined in collaboration with a senior health services researcher. The quality of the design, methodology, statistical analysis and conclusions, and the adequacy of the sample size were assessed for all identifiable clinical RCTs.
                From 760 accepted abstracts, there were only 9 RCTs (1%) of clinical interventions. In only 4 trials was the relevant primary end-point specified at the outset of the study, and none documented the method of randomization. Only one abstract mentioned blinding with respect to the intervention or outcome measure. Sample sizes were inadequate to detect even large clinical differences. To date, only one of these RCTs has been published in an English-language, peer-reviewed journal.
                Clear guidelines exist for the conduct of RCTs, yet compliance with these standards was rarely documented in abstracts of pediatric surgical RCTs presented at BAPS. Sample sizes were inadequate. RCTs in pediatric surgery are difficult to perform, but the specialty would benefit from well-designed, carefully conducted, multicentre, clinical RCTs to advance evidence-based practice.
                Copyright 2003, Elsevier Science (USA). All rights reserved. Recently we reported on the efficacy of imiquimod for treating vulvar intraepithelial neoplasia (VIN) in a placebo-controlled, double-blinded randomized clinical trial (RCT). Four weeks after treatment, a complete response was observed in 35% of patients and a partial response in 46%. All complete responders remained disease-free at 12 months follow-up. In the current investigations, we assessed long-term follow-up at least 5 years after the initial RCT.
                Twenty-four of 26 imiquimod-treated patients who had participated in the initial RCT were seen for follow-up. Primary endpoint was durability of clinical response to imiquimod assessed by naked eye vulvar examination and histology. Long-term clinical response was correlated to lesion size before start of the initial RCT. Secondary endpoints were mental health, global quality of life, body image and sexual function in relation with long-term clinical response.
                Median follow-up period was 7.2 years (range 5.6-8.3 years). VIN recurred in one of nine complete responders. Of the initial partial responders, two became disease-free after additional imiquimod treatment. In the other partial responders, VIN recurred at least once after the initial RCT. In long-term complete responders, lesion size at study entry was smaller and these patients had a significantly better global quality of life at follow-up than patients with residual disease and/or recurrence after imiquimod treatment.
                In case of a complete response, imiquimod is effective in the long-term. Furthermore, patients with a long-term complete response had a significantly better global quality of life than patients who recurred after imiquimod treatment.
                Copyright © 2010 Elsevier Inc. All rights reserved. In order to examine the reporting quality of urological RCTs, the initial objectives of this study were to evaluate the degree to which RCTs involving urological surgical techniques (as the intervention) published in the years 2000-2003 complied with the CONSORT statement, and to assess trends and patterns of compliance. Following our initial findings in urology, we extended the methodology to a number of other specialties to assess whether our findings in urology could be generalised to other surgical disciplines.
                The Royal Society of Medicine (RSM) Library was commissioned to search the Medline and Cochrane databases for RCTs in compliance with the study inclusion criteria below. Additional analyses of five other specialties (non-urological trials: cardiovascular, gastrointestinal, hepatic, orthopaedic and vascular) were also made. For the non-urological trials, 15 English language trials (from each specialty) were randomly picked from a blast search conducted by the RSM for the year 2003. The RCTs were given a score out of 22, reflecting how many of the 22 CONSORT items were complied with (with each item being given equal weighting), this score was termed the "CONSORT score".
                Urology trials: In total 122 RCT abstracts were identified which met the inclusion criteria for this study. From these, 32 were excluded as they were follow-up studies, involved a virtual procedure or were a cost analysis, leaving 90 RCTs published across 35 different journals which were analysed (68.2%, 90/122). The average score of 11.1 for urological trials indicates that RCTs in our sample do not comply with the CONSORT statement. No trials reported how they implemented their randomisation process. Only 46% of RCTs stated that they had permission from an ethics review board, 20% had declared their sources of funding, 14% stated whether there were any conflicts of interest and only 1.1% stated their trial registry number. For non-urological studies, an average CONSORT score of 11.2 was obtained.
                Clinical research teams conducting RCTs in urology and other surgical disciplines demonstrate poor compliance with the CONSORT statement. We would recommend that trials should be registered at their outset and that urological and other surgical journals to consider supporting the CONSORT statement and to have compliance 'hard-wired' into their submission, editorial and peer-review processes. Since it seems the best researchers are unable to produce an RCT results which enable surgical techniques to be critically assessed, there is a need for education about the CONSORT statement and its importance at all levels of surgical training. We believe that an open debate is needed on the possible role of other research designs, such as tracker studies. Whether this study actually raises the question of how appropriate RCTs are to surgical techniques, we leave to the reader.
The finding that healing rates can be higher for cases treated surgically as compared to those treated non-surgically, at least in the short term, is based on two RCTs only. A single RCT reported that in the medium to long term healing rates for the two procedures are very similar. There is currently scarce evidence for a sound decision making process among alternative treatments for the re-treatment of a periradicular pathosis. More well-designed RCTs should be performed with follow up of at least 4 years, and with a consistent sample size, to detect a true difference in the long term between the outcomes of the two alternative treatments, if any exist.