Oncotarget

Research Papers:

This article has an addendum. Addendum in: Oncotarget. 2023; 14:778-778.

Effectiveness of radiotherapy for local control in T3N0 rectal cancer managed with total mesorectal excision: a meta-analysis

PDF |  Full Text  |  Supplementary Files  |  How to cite  |  Press Release

Oncotarget. 2022; 13:1109-1119. https://doi.org/10.18632/oncotarget.28280

Metrics: PDF 738 views  |   Full Text 1641 views  |   ?  

Michael Jonathan Kucharczyk _, Andrew Bang, Michael C. Tjong, Stefania Papatheodorou and Jesus C. Fabregas

Abstract

Michael Jonathan Kucharczyk1,2, Andrew Bang3, Michael C. Tjong4, Stefania Papatheodorou5 and Jesus C. Fabregas6

1 Department of Radiation Oncology, Nova Scotia Cancer Centre, Halifax, NS B3H 1V7, Canada

2 Department of Radiation Oncology, Dalhousie University, Halifax, NS B3H 1V7, Canada

3 Department of Surgery, BC Cancer – Vancouver, Vancouver, BC V5Z 4E6, Canada

4 Department of Radiation Oncology, Princess Margaret Cancer Centre, Toronto, ON M5T 1W6, Canada

5 Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA 02115, USA

6 Department of Medicine, University of Florida Health Cancer Center, Gainesville, FL 32610, USA

Correspondence to:

Michael Jonathan Kucharczyk, email: [email protected]

Keywords: radiotherapy; meta-analysis; systematic review; rectal cancer; total mesorectal excision

Received: July 12, 2022     Accepted: September 22, 2022     Published: October 08, 2022

Copyright: © 2022 Kucharczyk et al. This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

ABSTRACT

Introduction: The total mesorectal excision (TME) significantly improved rectal cancer outcomes. Radiotherapy’s benefit in T3N0 rectal cancer patients managed with TME has not been clearly demonstrated. A systematic review and meta-analysis were undertaken to determine whether radiotherapy altered the risk of locoregional recurrence (LR) in T3N0 rectal cancer patients managed with a TME.

Materials and Methods: Studies indexed on PubMed or Embase were systematically searched from inception to October 18, 2020. Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were observed for the literature search, study screening, and data extraction; the Newcastle Ottawa Scale evaluated bias; Grades of Recommendation, Assessment, Development, and Evaluation Working Group system evaluated certainty; and all were performed independently by at least two investigators. Studies that reported LR data specific to T3N0 rectal cancer patients managed with TME, treated with and without radiotherapy, were included. Data was pooled using a random-effects model. Meta-analyses of the relative risk of local recurrence were conducted.

Results: Five retrospective cohort studies involving 932 unique patients reported LR outcomes; no prospective studies met eligibility criteria. Median follow-up ranged from 38.4–78 months. Adjuvant radiotherapy was provided in 3 studies. Chemotherapy was delivered and reported in 4 studies, providing both concurrent and adjuvant chemotherapy. A non-significant LR reduction with radiotherapy alongside TME was estimated, mean relative risk (RR) 0.63 (95% Confidence Interval 0.31–1.29; I2 = 41.8%).

Conclusions: A non-significant LR benefit with radiotherapy’s addition was estimated. Meta-analysis of exclusively retrospective cohort studies was concerning for biased results. Adequately powered randomized trials are warranted.


Introduction

The Swedish Rectal Cancer trial established radiotherapy’s role in the management of localized rectal cancer, benefitting both locoregional recurrence (LR) and overall survival (OS) [1]. The quality of surgery has since improved dramatically with the adoption of the total mesorectal excision (TME), an en-bloc resection of the mesorectum extending to the visceral pelvic fascia [2]. TME’s use yielded results similar to what previously required both radiotherapy and less robust surgeries [3]. Once TME was combined with radiotherapy, the subsequent randomized Dutch TME trial did not demonstrate a survival benefit with radiotherapy [4, 5]. Instead, a benefit to LR was observed, though this was not statistically significant in the long-term outcomes for the Stage II subgroup (T3/4N0 participants) [6].

Given TME’s effectiveness in facilitating local control, there are reasonable arguments that the lowest risk group of the Dutch TME trial (i.e., clinically staged T3N0 rectal cancer) could forego routine radiotherapy [7]. Many established LR risk factors are absent in this population, namely a higher T-stage and lymph node involvement, though other risks may be present (ex. mucinous histology, positive surgical margins, lower tumor epicenter) [812]. Prospective observational studies (Mercury II, OCUM, QuickSilver) support that pre-operative magnetic resonance imaging (MRI) could allow radiotherapy to be withheld for T3N0 disease at low risk of a positive margin or nodal disease, observing positive circumferential margins in only 1.9–4.8% and 3-year LR in 1–3% of participants [1315]. However, major guidelines suggest radiotherapy as a standard for all T3N0 rectal cancer patients [16].

Critical appraisals of radiotherapy’s benefit in the T3N0 patients are challenged by heterogeneous documentation of a high-quality TME being performed in pertinent studies. The performance of a good quality TME cannot be assumed, as it has been shown to require a formalized training program [17], a requisite for the participation in many randomized trials [18, 19]. Also, there were delays in the international adoption of TME following demonstrations of the technique’s superiority [20]. Therefore, we aimed to summarize all available evidence in a systematic review and meta-analysis to quantify the possible LR benefit from radiotherapy in T3N0 rectal cancers managed with a TME.

Results

Screening of search results

The systematic search identified 7246 unique studies, of which 134 abstracts were screened as eligible and subjected to an assessment of their full-text (Figure 1). Seven unique studies were identified and subjected to assessments of quality [2127]. Following attempted correspondence with the studies’ authors to address concerns raised when evaluating each study’s risk of bias (Supplementary Materials), five of seven studies were included for quantitative analysis [22, 2528].

PRISMA flow chart for study selection and reporting.

Figure 1: PRISMA flow chart for study selection and reporting.

Participant characteristics

Table 1 summarizes the characteristics of the participants of the five studies included in the meta-analysis. A summary table of the seven studies which met eligibility criteria prior to quality assessment is available in the Supplement (Supplementary Table 1).

Table 1: Characteristics of study participants of the five retrospective cohort studies of the meta-analysis

TrialCountryAccrual periodDesignParticipants (n)Rectal cancer populationInterventionComparatorMedian follow-up (m)Outcome
Delaney et al. 2002
[28]
USA1980–2001Retrospective Cohort135pT3NXM0 adenoca,
<8 cm from AV
Neoadj RT + TME
40–50 Gy
TME415 yr LR
Kim et al. 2010
[22]
South Korea1996–2004Retrospective Cohort151pT3N0 adenocaTME + Adj RT + Adj Ctx
50.4–54 Gy
TME + Adj Ctx785 yr LR
Peng et al. 2019
[26]
China2005–2015Retrospective Cohort
(subgroup)
121pT3N0M0 adenoca, <7 cm
from AV, negative margins
TME + Adj CRT ± Adj Ctx
46–50 Gy
TME + Adj Ctx Intervention 56.4
Comparator 57.1
3 yr 5 yr LR
Lin et al. 2019
[25]
China**2010–2014Retrospective Cohort272cT3N0M0 adenocaNeoadj RT + TME + Adj Ctx
50.4 Gy
TME ± Adj
CRT*** ± Adj Ctx
Intervention 38.4
Comparator 46.3
2 yr LR
Baek et al. 2020
[27]
Korea2003–2012Retrospective Cohort365pT3N0M0 adenoca,
negative margins
TME + Adj CRT
43.2–60 Gy; Median 44 Gy
TME ± Adj Ctx715 yr LR

Among the included studies, 932 participants were enrolled between 1980 and 2015. All studies involved adenocarcinoma, though cases of mucinous adenocarcinoma were documented among all 5 study populations (<10%) [2125, 27]. Most participants, 797 (85.5%), were located in Asia [2227]. Adjuvant chemotherapy was received by all study participants in 4 studies but was omitted in the earliest (1980) and only North American study [28]. Radiotherapy was provided adjuvantly in 3 studies [22, 26, 27] and neoadjuvantly in 2 studies [25, 28]. Median follow-up ranged from 41–78 months. The most commonly reported LR time point was at 5-years. The study that did not report 5-year LR rates had a point estimate extrapolated from figures [25]. All studies offered standard fractionated radiotherapy (1.8–2.0 Gy per fraction), with doses ranging from 40 to 60 Gy. Three studies specified their radiotherapy technique as either 3 or 4-field approaches [22, 26, 28] and two others did not specify [25, 27]. One neoadjuvant study did not control for margin status [28], two adjuvant studies included exclusively margin negative patients [26, 27], one neoadjuvant study had 5/75 participants in each arm with positive margins (with comparator patients receiving chemoradiotherapy) [25], and one adjuvant study reported 2/29 comparator participants and 7/122 intervention participants [22].

Risk of bias

Risk of Bias was assessed in all 7 eligible studies identified by the screening process (Supplement – NOS evaluations) and is summarized in Table 2. Of note, the NOS only assesses two factors for Comparability. Tumor location and chemotherapy were deemed the two most relevant factors given that both neoadjuvant and adjuvant studies were included (biasing interpretation of margin status). Individual study concerns prompted the exclusion of two studies. GRADE assessment determined a Low certainty in the final result, with additional concerns for Imprecision. Expanded discussion is included in the eResults.

Table 2: Summary of the main outcome extracted from each study, extracting the reported 5-year local recurrence events

StudyInterventionComparatorOxford quality ratingNewcastle ottawa quality assessment
Local
recurrences
Number
at risk
Local
recurrences
Number
at risk
Selection
(out of 4)
Comparability
(out of 2)
Outcomes
(out of 3)
Delaney et al. 2002
[28]
4 (8.3%)4810 (11.5%)873✯✯✯✯✯✯✯✯
Kim et al. 2010
[22]
31 (25.4%)1226 (20.6%)293✯✯✯✯✯✯
Lin et al. 2019
[25]
3 (2.8%)1082 (2.7%)753✯✯✯✯✯✯✯✯
Peng et al. 2019
[26]
4 (6.9%)5812 (19.0%)633✯✯✯✯✯✯✯✯✯
Baek et al. 2020
[27]
1 (0.1%)14314 (6.3%)2223✯✯✯✯✯✯✯✯

Publication bias was described through tests of heterogeneity, specifically an Egger test and Plot (Supplementary Figure 1) and Funnel Plot (Supplementary Figure 2). Egger’s test for small study effects did not estimate this as a significant cause of bias (p = 0.813). These tests did not suggest a publication bias. Due to this meta-analysis’ small sample size of studies, estimations are only provided for descriptive purposes.

Local recurrence

Of the 5 pooled trials, the random effects meta-analysis estimated the risk of LR among 955 study participants. The intervention was reported as received in 479 (radiotherapy with or without chemotherapy, concurrently and/or sequentially) and 476 were reported to receive the comparator (no radiotherapy, with or without chemotherapy). Figure 2 depicts each studies’ weighted contribution and the estimated pooled relative risk of 5-year LR of 0.63 (95% Confidence Interval (CI) 0.31–1.29, p = 0.143; entire predictive interval 0.08–4.70) among participants reported to have received radiotherapy compared to participants not receiving radiotherapy. The absolute number of LR events in the intervention population was 43/479 and 44/476 in the comparator. Moderate heterogeneity was observed (I2 = 0.41)

Forest plot of the relative risk of local recurrence in the included retrospective cohort studies.

Figure 2: Forest plot of the relative risk of local recurrence in the included retrospective cohort studies. For each study, the black diamond indicates the point estimate, the black line the 95% confidence interval (CI), and the grey box the relative weight of the study. The hatched redline marks the point estimate of the pooled relative risk, the blue diamond portrays its 95% CI, and the blue line indicates the entire estimated predictive interval.

Sensitivity analyses established a priori included an influence analysis which repeated the random-effects meta-analysis, removing each study in turn, and a cumulative meta-analysis by date. The cumulative meta-analysis by date (Supplementary Figure 3) illustrates that the point estimate continuously favors radiotherapy but does not approach statistical significance. Influence analysis (Supplementary Figure 4) observed that only the removal of the Kim et al.’s works from the meta-analysis, the study where radiotherapy demonstrated the least benefit (31/122 LRs with radiotherapy versus 6/29 without), provided a pooled estimate of 5-year LR relative risk which favored radiotherapy and the 95% confidence interval did not include the null result (relative risk = 0.47; 95% CI 0.22–0.99).

DISCUSSION

This systematic review identified unique 7 retrospective cohort studies which evaluated whether radiotherapy reduces LR in T3N0 rectal cancer patients managed with TME. Following an assessment of each studies’ risk of bias, five were included in a random-effects meta-analysis. This assessment of 932 patients observed a point estimate which signaled a benefit for radiotherapy that did not approach statistical significance. To the best of our knowledge, this is the first study to date to perform a systematic review or meta-analysis regarding the benefit of radiotherapy specific to the T3N0 rectal cancer patient population.

Existing randomized evidence does not offer a comparison of TME with or without radiotherapy specific to this group. The Dutch trial was the only trial to randomize patients treated with a TME technique by receipt of radiotherapy (versus no radiotherapy). The Dutch trial’s 492-patient clinically staged Stage II subgroup (i.e., T3N0 and T4N0) did not estimate a significant 5-year LR benefit (5.3% vs. 7.2%, p = 0.331) [5]. As a subgroup analysis and secondary endpoint, no strong conclusions should be drawn from this finding due to a lack of appropriate power to detect a possible effect. There are additional issues limiting indirect comparisons of the Dutch’s population to this meta-analysis – the Dutch’s participants were not allowed chemotherapy while adjuvant chemotherapy was either provided or offered for 909/1044 (87%) of this meta-analysis’ participants. Thus, it is unclear if all stage II patients are at sufficient risk of locoregional dissemination to merit radiotherapy’s modest absolute benefit and known adverse effects [2934].

Two SEER-based population-level studies attempted to clarify this question for T3N0 patients [35, 36]. The first explored radiotherapy’s possible benefit in 4724 rectal cancer patients, observing a potentially statistically significant benefit in cancer-specific survival among patients receiving adjuvant radiotherapy compared to those that did not (HR = 0.69, 95% CI = 0.58–0.82, p < 0.001). Though this was not observed in those receiving neoadjuvant radiotherapy (HR = 0.86, 95% CI = 0.72–1.04, p = 0.13) [35]. A second study only observed a benefit with radiotherapy in those with high-risk disease, defined as an age ≥70 or the combination of grade III/IV disease with less than 12 nodes resected [36]. Issues which affect population-based studies may be prevalent in these studies, including the inability to control for all relevant confounders or selection bias. Moreover, they did not ascertain whether patients underwent TME.

Prospective evidence includes three observational series which used MRI to direct management of early rectal cancer patients, including cT3N0 disease [1315]. As all reported acceptably low LR rates in patients foregoing radiotherapy, if deemed low-risk by MRI, they could be interpreted as suggested scenarios where radiotherapy can selectively omitted. Results specific to T3N0 patients were not uniformly reported.

Among randomized evidence, the maturing PROSPECT compares neoadjuvant approaches for cT2N1 and cT3N0-1 disease, chemoradiotherapy versus multiagent chemotherapy with selective chemoradiotherapy, [37]. Elsewise, the existing generation of randomized radiotherapy evidence is either exploring intensification via a total neoadjuvant approach [3840] and/or de-intensification by sparing patients a TME [41, 42]. Studies investigating a total neoadjuvant approach did not randomize radiotherapy’s provision, barring any further signal to assist with this meta-analysis’ question.

While the best available randomized data, upcoming evidence, nor this meta-analysis sufficiently support the consideration of radiotherapy for all T3N0 disease that will receive a good quality TME, prospective observational evidence has suggested low-risk patients can be selected to forego radiotherapy while high-risk patients have a LR rate which could benefit from radiotherapy. A strength of this meta-analysis is identifying all available comparable studies that specifically reported on T3N0 rectal cancer. Modest support for this result were moderately consistent results (I2 = 0.41) and acceptable risks of bias for cohort studies (as per the NOS scores). Given that there is nodal positivity observed in approximately 20% of clinically staged T3N0 cases [43], it was reassuring to observe that radiotherapy did not clearly have a benefit in the two populations managed neoadjuvantly [26, 28], relative to the three studies where clinical decision making had the benefit of definitive surgical pathology [22, 25, 27].

There are significant limitations to this meta-analysis. Foremost is the quantity and quality of the data – ultimately there are only 932 participants among 5 retrospective cohort studies. The NOS evaluation also does not adequately address concerns of Comparability, as there is an increased risk of LR with a positive margin or adjuvant radiotherapy [44]. As per our GRADE evaluation, this would limit the certainty of this meta-analysis’ estimated point estimate and range of error to Low. Further concerns relate to generalizability regarding the meta-analysis population’s ethnicity, receipt of chemotherapy, presence of a threatened margin, mixed inclusion of adjuvant and neoadjuvant therapies, and the broad confidence interval.

Though all but one study reported margin status, neither neoadjuvant study directed management based on a threatened margin and two of three adjuvant studies exclusively treated margin negative patients. The exception is one study offered adjuvant chemoradiotherapy to comparator participants with positive margins [25]. As randomized evidence supports that neoadjuvant radiotherapy downsizes disease and secondary to the assessment of margin status in this meta-analysis’ studies, our results should not be generalized to patients where surgical margins are threatened. [4547].

There may also be regional generalizability concerns as four of the five studies were performed in continental Asia [22, 2527]. There is limited evidence to provide meaningful guidance as to whether Asian American populations have different outcomes from other Americans nor any other studies that have compared localized rectal cancer outcomes in continental Asia to elsewhere [48, 49]. Unlike the single North American study [21, 28], the participants in the Asian studies also received either concurrent or multi-agent chemotherapy – further miring comparability.

Though it was reassuring to see similar outcomes being observed in the two included studies which exclusively included participants with low rectal cancers, this benefit was not observed homogeneously throughout the analyzed studies [21, 26]. In contrast, Baek et al’s. study of Korean T3N0 patients noted that either a low rectal cancer (<5 cm from the anal verge) or a close surgical margin, signaled for a possible benefit with concurrent chemoradiotherapy [27].

Translation of this data is further limited by the diverse integration of adjuvant chemotherapy evidence in rectal cancer. Generalizability issues include that randomized colorectal cancer chemotherapy trials often excluded rectal cancer patients to avoid any confounding toxicity signals from radiotherapy [50], studies exclusive to rectal cancer did not clearly control for TME, outcomes specific to the T3N0 population were not reported, nor was LR reported [51, 52]. The interpretation of the randomized evidence has thus prompted varied provision of adjuvant chemotherapy for intermediate risk rectal cancer – including T3N0 patients [5355]. Given that adjuvant chemotherapy was offered routinely in 5 out of 6 of this meta-analysis’ studies, it would be difficult to apply this study’s results to patients not receiving systemic therapy.

A modestly sized randomized control trial would have reasonable power to resolve this question. Allowing for a one-sided evaluation (α = 0.05; β = 0.8) with this meta-analysis’ point estimate for benefit (HR = 0.63), a one-to-one randomized study would only need to treat 120 participants. This increases to 139 participants if the Dutch TME’s Stage II subgroup data was used (HR = 0.71). To address other confounders, controlling for chemotherapy use and only including patients with unthreatened margins would seem prudent. Another practical approach, albeit with lower methodological rigor, would be an ad-hoc analysis of radiotherapy’s benefit among the Dutch TME’s T3N0 participants.

With low certainty, this meta-analysis observed a non-significant benefit with radiotherapy to 5-year LR rates among T3N0 rectal cancer patients that received a TME. Until a pragmatically sized randomized control trial is completed, our research adds a layer of data to facilitate informed and personalized treatment decisions for T3N0 rectal cancer patients, albeit with potential significant bias from solely relying on retrospective cohort studies.

Materials and Methods

Systematic review and meta-analysis were performed and reported as per the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [56]. A study protocol was registered to the PROSPERO data base (CRD42020216058). Meta-analysis of Observational Studies in Epidemiology and PRISMA checklists were reported [57]. Four oncologists (AB, JF, MJK, MT) performed title and abstract screening, assessment of eligibility criteria, data extraction, and assessments of bias. Two authors were involved in either reviewing or screening any given item. A third author resolved inconsistencies, except in the case of data extraction. All authors reviewed and confirmed correct data extraction.

Search strategy and selection criteria

A search strategy was developed in collaboration with professional librarian services (Countway Library, Boston, MA, USA). The search was restricted to English language literature reported in PubMed and EMBASE from inception to October 18, 2020. Four search hedges were utilized requiring a description of radiotherapy, rectal cancer, an interventional study, and a surgical resection. The supplement details the full search strategy (Supplementary Materials).

Inclusion criteria screening and full text assessment was performed via the Covidence platform (Melbourne, Australia). Full texts were then assessed for eligibility criteria. Included studies had their reference lists considered for potential studies that would meet inclusion criteria.

Eligibility criteria

Studies were considered eligible if they published local or LR rates in a T3N0M0 rectal cancer population where all participants were explicitly stated to have had a TME, if they had an intervention arm which received radiotherapy, and if they had a comparator arm which did not receive radiotherapy. Studies which published a Duke’s staging equivalent to T3N0M0 were eligible. Studies could clinically and/or pathologically stage their patients to qualify for the study. Radiotherapy of any dose and fractionation combination, with or without concurrent chemotherapy, qualified as receiving radiotherapy.

Data extraction

The following data was extracted into a dedicated database: study characteristics, baseline participant demographics, accrual dates, treatment modalities, confirmation that TME was performed, follow-up duration, LR, and OS rates. Outcome event rates were extracted for all reported time points. Inconsistencies were resolved by discussion.

Outcomes

The primary outcome of this meta-analysis was LR, defined as a recurrence in the pelvis, with or without other distant disease. Thus, LR was an aggregate outcome for locoregional control when locoregional control was also reported. A priori, it was decided to extract all reported LR rates then present the most commonly reported time-point among the eligible studies as the LR time-point. This reduced the risks associated with interpolating data, which could have occurred if we had specified a time-point that was ultimately not commonly reported.

Assessment of quality (certainty and risk of bias)

The Newcastle Ottawa Scale (NOS) was used to systematically evaluate each eligible study’s risk of bias [58]. The NOS provided a framework to assess cohort studies, evaluating their selection of the exposed and non-exposed, ascertainment of the exposure, comparability of the cohorts based on methodological considerations, assessment of the outcome, duration of follow-up, and the adequacy of follow-up. When assessing comparability, the two most relevant factors must be selected by investigators a priori. Studies were investigated if they controlled for either tumor location within the rectum or receipt of multiagent chemotherapy. The Grades of Recommendation, Assessment, Development, and Evaluation Working Group system (GRADE) was used to grade the certainty of the result based on the evidence’s risk of bias, inconsistency, indirectness, imprecision, publication bias, large effects, dose response, and opposing plausible residual bias and confounding [59]. Two authors (JF, MJK) performed GRADE assessment was; discrepant opinions were resolved through discussion. Certainty and risk of bias assessment required review of each study’s full text. Following quality assessment, attempts to contact corresponding author(s) for each included study of the meta-analysis was attempted to resolve any identified uncertainties.

Data synthesis and analysis

For each trial, if they were not reported, 5-year LR rates were calculated. These values were used as inputs to calculate weight pooled treatment effects and a 95% confidence interval (CI) using a random-effects meta-analysis. Variance was estimated by using the DerSimonian and Laird approach.

I2 statistics and forest plots were used to assess for heterogeneity across studies. Forest plots facilitated an influence analysis where each study was removed sequential and a cumulative random-effects meta-analysis by the date of publication. Ad hoc sensitivity analyses included repeating the influence analysis without a specific study that had questionable adherence to implementing TME surgery [21]. Publication bias was evaluated by Egger and Funnel plots.

Abbreviations

CI: Confidence Interval; GRADE: Grades of Recommendation, Assessment, Development, and Evaluation Working Group system; Gy: Gray; LR: Local Recurrence; OS: Overall Survival; MRI: Magnetic Resonance Imaging; NOS: Newcastle Ottawa Scale; PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses; TME: Total Mesorectal Excision; RR: Relative Risk.

Data availability

Data not directly retrievable from cited texts has been included in the included supplementary materials, specifically the Newcastle Ottawa Scale scores. Code used to clean the data and perform the included analyses will not be publicly available.

Author contributions

Drs. Bang, Fabregas, Kucharczyk, and Tjong shared similar roles in the project’s conceptualization, literature screening, data extraction, and analysis. Drs. Bang, Fabregas, and Kucharczyk synthesized the data for separate conference proceedings and/or publication. Dr. Papatheodoru provided review of the Methods, review of the statistical assessment, and contributed to producing supplementary figures. All authors provided substantial contributions to the ultimate manuscript, either through composition or review.

ACKNOWLEDGMENTS

We acknowledge Dr. Paul Bains (Countway Library, Harvard Medical School), who provided guidance with our search strategy, and Dr. Marko Simunovic (Juravinski Hospital Cancer Centre, McMaster University), who provided guidance in manuscript preparation.

CONFLICTS OF INTEREST

No perceived conflicts of interest are reported. Potential conflicts of interest include Dr. Kucharczyk’s income related to prostate cancer treatment and/or research, including either consultancy fees or honoraria from Abbvie, Ferring Pharmaceuticals, Janssen Pharmaceutica, McKesson, Palette Life Sciences, TerSera Therapeutics, and Verity Pharmaceuticals.

References

1. Cedermark B, Dahlberg M, Glimelius B, Påhlman L, Rutqvist LE, Wilking N, and Swedish Rectal Cancer Trial. Improved survival with preoperative radiotherapy in resectable rectal cancer. N Engl J Med. 1997; 336:980–87. https://doi.org/10.1056/NEJM199704033361402. [PubMed].

2. Heald RJ, Husband EM, Ryall RD. The mesorectum in rectal cancer surgery--the clue to pelvic recurrence? Br J Surg. 1982; 69:613–16. https://doi.org/10.1002/bjs.1800691019. [PubMed].

3. MacFarlane JK, Ryall RD, Heald RJ. Mesorectal excision for rectal cancer. Lancet. 1993; 341:457–60. https://doi.org/10.1016/0140-6736(93)90207-w. [PubMed].

4. Kapiteijn E, Marijnen CA, Nagtegaal ID, Putter H, Steup WH, Wiggers T, Rutten HJ, Pahlman L, Glimelius B, van Krieken JH, Leer JW, van de Velde CJ, and Dutch Colorectal Cancer Group. Preoperative radiotherapy combined with total mesorectal excision for resectable rectal cancer. N Engl J Med. 2001; 345:638–46. https://doi.org/10.1056/NEJMoa010580. [PubMed].

5. Peeters KC, Marijnen CA, Nagtegaal ID, Kranenbarg EK, Putter H, Wiggers T, Rutten H, Pahlman L, Glimelius B, Leer JW, van de Velde CJ, and Dutch Colorectal Cancer Group. The TME trial after a median follow-up of 6 years: increased local control but no survival benefit in irradiated patients with resectable rectal carcinoma. Ann Surg. 2007; 246:693–701. https://doi.org/10.1097/01.sla.0000257358.56863.ce. [PubMed].

6. van Gijn W, Marijnen CA, Nagtegaal ID, Kranenbarg EM, Putter H, Wiggers T, Rutten HJ, Påhlman L, Glimelius B, van de Velde CJ, and Dutch Colorectal Cancer Group. Preoperative radiotherapy combined with total mesorectal excision for resectable rectal cancer: 12-year follow-up of the multicentre, randomised controlled TME trial. Lancet Oncol. 2011; 12:575–82. https://doi.org/10.1016/S1470-2045(11)70097-3. [PubMed].

7. Wo JY, Mamon HJ, Ryan DP, Hong TS. T3N0 rectal cancer: radiation for all? Semin Radiat Oncol. 2011; 21:212–19. https://doi.org/10.1016/j.semradonc.2011.02.007. [PubMed].

8. Sebag-Montefiore D, Stephens RJ, Steele R, Monson J, Grieve R, Khanna S, Quirke P, Couture J, de Metz C, Myint AS, Bessell E, Griffiths G, Thompson LC, Parmar M. Preoperative radiotherapy versus selective postoperative chemoradiotherapy in patients with rectal cancer (MRC CR07 and NCIC-CTG C016): a multicentre, randomised trial. Lancet. 2009; 373:811–20. https://doi.org/10.1016/S0140-6736(09)60484-0. [PubMed].

9. Bentzen SM, Balslev I, Pedersen M, Teglbjaerg PS, Hanberg-Sørensen F, Bone J, Jacobsen NO, Sell A, Overgaard J, Bertelsen K. Time to loco-regional recurrence after resection of Dukes’ B and C colorectal cancer with or without adjuvant postoperative radiotherapy. A multivariate regression analysis. Br J Cancer. 1992; 65:102–7. https://doi.org/10.1038/bjc.1992.19. [PubMed].

10. Stocchi L, Nelson H, Sargent DJ, O’Connell MJ, Tepper JE, Krook JE, Beart R Jr, and North Central Cancer Treatment Group. Impact of surgical and pathologic variables in rectal cancer: a United States community and cooperative group report. J Clin Oncol. 2001; 19:3895–902. https://doi.org/10.1200/JCO.2001.19.18.3895. [PubMed].

11. Luna-Pérez P, Bustos-Cholico E, Alvarado I, Maffuz A, Rodríguez-Ramírez S, Gutiérrez de la Barrera M, Labastida S. Prognostic significance of circumferential margin involvement in rectal adenocarcinoma treated with preoperative chemoradiotherapy and low anterior resection. J Surg Oncol. 2005; 90:20–25. https://doi.org/10.1002/jso.20232. [PubMed].

12. Gunderson LL, Sargent DJ, Tepper JE, O’Connell MJ, Allmer C, Smalley SR, Martenson JA, Haller DG, Mayer RJ, Rich TA, Ajani JA, Macdonald JS, Goldberg RM. Impact of T and N substage on survival and disease relapse in adjuvant rectal cancer: a pooled analysis. Int J Radiat Oncol Biol Phys. 2002; 54:386–96. https://doi.org/10.1016/s0360-3016(02)02945-0. [PubMed].

13. Kennedy ED, Simunovic M, Jhaveri K, Kirsch R, Brierley J, Drolet S, Brown C, Vos PM, Xiong W, MacLean T, Kanthan S, Stotland P, Raphael S, et al. Safety and Feasibility of Using Magnetic Resonance Imaging Criteria to Identify Patients With “Good Prognosis” Rectal Cancer Eligible for Primary Surgery: The Phase 2 Nonrandomized QuickSilver Clinical Trial. JAMA Oncol. 2019; 5:961–66. https://doi.org/10.1001/jamaoncol.2019.0186. [PubMed].

14. Ruppert R, Kube R, Strassburg J, Lewin A, Baral J, Maurer CA, Sauer J, Junginger T, Hermanek P, Merkel S, and other members of the OCUM Group. Avoidance of Overtreatment of Rectal Cancer by Selective Chemoradiotherapy: Results of the Optimized Surgery and MRI-Based Multimodal Therapy Trial. J Am Coll Surg. 2020; 231:413–25.e2. https://doi.org/10.1016/j.jamcollsurg.2020.06.023. [PubMed].

15. Battersby NJ, How P, Moran B, Stelzner S, West NP, Branagan G, Strassburg J, Quirke P, Tekkis P, Pedersen BG, Gudgeon M, Heald B, Brown G, and MERCURY II Study Group. Prospective Validation of a Low Rectal Cancer Magnetic Resonance Imaging Staging System and Development of a Local Recurrence Risk Stratification Model: The MERCURY II Study. Ann Surg. 2016; 263:751–60. https://doi.org/10.1097/SLA.0000000000001193. [PubMed].

16. National Comprehensive Cancer Network. Rectal Cancer: NCCN Clinical Practice Guidelines in Oncology. 2020. https://www.nccn.org/guidelines/category_1.

17. Martling AL, Holm T, Rutqvist LE, Moran BJ, Heald RJ, Cedemark B. Effect of a surgical training programme on outcome of rectal cancer in the County of Stockholm. Stockholm Colorectal Cancer Study Group, Basingstoke Bowel Cancer Research Project. Lancet. 2000; 356:93–96. https://doi.org/10.1016/s0140-6736(00)02469-7. [PubMed].

18. Cedermark B, Johansson H, Rutqvist LE, Wilking N. The Stockholm I trial of preoperative short term radiotherapy in operable rectal carcinoma. A prospective randomized trial. Stockholm Colorectal Cancer Study Group. Cancer. 1995; 75:2269–75. https://doi.org/10.1002/1097-0142(19950501)75:9<2269::aid-cncr2820750913>3.0.co;2-i. [PubMed].

19. Martling A, Holm T, Johansson H, Rutqvist LE, Cedermark B, and Stockholm Colorectal Cancer Study Group. The Stockholm II trial on preoperative radiotherapy in rectal carcinoma: long-term follow-up of a population-based study. Cancer. 2001; 92:896–902. https://doi.org/10.1002/1097-0142(20010815)92:4<896::aid-cncr1398>3.0.co;2-r. [PubMed].

20. Phang PT, Woods R, Brown CJ, Raval M, Cheifetz R, Kennecke H. Effect of systematic education courses on rectal cancer treatments in a population. Am J Surg. 2011; 201:640–44. https://doi.org/10.1016/j.amjsurg.2011.01.008. [PubMed].

21. Kennecke H, Lim H, Woods R, McGahan CE, Hay J, Raval MJ, Johal B. Outcomes of unselected patients with pathologic T3N0 rectal cancer. Radiother Oncol. 2012; 105:214–19. https://doi.org/10.1016/j.radonc.2012.09.021. [PubMed].

22. Kim JS, Kim NK, Min BS, Hur H, Ahn JB, Keum KC. Adjuvant radiotherapy following total mesorectal excision for stage IIA rectal cancer: is it beneficial? Int J Colorectal Dis. 2010; 25:1103–10. https://doi.org/10.1007/s00384-010-0970-1. [PubMed].

23. Wu JX, Wang Y, Chen N, Chen LC, Bai PG, Pan JJ. In the era of total mesorectal excision: adjuvant radiotherapy may be unnecessary for pT3N0 rectal cancer. Radiat Oncol. 2014; 9:159. https://doi.org/10.1186/1748-717X-9-159. [PubMed].

24. Agas RAF, Co LBA, Jacinto JCKM, Yu KKL, Sogono PG, Bacorro WR, Sy Ortin TT. Neoadjuvant Radiotherapy Versus No Radiotherapy for Stage IV Rectal Cancer: a Systematic Review and Meta-analysis. J Gastrointest Cancer. 2018; 49:389–401. https://doi.org/10.1007/s12029-018-0141-0. [PubMed].

25. Lin Y, Lin H, Xu Z, Zhou S, Chi P. Comparative Outcomes of Preoperative Chemoradiotherapy and Selective Postoperative Chemoradiotherapy in Clinical Stage T3N0 Low and Mid Rectal Cancer. J Invest Surg. 2019; 32:679–87. https://doi.org/10.1080/08941939.2018.1469696. [PubMed].

26. Peng HH, Zhou XH, Zhou TC, Qiu XS, You KY. Tumor location as an indication for adjuvant radiotherapy in pT3N0 rectal cancer after surgery. Radiat Oncol. 2019; 14:8. https://doi.org/10.1186/s13014-019-1206-3. [PubMed].

27. Baek JY, Yu JI, Park HC, Choi DH, Yoo GS, Lee WY, Yun SH, Cho YB, Park YA, Kim HC, Nam H. Determining whether postoperative chemoradiotherapy is required in patients with pathologic T3N0 rectal cancer with negative resection margin. Int J Colorectal Dis. 2020; 35:2239–48. https://doi.org/10.1007/s00384-020-03701-z. [PubMed].

28. Delaney CP, Lavery IC, Brenner A, Hammel J, Senagore AJ, Noone RB, Fazio VW. Preoperative radiotherapy improves survival for patients undergoing total mesorectal excision for stage T3 low rectal cancers. Ann Surg. 2002; 236:203–7. https://doi.org/10.1097/00000658-200208000-00008. [PubMed].

29. Birgisson H, Påhlman L, Gunnarsson U, Glimelius B. Late adverse effects of radiation therapy for rectal cancer - a systematic overview. Acta Oncol. 2007; 46:504–16. https://doi.org/10.1080/02841860701348670. [PubMed].

30. Pietrzak L, Bujko K, Nowacki MP, Kepka L, Oledzki J, Rutkowski A, Szmeja J, Kladny J, Dymecki D, Wieczorek A, Pawlak M, Lesniak T, Kowalska T, Richter P, and Polish Colorectal Study Group. Quality of life, anorectal and sexual functions after preoperative radiotherapy for rectal cancer: report of a randomised trial. Radiother Oncol. 2007; 84:217–25. https://doi.org/10.1016/j.radonc.2007.07.007. [PubMed].

31. Stephens RJ, Thompson LC, Quirke P, Steele R, Grieve R, Couture J, Griffiths GO, Sebag-Montefiore D. Impact of short-course preoperative radiotherapy for rectal cancer on patients’ quality of life: data from the Medical Research Council CR07/National Cancer Institute of Canada Clinical Trials Group C016 randomized clinical trial. J Clin Oncol. 2010; 28:4233–39. https://doi.org/10.1200/JCO.2009.26.5264. [PubMed].

32. Brændengen M, Tveit KM, Hjermstad MJ, Johansson H, Berglund Å, Brandberg Y, Glimelius B. Health-related quality of life (HRQoL) after multimodal treatment for primarily non-resectable rectal cancer. Long-term results from a phase III study. Eur J Cancer. 2012; 48:813–19. https://doi.org/10.1016/j.ejca.2011.06.035. [PubMed].

33. Wiltink LM, Chen TY, Nout RA, Kranenbarg EM, Fiocco M, Laurberg S, van de Velde CJ, Marijnen CA. Health-related quality of life 14 years after preoperative short-term radiotherapy and total mesorectal excision for rectal cancer: report of a multicenter randomised trial. Eur J Cancer. 2014; 50:2390–98. https://doi.org/10.1016/j.ejca.2014.06.020. [PubMed].

34. Sun W, Dou R, Chen J, Lai S, Zhang C, Ruan L, Kang L, Deng Y, Lan P, Wang L, Wang J. Impact of Long-Course Neoadjuvant Radiation on Postoperative Low Anterior Resection Syndrome and Quality of Life in Rectal Cancer: Post Hoc Analysis of a Randomized Controlled Trial. Ann Surg Oncol. 2019; 26:746–55. https://doi.org/10.1245/s10434-018-07096-8. [PubMed].

35. Peng LC, Milsom J, Garrett K, Nandakumar G, Coplowitz S, Parashar B, Nori D, Clifford Chao KS, Wernicke AG. Surveillance, epidemiology, and end results-based analysis of the impact of preoperative or postoperative radiotherapy on survival outcomes for T3N0 rectal cancer. Cancer Epidemiol. 2014; 38:73–78. https://doi.org/10.1016/j.canep.2013.12.008. [PubMed].

36. Huang YX, Lin YZ, Li JL, Zhang XQ, Tang LR, Zhuang QY, Lin FF, Lin XJ, Wu JX. Role of postoperative radiotherapy in pT3N0 rectal cancer: A risk-stratification system based on population analyses. Cancer Med. 2019; 8:1024–33. https://doi.org/10.1002/cam4.1991. [PubMed].

37. Bossé D, Mercer J, Raissouni S, Dennis K, Goodwin R, Jiang D, Powell E, Kumar A, Lee-Ying R, Price-Hiller J, Heng DY, Tang PA, MacLean A, et al. PROSPECT Eligibility and Clinical Outcomes: Results From the Pan-Canadian Rectal Cancer Consortium. Clin Colorectal Cancer. 2016; 15:243–49. https://doi.org/10.1016/j.clcc.2016.02.003. [PubMed].

38. Kasi A, Abbasi S, Handa S, Al-Rajabi R, Saeed A, Baranda J, Sun W. Total Neoadjuvant Therapy vs Standard Therapy in Locally Advanced Rectal Cancer: A Systematic Review and Meta-analysis. JAMA Netw Open. 2020; 3:e2030097. https://doi.org/10.1001/jamanetworkopen.2020.30097. [PubMed].

39. Bahadoer RR, Dijkstra EA, van Etten B, Marijnen CAM, Putter H, Kranenbarg EM, Roodvoets AGH, Nagtegaal ID, Beets-Tan RGH, Blomqvist LK, Fokstuen T, Ten Tije AJ, Capdevila J, et al, and RAPIDO collaborative investigators. Short-course radiotherapy followed by chemotherapy before total mesorectal excision (TME) versus preoperative chemoradiotherapy, TME, and optional adjuvant chemotherapy in locally advanced rectal cancer (RAPIDO): a randomised, open-label, phase 3 trial. Lancet Oncol. 2021; 22:29–42. https://doi.org/10.1016/S1470-2045(20)30555-6. [PubMed].

40. Conroy T, Bosset JF, Etienne PL, Rio E, François É, Mesgouez-Nebout N, Vendrely V, Artignan X, Bouché O, Gargot D, Boige V, Bonichon-Lamichhane N, Louvet C, et al, and Unicancer Gastrointestinal Group and Partenariat de Recherche en Oncologie Digestive (PRODIGE) Group. Neoadjuvant chemotherapy with FOLFIRINOX and preoperative chemoradiotherapy for patients with locally advanced rectal cancer (UNICANCER-PRODIGE 23): a multicentre, randomised, open-label, phase 3 trial. Lancet Oncol. 2021; 22:702–15. https://doi.org/10.1016/S1470-2045(21)00079-6. [PubMed].

41. Garcia-Aguilar J, Patil S, Kim JK, Yuval JB, Thompson H, Verheij F, Lee M, Saltz LB, and on behalf of the OPRA Consortium. Preliminary results of the organ preservation of rectal adenocarcinoma (OPRA) trial. J Clin Oncol. 2020; 38:4008. https://doi.org/10.1200/JCO.2020.38.15_suppl.4008.

42. Rullier E, Vendrely V, Asselineau J, Rouanet P, Tuech JJ, Valverde A, de Chaisemartin C, Rivoire M, Trilling B, Jafari M, Portier G, Meunier B, Sieleznieff I, et al. Organ preservation with chemoradiotherapy plus local excision for rectal cancer: 5-year results of the GRECCAR 2 randomised trial. Lancet Gastroenterol Hepatol. 2020; 5:465–74. https://doi.org/10.1016/S2468-1253(19)30410-8. [PubMed].

43. Guillem JG, Díaz-González JA, Minsky BD, Valentini V, Jeong SY, Rodriguez-Bigas MA, Coco C, Leon R, Hernandez-Lizoain JL, Aristu JJ, Riedel ER, Nitti D, Wong WD, Pucciarelli S. cT3N0 rectal cancer: potential overtreatment with preoperative chemoradiotherapy is warranted. J Clin Oncol. 2008; 26:368–73. https://doi.org/10.1200/JCO.2007.13.5434. [PubMed].

44. Sauer R, Liersch T, Merkel S, Fietkau R, Hohenberger W, Hess C, Becker H, Raab HR, Villanueva MT, Witzigmann H, Wittekind C, Beissbarth T, Rödel C. Preoperative versus postoperative chemoradiotherapy for locally advanced rectal cancer: results of the German CAO/ARO/AIO-94 randomized phase III trial after a median follow-up of 11 years. J Clin Oncol. 2012; 30:1926–33. https://doi.org/10.1200/JCO.2011.40.1836. [PubMed].

45. Ngan SY, Burmeister B, Fisher RJ, Solomon M, Goldstein D, Joseph D, Ackland SP, Schache D, McClure B, McLachlan SA, McKendrick J, Leong T, Hartopeanu C, et al. Randomized trial of short-course radiotherapy versus long-course chemoradiation comparing rates of local recurrence in patients with T3 rectal cancer: Trans-Tasman Radiation Oncology Group trial 01.04. J Clin Oncol. 2012; 30:3827–33. https://doi.org/10.1200/JCO.2012.42.9597. [PubMed].

46. Erlandsson J, Holm T, Pettersson D, Berglund Å, Cedermark B, Radu C, Johansson H, Machado M, Hjern F, Hallböök O, Syk I, Glimelius B, Martling A. Optimal fractionation of preoperative radiotherapy and timing to surgery for rectal cancer (Stockholm III): a multicentre, randomised, non-blinded, phase 3, non-inferiority trial. Lancet Oncol. 2017; 18:336–46. https://doi.org/10.1016/S1470-2045(17)30086-4. [PubMed].

47. Bujko K, Nowacki MP, Nasierowska-Guttmejer A, Michalski W, Bebenek M, Kryj M. Long-term results of a randomized trial comparing preoperative short-course radiotherapy with preoperative conventionally fractionated chemoradiation for rectal cancer. Br J Surg. 2006; 93:1215–23. https://doi.org/10.1002/bjs.5506. [PubMed].

48. Le H, Ziogas A, Taylor TH, Lipkin SM, Zell JA. Survival of distinct Asian groups among colorectal cancer cases in California. Cancer. 2009; 115:259–70. https://doi.org/10.1002/cncr.24034. [PubMed].

49. Zhang C, Zhang C, Wang Q, Li Z, Lin J, Wang H. Differences in Stage of Cancer at Diagnosis, Treatment, and Survival by Race and Ethnicity Among Leading Cancer Types. JAMA Netw Open. 2020; 3:e202950. https://doi.org/10.1001/jamanetworkopen.2020.2950. [PubMed].

50. Carvalho C, Glynne-Jones R. Challenges behind proving efficacy of adjuvant chemotherapy after preoperative chemoradiation for rectal cancer. Lancet Oncol. 2017; 18:e354–63. https://doi.org/10.1016/S1470-2045(17)30346-7. [PubMed].

51. Wolmark N, Wieand HS, Hyams DM, Colangelo L, Dimitrov NV, Romond EH, Wexler M, Prager D, Cruz AB Jr, Gordon PH, Petrelli NJ, Deutsch M, Mamounas E, et al. Randomized trial of postoperative adjuvant chemotherapy with or without radiotherapy for carcinoma of the rectum: National Surgical Adjuvant Breast and Bowel Project Protocol R-02. J Natl Cancer Inst. 2000; 92:388–96. https://doi.org/10.1093/jnci/92.5.388. [PubMed].

52. Bujko K, Glimelius B, Valentini V, Michalski W, Spalek M. Postoperative chemotherapy in patients with rectal cancer receiving preoperative radio(chemo)therapy: A meta-analysis of randomized trials comparing surgery ± a fluoropyrimidine and surgery + a fluoropyrimidine ± oxaliplatin. Eur J Surg Oncol. 2015; 41:713–23. https://doi.org/10.1016/j.ejso.2015.03.233. [PubMed].

53. Glynne-Jones R, Wyrwicz L, Tiret E, Brown G, Rödel C, Cervantes A, Arnold D, and ESMO Guidelines Committee. Rectal cancer: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann Oncol. 2017; 28:iv22–40. https://doi.org/10.1093/annonc/mdx224. [PubMed].

54. Costas-Chavarri A, Nandakumar G, Temin S, Lopes G, Cervantes A, Cruz Correa M, Engineer R, Hamashima C, Ho GF, Huitzil FD, Malekzadeh Moghani M, Sharara AI, Stern MC, et al. Treatment of Patients With Early-Stage Colorectal Cancer: ASCO Resource-Stratified Guideline. J Glob Oncol. 2019; 5:1–19. https://doi.org/10.1200/JGO.18.00214. [PubMed].

55. You YN, Hardiman KM, Bafford A, Poylin V, Francone TD, Davis K, Paquette IM, Steele SR, Feingold DL, and On Behalf of the Clinical Practice Guidelines Committee of the American Society of Colon and Rectal Surgeons. The American Society of Colon and Rectal Surgeons Clinical Practice Guidelines for the Management of Rectal Cancer. Dis Colon Rectum. 2020; 63:1191–222. https://doi.org/10.1097/DCR.0000000000001762. [PubMed].

56. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R, Glanville J, Grimshaw JM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021; 372:n71. https://doi.org/10.1136/bmj.n71. [PubMed].

57. Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, Moher D, Becker BJ, Sipe TA, Thacker SB. Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA. 2000; 283:2008–12. https://doi.org/10.1001/jama.283.15.2008. [PubMed].

58. Wells G, Shea B, O’Connell D, Peterson J, Welch V, Losos M, Tugwell P. The Newcastle-Ottawa Scale (NOS) for Assessing the Quality of Non-Randomized Studies in Meta-Analysis. Oxford. 2000.

59. Schünemann HJ, Higgins JPT, Vist GE, Glasziou P, Akl EA, Skoetz N, Guyatt GH, and on behalf of the Cochrane GRADEing Methods Group (formerly Applicability and Recommendations Methods Group) and the Cochrane Statistical Methods Group. Chapter 14: Completing ‘Summary of findings’ tables and grading the certainty of the evidence’. Cochrane Handbook for Systematic Reviews of Interventions version 6.2: Cochrane Training. 2021. http://www.training.cochrane.org/handbook.

60. Howick J, Chalmers I, Glasziou P, Greenhalgh T, Heneghan C, Liberati A, Moschetti I, Phillips B, Thornton H. The 2011 Oxford CEBM Evidence Levels of Evidence (Introductory Document). Oxford Centre for Evidence-Based Medicine. 2011. https://www.cebm.ox.ac.uk/resources/levels-of-evidence/ocebm-levels-of-evidence.


Creative Commons License All site content, except where otherwise noted, is licensed under a Creative Commons Attribution 4.0 License.
PII: 28280