Research Papers:

Prognostic nomograms for patients with resectable hepatocelluar carcinoma incorporating systemic inflammation and tumor characteristics

PDF |  HTML  |  How to cite

Oncotarget. 2016; 7:80783-80793. https://doi.org/10.18632/oncotarget.13038

Metrics: PDF 1796 views  |   HTML 2596 views  |   ?  

Junyi Shen, Linye He, Chuan Li, Tianfu Wen _, Weixia Chen, Changli Lu, Lvnan Yan, Bo Li and Jiayin Yang


Junyi Shen1, Linye He1, Chuan Li1, Tianfu Wen1, Weixia Chen2, Changli Lu3, Lvnan Yan1, Bo Li1, Jiayin Yang1

1Department of Liver Surgery and Liver Transplantation Center, West China Hospital, Sichuan University, Chengdu, China

2Department of Radiology, West China Hospital, Sichuan University, Chengdu, China

3Department of Pathology, West China Hospital, Sichuan University, Chengdu, China

Correspondence to:

Tianfu Wen, email: [email protected]

Keywords: nomogram, prognosis, HCC, hepatectomy

Received: July 18, 2016     Accepted: October 28, 2016     Published: November 03, 2016


Background: The model to predict the prognosis of resectable hepatocelluar carcinoma (HCC) has not been determined. Methods: Predictors were selected using Cox model. Nomograms were generated in the training set and validated in the validation set. The predictive ability of the nomogram was determined by concordance index and calibration curve. Results: Independent factors for overall survival including alpha-fetoprotein level (hazard ratio (HR):1.292), tumor size (HR:1.092), tumor number (HR:1.472), microvascular invasion (HR:1.660), neutrophil to lymphocyte count ratio (NLR) (HR:1.428), major vascular invasion (HR:2.485) and satellite lesions(HR:1.392) were selected into the nomogram for survival. The c-index in the training set and validation set were 0.767 and 0.719, respectively, which were statistically higher than those of the four conventional staging systems.(Barcelona Clinic Liver Cancer: 0.644 and 0.609; the seventh American Joint Committee on Cancer: 0.678 and 0.674; Cancer of the Liver Italian Program: 0.692 and 0.648; Hong Kong Liver Cancer: 0.689 and 0.639, p < 0.001 for all). A nomogram for predicting 3- and 5-year recurrence free survival was generated with the c-index of 0.746 for the training set and 0.718 for the validation set, respectively. Conclusions: We have generated nomograms predicting prognosis for HCC treated by hepatectomy with a higher predictive power.


Hepatocelluar carcinoma (HCC) in china alone accounts for appropriate 50% of the deaths from liver cancer worldwide due to high presence of Hepatitis B virus (HBV) infection. [1] Surgical resection is widely accepted for curative therapy. Small HCC with well preserved liver function is suitable for hepatectomy with 5-year survival rate of 70–81%. [2, 3] For patients with intermediate-advanced stage HCC, hepatectomy is not recommended based on current stage systems due to high recurrence rate, recent studies from western and eastern shown that surgical resection for some selected patients with intermediated-advanced stage HCCs could bring more survival benefits than transarterial chemoembolization (TACE). [46] With more patients suitable for hepatectomy, the model to predict all resectable HCCs but not only early stage HCC or specific stage HCCs was necessary. [7, 8] Liu et al. had proposed one model which had excellent discriminating power about prognosis of patients from early to advanced stages of HCC. [9] We believed that, for resectable, HCCs, the prediction power of nomograms with full consideration of pathological findings or/and some promising inflammation index might increase.

The conventional staging systems mainly focused on tumor status, such as tumor size, tumor number and vascular invasion. [10] They had some limitation in predicting the prognosis of HCC after surgery because the current staging systems put insufficient attention on pathological findings, such as microvascular invasion (MVI), satellite lesions, and acceptable risk factors like platelet-to-lymphocyte ratio (PLR) or/and neutrophil-to-lymphocyte ratio (NLR). For example, MVI representing tumor behavior had been demonstrated as an extremely important factor associated with the prognosis of HCCs. [11, 12] Only the seventh American Joint Committee on Cancer (AJCC) system had included this factor to distinguish the prognosis. Similarly, satellite lesion negatively impacting the prognosis was neglected in the conventional staging systems. [13, 14]. Besides, in most investigations, tumor size itself as continuous variable was included as a categorical variable and tumor number were simply classified as single and multiple HCCs. [1518] Previous studies showed patients with tumor number more than 3 might present poor prognosis compared to patients with 1–3 tumors after surgery. [19] We hypothesized model incorporating tumor size as continuous variable might accurately predict the prognosis since tumor size was closely related with risk factors, such as MVI and satellite lesion. [20].

Recently, systematic inflammation index, such as PLR and NLR, has been focused by many investigators and demonstrated to be an independent risk factor associated with cancerous prognosis. [2123] Inflammation closely correlated with cancer progress [2426] In clinical, neutrophil counts, platelet counts and lymphocyte counts might reflect the host immune and inflammation status and thus indicate tumor progress through different combinations. [21] Unfortunately, they are few predictive models including these simple and effective factors.

Nomogram is a method that could assign relative risk scores to each predictor according to its contribution to the prognosis. Based on total points of individual, it could predict the probability of overall survival (OS) and recurrence free survival (RFS) after hepatectomy. Recently, many investigators successfully evaluate risk scores to more accurately predict the outcomes in various cancers including HCC. [2729]. For resectable HCCs after hepatectomy, model incorporating all the available risk factors might increase power in predicting the prognosis of HCCs after hepatectomy.

The purpose of the current study is (1) to construct clinically useful nomograms with full consideration of tumor status and systematic inflammation to predict OS and RFS for resectable HCC after hepatectomy; (2) to validate the nomograms in the validation set; (3) to compare its predictive power with current popular staging systems.


Baseline characteristics in training set and validation set

A total of 777 subjects were included in the current study with 618 in the training set and 159 subjects in the validation set. The baseline characteristics of the two cohorts in all study subjects are shown in Table 1. In the training set, there were 150 patients (24.3%) with age > 60 year and 541 male patients.540 patients (87.4%) had HBV infection. The average tumor size was 6.7 cm ranging from1.2 cm to 25.0 cm. There were 478 patients with solitary HCC, 82 patients (13.3%) with two tumors and 58 patients (9.4%) with more tumors. Major vascular invasion was noted in 98 patients (15.9%) and MVI in 342 (37.5%). Satellite lesions were available for 96 patients (15.5%). In validation set, the distribution of these characteristics is almost similar to the training set (Table 1).

Table 1: Clinicopathological characteristics in the training set and validation set

Training set

Validation set

n = 618

n = 159

age > 60 y

150 (24.3)

40 (25.2)

Gender (male/female)



Positive HBsAg

540 (87.4)

140 (88.1)

Positive HBV load

292 (47.2)

80 (50.3)

AFP > 400 ng/ml

289 (46.8)

79 (49.7)



276 (44.7)

65 (40.9)


342 (55.3)

94 (59.1)

Satellite lesion

96 (15.5)

20 (12.6)


232 (37.5)

62 (39.0)

Tumor number


478 (77.3)

125 (78.6)


82 (13.3)

17 (10.7)


58 (9.4)

17 (10.7)

Tumor size

6.7 ± 3.7

7.3 ± 3.5

Ishak score


399 (64.6)

97 (61.0)


219 (35.4)

62 (39.0)

Major vascular invasion

98 (15.9)

17 (10.7)

Positive surgical margin

13 (2.1)

3 (1.9)


1.6 ± 0.3

1.6 ± 0.2


1.6 ± 0.2

1.6 ± 0.2


41.4 ± 4.4

40.8 ± 4.0


15.2 ± 6.9

14.9 ± 6.7


≥ 111

224 (36.2)

67 (42.1)

< 111

394 (63.8)

92 (57.9)


≥ 3

197 (31.9)

49 (30.8)

< 3

421 (68.1)

110 (69.2)

Surgery type


151 (24.4)

46 (28.9)


196 (31.7)

54 (34.0)


271 (43.9)

59 (37.1)

Blood transfusion

50 (8.1)

13 (8.2)

recurrence site


360 (58.3)

93 (58.5)


78 (12.6)

18 (11.3)

recurrence treat

salvage LT

7 (1.1)

1 (0.6)


44 (7.1)

5 (3.1)

radiofrequency ablation

34 (5.5)

8 (5.0)


165 (26.7)

45 (28.3)

pallitive therapy

189 (30.6)

53 (33.3)

HBsAg hepatitis B virus antigen; AFP alpha-fetoprotein, HBV-DNA hepatitis B virus DNA; MVI microvascular invasion, TBIL total bilirubin AST aspartate aminotransferase, ALT alanine aminotransferase; ALB albumin; TBIL total bilirubin; PLR platelet to lymphocyte ratio; NLR neutrophil to lymphocyte ratio; LT liver transplantation; TACE transcatheter arterial chemoembolization.

Follow-up treatments and predictors of OS

During follow-up, 548 patients (70.9%) suffered from postoperative recurrence with 453 patients with intrahepatic recurrence and 96 patients with extrahepatic recurrence. Of the 548 patients with recurrence, eight patients received liver transplantation, 49 patients received resection, 42 patients received radiofrequency ablation, 210 patients received TACE and 242 received palliative therapy. In univariate analysis of the training set, age, gender, AFP, satellite lesion, MVI, tumor number, tumor size, major vascular invasion, positive surgical margin, alanine transaminase (ALT), aspartate transaminase (AST), albumin (ALB), PLR, NLR, surgery type were potential risk factors for postoperative On multivariable analysis, alpha-fetoprotein (AFP) (P = 0.031 hazard ration (HR) 1.292 95% confidence interval (CI) 1.024–1.629), NLR (p = 0.004 HR 1.428 95% CI 1.123–1.817), tumor size (p < 0.001 HR 1.092 95% CI 1.058–1.127), tumor number (p < 0.001 HR 1.350 95% CI 1.146–1.589), satellite lesions (p = 0.028 HR 1.392 95% CI 1.036–1.869), MVI (p < 0.001 HR 1.660 95% CI 1.304–2.113) and surgery type (p = 0.005 HR 1.250 95% CI 1.071–1.459) showed prognostic power (Table 2).

Table 2: Variables associated with OS according to the Cox proportional hazard model


Univariate analysis

Multivariate analysis



95% CI



95% CI

age > 60 y




Gender (male/female)




Positive HBsAg


Positive HBV load


AFP > 400 ng/ml

< 0.001






Differentiation (poor/moderate–well)




Satellite lesion

< 0.001







< 0.001



< 0.001



Tumor number (one/two/more)

< 0.001



< 0.001



Tumor size

< 0.001



< 0.001



Ishak score (5–6/0–4)


Major vascular invasion

< 0.001



< 0.001



Positive surgical margin









< 0.001









PLR (> 111/ ≤ 111)

< 0.001



NLR (> 3/ ≤ 3)

< 0.001








Surgery type (extend/major/minor)

< 0.001






Blood transfusion


HR hazard ration; CI confidence interval; HBsAg hepatitis B virus antigen; AFP alpha-fetoprotein, HBV-DNA hepatitis B virus DNA; MVI microvascular invasion, TBIL total bilirubin AST aspartate aminotransferase, ALT alanine aminotransferase ; ALB albumin; TBIL total bilirubin; PLR platelet to lymphocyte ratio; NLR neutrophil to lymphocyte ratio; PT prothrombin time.

Construction and validation of the nomogram

A nomogram to predict OS of patients with HCC following surgical resection is shown in Figure 1A. Spearman correlation indicated that surgery type versus tumor size correlated significantly (r = 0.402, P < 0.001). Except for surgery type, the nomogram included other seven variables associated with OS in multivariable analysis. Each factor in the nomogram was assigned a weighted number of points, and the sum of points for each patient was in accordance with a specific predicted 3- and 5-year OS. A higher score predicted worse prognosis (Figure 1).The model demonstrated good accuracy for predicting overall survival rate of HCC after hepatectomy, with a c-index of 0.767 (95% CI 0.742–0.792). The bootstrapped calibration plot for the prediction of 3-year and 5-year OS is shown in Figure 2A and 2B. The calibration plots revealed good prediction of 3- and 5-year OS.

Nomograms to predict probability of 3- and 5-year over survival.

Figure 1: Nomograms to predict probability of 3- and 5-year over survival. (A) and recurrence free survival (B) for HCC treated by hepatectomy To calculate the probability of postoperative survival, we first draw a vertical line to the points scale to get the value for each factor and then sum up all the individual values. We finally draw a vertical line from the total points scale to the probability at the probability at the year 3 line to obtain 3-year survival rate and at the year 5 line to obtain 5-year survival rate. AFP: 0 = < 400 ng/ml, 1 = > 400 ng/ml; MVI: 0 = negative,1 = positive; Satellite lesions: 0 = negative,1 = positive; Tumor number: 1=one,2=two,3=more; Major vascular invasion: 0 = negative,1 = positive; NLR: 0 = < 3,1 = ≥ 3.

Good calibration of the nomogram in the training and validation set.

Figure 2: Good calibration of the nomogram in the training and validation set. The nomogram predicted the probabilities of postoperative 3 years survival (A), 5 years survival (B) in the training set and 3 years survival (C), 5 years survival (D) in the validation set.

In the validation set, the C-index of the nomogram for predicting OS was 0.719 (95% CI, 0.671 to 0.767), and a calibration curve showed good agreement between prediction and observation in the probability of 3-year and 5-year survival (Figure 2C and 2D).

Similarly, based on the multivariate analysis, the seven risk factors included in the OS nomogram were indentified predictors of recurrence free survival (Table 3). A nomogram to predict 3- and 5-year RFS of patients with HCC following surgical resection is shown in Figure 1B. The model demonstrated good accuracy for predicting RFS rate of HCC after hepatectomy, with a c-index of 0.746 (95% CI, 0.723 to 0.768). In the validation set, the C-index of the nomogram for predicting RFS was 0.718 (95% CI, 0.670 to 0.766)

Table 3: Variables associated with RFS according to the Cox proportional hazards model


Univariate analysis

Multivariate analysis



95% CI



95% CI

age > 60 y




Gender (male/female)




Positive HBsAg


Positive HBV load


AFP > 400 ng/ml

< 0.001






Differentiation (poor/moderate-well)

< 0.001



Satellite lesion

< 0.001







< 0.001






Tumor number(one/two/more)

< 0.001






Tumor size

< 0.001






Ishak score (5–6 / 0–4)


Major vascular invasion

< 0.001



< 0.001



Positive surgical margin

< 0.001















PLR (> 111 / ≤ 111)

< 0.001



NLR ( >3 / ≤ 3)

< 0.001










Surgery type (extend/major/minor)

< 0.001



Blood transfusion


Abbreviations as Table 2.

Survival analysis based on current staging system

In the current study, Barcelona Clinic Liver Cancer (BCLC) system, the seventh AJCC system, Cancer of the Liver Italian Program (CLIP) system and Hong Kong Liver Cancer (HKLC) system were used to classify all the patients. The results were shown in Table 3. The survival analysis stratified by BCLC system, the seventh AJCC system, CLIP system and HKLC system were present in Figure 3 and Table 4.

Kaplan-Meier survival curves of the training set.

Figure 3: Kaplan-Meier survival curves of the training set. (A) Barcelona Clinic Liver Cancer (BCLC) staging system; (B) American Joint Committee on Cancer (AJCC) seventh edition; (C) Cancer of the Liver Italian Program (CLIP) staging system; (D) Hong Kong Liver Cancer (HKLC) staging system) and the validation set ((E) Barcelona Clinic Liver Cancer (BCLC) staging system; (F) American Joint Committee on Cancer (AJCC) seventh edition; (G) Cancer of the Liver Italian Program (CLIP) staging system; (H) Hong Kong Liver Cancer (HKLC) staging system) classified by different staging systems.

Table 4: Overall survival analysis stratified by staging systems in the training set and validation set

Staging system

Training set

Validation set

n = 618




n = 159




BCLC system


407 (65.9)




110 (69.2)





113 (18.3)




32 (20.1)





98 (15.9)




17 (10.7)




AJCC system


297 (48.1)




74 (46.5)





153 (24.8)




44 (27.7)





72 (11.7)




25 (15.7)





96 (15.5)




16 (10.1)




CLIP system


203 (32.8)




48 (30.2)





200 (32.4)




52 (32.7)





97 (15.7)




25 (15.7)





83 (13.4)




20 (12.6)





30 (4.9)




13 (8.2)





5 (0.8)




1 (0.6)




HKLC system


237 (38.3)




47 (29.6)





286 (46.2)




92 (57.9)





86 (13.9)




20 (12.6)





9 (1.5)




0 (0.0)




BCLC Barcelona Clinic Liver Cancer staging system; AJCC American Joint Committee on Cancer seventh edition; CLIP Cancer of the Liver Italian Program staging system; HKC Hong Kong Liver Cancer staging system.

Comparsion of the nomogram and current staging system

The c-index for OS in the training set and the validation set were 0.767 (95% CI 0.742–0.792) and 0.719 (95% CI 0.671–0.767), respectively. In the training set, There were significant differences in the C-indices between the nomogram and other staging systems (0.767 vs. BCLC: 0.644; the seventh AJCC system: 0.678; CLIP: 0.692 and HKLC system; 0.688; P < 0.001 for all, respectively), and all C-indices were significantly lower than that of the nomogram. In the validation set, There were also significant differences in the C-indices between the nomogram and other staging systems (0.719 vs. BCLC: 0.609; the seventh AJCC system: 0.674; CLIP: 0.648 and HKLC system; 0.639; P < 0.001 for all, respectively), and all c-indices were significantly lower than that of the nomogram.


Currently, surgical resection remains the curative treatment modality for hepatocelluar carcinoma without metastasis. [1, 5] Hepatectomy was considered when all tumors on preoperative imaging studies could technically be resected and preserved liver function is well. Recently, many hepatobiliary institutions, including western and eastern liver cancer centers, advocate hepatectomy to treat HCC outside the Milan criteria. [5, 6] Personal prognostic prediction is essential to guild post-operative additional treatment and postoperative counseling. The prognosis of HCC patients varies greatly according the tumor status, liver function and performance status. In clinical, for those with resectable HCCs, they almost had Child-Pugh status A even they had intermediate-advanced stage HCCs. Consistently, in this study, Child-Pugh status or liver cirrhosis did not impact the prognosis after hepatectomy. [5, 6, 30] Surgery type was considered as predictor of prognosis in the Cox model. However, according to the pearson correlation analysis, surgery type and tumor size correlated closely. In clinical practice, patients with large tumor size might face that more liver tissue were be removed in order to eliminate tumor. We therefore select tumor size for analysis, namely tumor size and then construct this nomogram by combination of tumor characteristics and systematic inflammation.

Tumor characteristics in our nomogram included AFP level, tumor size, tumor number, MVI, major vascular invasion and satellite lesions. In consistent with previous study, all the variables were validated as independent risk factors in our large sample size. [5, 31] The cutoff value of AFP was 400 ng/ml as previous study showed. [32] AFP > 400 ng/ml was assigned score of 10.4 points for OS prediction and 15 points for RFS prediction Tumor size was ranging from 1.2cm to 26.0cm and tumor size with 26.0 cm was assigned score of 100 points for OS prediction and RFS prediction. Tumor number was classified as one, two and more with scores of 0, 12.2 and 24.4 points, respectively. The MVI, major vascular invasion and satellite lesions obtained score of 18.0 points, 38.5 points and 13.6 points, respectively for OS prediction and 14.1 points, 53.8 points and 9.4 points, respectively for RFS prediction. In contrast to many previous studies, we included tumor size as continuous variable because various cutoff of tumor size are validated as risk factor for HCC. [31, 33] The higher the points were, the larger the tumor size was. Our previous study suggested tumor number > 3 decreased the prognosis after hepatectomy. [19] In our nomogram, tumor number > = 3 had the max score of about 25.0 points for OS prediction and 40 points for RFS prediction. Satellite lesion and MVI were currently acceptable risk factor associated with HCC patients’ prognosis.

The relationship between systematic inflammation, such as PLR and NLR, and cancerous prognosis has been universally accepted by many investigators. Elevated NLR and PLR were identified as independent prognostic factors [21, 23] The systemic inflammatory response such as NF-κB pathway, might lead to aberrant release of pro-inflammatory cytokines and inflammatory mediators, promoting the tumor to proliferate and metastasize via the promotion of angiogenesis, DNA damage, and apoptosis inhibition. [24] In the current study, we defined the mean value of PLR and NLR as cutoff value, and NLR (> 3) were demonstrated as independent risk factor. Elevated NLR got the score of appropriate 12.7 points for OS prediction and 11.7 points for RFS prediction. In our nomograms, the predictive power was enhanced when incorporating these risk predictors, with index of 0.767 for OS prediction and 0.746 for RFS prediction.

According to our nomogram, each individual could achieve a predicted 3- and 5-year OS and RFS after hepatectomy, which cannot be realized by the conventional staging systems placing patients into prognostic groups. For example, BCLC system simply stratified the patients into three groups. For the other three systems, they might not distinguish the prognosis between some stages in the training or validation set. Notably, our nomograms could pay sufficient attention to pathological information, such as MVI and satellite lesion. [9, 34, 35] Moreover, in current study, we firstly incorporated the systematic inflammation into a model to predict the prognosis since this simple and effective blood marker could predict various cancerous prognosis. Consequently, our nomogram showed good calibration and discriminatory abilities with C-index value of 0.767 higher than that of previous nomogram(c-index:0.62) and four conventional staging systems [36].

In conclusion, our nomogram focus on tumor itself and imflammation status,which better predicted the individual prognosis after hepatectomy than conventional staging system. Nomogram is relatively easy to read with a simple graphic. When more HCC patients underwent hepatectomy, these nomograms are effective and practical.

The current study had several limitations. Firstly, while the nomogram was internally validated using bootstrapped calibration and validation set, multicenter studies are needed to externally validate the proposed nomogram. Secondly, our nomogram could only apply those with HCC after hepatectomy. Since hepatectomy provides the hope of curative therapy, it is necessary to accurately predict the prognosis of these patients and thus to guild the postoperative therapy. In the future, since more risk factors were indentified, a model with higher accuracy may be established. Thirdly, in the validation set, the sample size was relative small. The proposed nomograms needed to be validated in large sample size and prospective study.



Patients were identified from a prospectively maintained database of HCC treated with hepatectomy at West China Hospital from July 1, 2007 through July 31, 2014. A cohort of 777 HCC patients were randomly with a 4:1 ratio allocated into the training set and the validation set via SPSS 20.0 software. The training set consisted of 618 patients and the validation set consisted of 159 patients. The diagnoses of HCC were all histologically confirmed based on analysis of paraffin-embedded tissue by experienced liver pathologists in West China Hospital. Clinicopathological variables including age, gender, hepatitis B virus surface antigen (HBsAg), liver cirrhosis, a- AFP, tumor size, number, major vascular invasion, MVI, satellite lesions, differentiation were obtained from our database. The cutoff value of AFP was defined as previous study described. [32] The presence of MVI, visible only on microscopy, was described as determined from histopathological reports, while major vascular invasion were described as tumor invading the portal or/and hepatic vein which can be detected by imaging study or surgical findings. Two or more HCCs that were reported separately with a full description of histopathologic features were described as multiple HCCs. Nodules (< 2 cm) close to the main tumor were described as satellite lesions in the original pathology report. [37] The types of hepatectomy including minor (1 segment), major (2–3 segments) and extended liver resection (> 3 segments) were determined according to the tumor location and size, liver functional reserve, cirrhosis, and estimated volume of future liver remnant based on CT data. All the patients were strictly stratified by BCLC system [38], the seventh AJCC system [39], CLIP system [40] and HKLC system [41]. The inclusion criteria were as follows: (1) without extrahepatic metastasis; (2) HCC treated by hepatectomy; (3) exact diagnosis of pathologically proven HCC; (4) HCC patients should have child-pugh status A, or child-pugh status B which can be improved to A. (5) liver tumor can be completely removed (R0), and for patients with liver cirrhosis, the residual liver volume should be at least 40% of total liver volume. The exclusion criteria were as follows: (1) with other cancers; (2) with severe cardiovascular and pulmonary disease; (3) the major vascular invasion was involving in the trunk of portal vein or the inferior vena cava; (4) imaging study (liver ultrasound or abdominal contrast-enhanced computed tomography (CT) scan suggests severe liver cirrhosis or/and ascites (5) incomplete clinicopathological reports and follow-up data. Informed consent for using their data in research was obtained from all patients, and the study protocol was approved by the Ethic Committee of West China Hospital.


The median follow-up for our cohort was 33.13 months in the training set and 34.80 months in the validation set. All of the patients were regularly followed at first month and every 3 months after surgery. Routing blood tests, liver function tests, AFP levels measurements, HBV-DNA levels, liver ultrasound were performed at each follow up. Once HCC recurrence including intrahepatic or/and extrahepatic recurrence was suspected, CT or/and magnetic resonance imaging (MRI) was chosen to conform the lesions, and chest CT scan and bone scan were necessary. After HCC recurrence, Patients were evaluated at multidisciplinary team (MDT) in West China Hospital for treatment guidance based on the status of tumor and general condition. The MDT mainly comprised of experienced hepatic surgeon, radiologists, pathologists and oncologists in West China Hospital. Liver transplantation, resection, ablation, and TACE and palliative therapy could be applied. Patients were administrated anti-virus therapy, such as Entecavir (0.5 mg/day), if their HBV-DNA levels were > 1.00E + 03 copies/ml before and after surgery during follow up. RFS and OS were calculated from the date of initial treatment until the date of detection of recurrence and death or the date of last follow-up.

Statistical analysis

Continuous variables were displayed as mean ± standard deviation and compared by Student’s t test or Mann-Whitney U test (non-normal distribution data). Categorical data were shown as frequency and assessed by Fisher’s exact test and two-tailed χ2 test. Survival curves stratified by various stage systems were evaluated using the Kaplan-Meier method and compared using the log-rank test.

Potential risk factors significant in univariate analysis were included multivariate analysis with forward step-wise selection process. We subsequently used the risk factors from multivarate analysis of the training set to construct a nomogram. Harrell’s concordance index (c-index) ranging from 0.5 (randomness) to 1 (perfect discrimination) was used to evaluate the concordance between predicted and actual observed responses of patients. [42] Being concordant means the nomogram assigned a higher probability of death (alive) to the patient who died (alive) than the one alive (death). The c-index is the probability of being concordant out of all predicted and actual patient pairs. [43].

Calibration plots were generated to investigate the performance characteristics of our nomogram at 3 and 5 years after surgery in the training set and the validation set. Nomogram was internally validated using bootstrapping with 1000 resamples. Moreover, we estimate the predictive performance when the models are applied to new patients in the validation set. The predict power between the nomogram and other four current staging systems in the training set and the validation set were assessed using the rcorrp.cens package in Hmisc in R and were shown as the C-index. A higher C-index indicated a higher predict power for HCC. A P < 0.05 was considered statistically significant. All analyses were carried out using R version 3.3.0 with the rms packages (http://www.R-project.org) and SPSS version 20.0 (Chicago, IL, USA).


The authors thank the patients for participating in this study.




This work was supported by grants from Scientific and Technological Support Project of Sichuan Province (2015SZ0049 and 2016SZ0025).

Authors’ contributions

Tianfu Wen proposed the study. Junyi Shen and Chuan Li performed the research. Changli Lu comfirmed HCCs. Changli Lu and Weixia Chen joined the MDT for guiding the treatment of recurrent HCC. Junyi Shen and Linye He collected and analyzed the data. Junyi Shen wrote the first draft, Tianfu Wen reviewed the paper. All authors contributed to the interpretation of the study.


1. Wang FS, Fan JG, Zhang Z, Gao B, Wang HY. The global burden of liver disease: the major impact of China. Hepatology. 2014; 60:2099–2108.

2. Liu PH, Hsu CY, Hsia CY, Lee YH, Huang YH, Chiou YY, Lin HC, Huo TI. Surgical Resection Versus Radiofrequency Ablation for Single Hepatocellular Carcinoma </ = 2 cm in a Propensity Score Model. Ann Surg. 2016; 263:538–545.

3. Peng W, Li C, Wen TF, Yan LN, Li B, Wang WT, Yang JY, Xu MQ. Postoperative prognostic nutritional index change is an independent predictor of survival in patients with small hepatocellular carcinoma. Am J Surg. 2015.

4. Vitale A, Burra P, Frigo AC, Trevisani F, Farinati F, Spolverato G, Volk M, Giannini EG, Ciccarese F, Piscaglia F, Rapaccini GL, Di Marco M, Caturelli E, et al. And Italian Liver Cancer g. Survival benefit of liver resection for patients with hepatocellular carcinoma across different Barcelona Clinic Liver Cancer stages: A multicentre study. J Hepatol. 2015; 62:617–624.

5. Zhong JH, Ke Y, Gong WF, Xiang BD, Ma L, Ye XP, Peng T, Xie GS, Li LQ. Hepatic resection associated with good survival for selected patients with intermediate and advanced-stage hepatocellular carcinoma. Ann Surg. 2014; 260:329–340.

6. Kokudo T, Hasegawa K, Yamamoto S, Shindoh J, Takemura N, Aoki T, Sakamoto Y, Makuuchi M, Sugawara Y, Kokudo N. Surgical treatment of hepatocellular carcinoma associated with hepatic vein tumor thrombosis. J Hepatol. 2014; 61:583–588.

7. Yang P, Qiu J, Li J, Wu D, Wan X, Lau WY, Yuan Y, Shen F. Nomograms for Pre- and Postoperative Prediction of Long-term Survival for Patients Who Underwent Hepatectomy for Multiple Hepatocellular Carcinomas. Ann Surg. 2016; 263:778–786.

8. Shim JH, Jun MJ, Han S, Lee YJ, Lee SG, Kim KM, Lim YS, Lee HC. Prognostic nomograms for prediction of recurrence and survival after curative liver resection for hepatocellular carcinoma. Ann Surg. 2015; 261:939–946.

9. Liu PH, Hsu CY, Hsia CY, Lee YH, Huang YH, Su CW, Lee FY, Lin HC, Huo TI. Proposal and validation of a new model to estimate survival for hepatocellular carcinoma patients. Eur J Cancer (Oxford, England :1990). 2016; 63:25–33.

10. Lencioni R, Chen XP, Dagher L, Venook AP. Treatment of intermediate/advanced hepatocellular carcinoma in the clinic: how can outcomes be improved? The oncologist. 2010; 15:42–52.

11. Lim KC, Chow PK, Allen JC, Chia GS, Lim M, Cheow PC, Chung AY, Ooi LL, Tan SB. Microvascular invasion is a better predictor of tumor recurrence and overall survival following surgical resection for hepatocellular carcinoma compared to the Milan criteria. Ann Surg. 2011; 254:108–113.

12. Hung HH, Lei HJ, Chau GY, Su CW, Hsia CY, Kao WY, Lui WY, Wu WC, Lin HC, Wu JC. Milan criteria, multi-nodularity, and microvascular invasion predict the recurrence patterns of hepatocellular carcinoma after resection. J Gastrointest Surg. 2013; 17:702–711.

13. Andreana L, Burroughs AK. Treatment of early hepatocellular carcinoma: How to predict and prevent recurrence. Dig Liver Dis. 2010; 42:S249–257.

14. Huang J, Li BK, Chen GH, Li JQ, Zhang YQ, Li GH, Yuan YF. Long-term outcomes and prognostic factors of elderly patients with hepatocellular carcinoma undergoing hepatectomy. J Gastrointest Surg. 2009; 13:1627–1635.

15. Truant S, Boleslawski E, Duhamel A, Bouras AF, Louvet A, Febvay C, Leteurtre E, Huet G, Zerbib P, Dharancy S, Hebbar M, Pruvot FR. Tumor size of hepatocellular carcinoma in noncirrhotic liver: a controversial predictive factor for outcome after resection. Eur J Surg Oncol. 2012; 38:1189–1196.

16. Hwang S, Lee YJ, Kim KH, Ahn CS, Moon DB, Ha TY, Song GW, Jung DH, Lee SG. The Impact of Tumor Size on Long-Term Survival Outcomes After Resection of Solitary Hepatocellular Carcinoma: Single-Institution Experience with 2558 Patients. J Gastrointest Surg. 2015; 19:1281–1290.

17. Zhang W, Wang X, Jiang R, Hou J, Mu X, Li G, Sun B. Effect of Tumor Size on Cancer-Specific Survival in Small Hepatocellular Carcinoma. Mayo Clin Proc. 2015; 90:1187–1195.

18. Li J, Liu Y, Yan Z, Wan X, Xia Y, Wang K, Liu J, Lau WY, Wu M, Shen F. A nomogram predicting pulmonary metastasis of hepatocellular carcinoma following partial hepatectomy. Br J Cancer. 2014; 110:1110–1117.

19. Jianyong L, Lunan Y, Wentao W, Yong Z, Bo L, Tianfu W, Minqing X, Jiaying Y. Barcelona clinic liver cancer stage B hepatocellular carcinoma: transarterial chemoembolization or hepatic resection? Medicine (Baltimore). 2014; 93:e180.

20. Pawlik TM, Delman KA, Vauthey JN, Nagorney DM, Ng IO, Ikai I, Yamaoka Y, Belghiti J, Lauwers GY, Poon RT, Abdalla EK. Tumor size predicts vascular invasion and histologic grade: Implications for selection of surgical treatment for hepatocellular carcinoma. Liver Transpl. 2005; 11:1086–1092.

21. Okamura Y, Sugiura T, Ito T, Yamamoto Y, Ashida R, Mori K, Uesaka K. Neutrophil to lymphocyte ratio as an indicator of the malignant behaviour of hepatocellular carcinoma. Br J Surg. 2016.

22. Zhao QT, Yuan Z, Zhang H, Zhang XP, Wang HE, Wang ZK, Duan GC. Prognostic role of platelet to lymphocyte ratio in non-small cell lung cancers: A meta-analysis including 3,720 patients. Int J Cancer. 2016; 139:164–170.

23. Li X, Chen ZH, Xing YF, Wang TT, Wu DH, Wen JY, Chen J, Lin Q, Dong M, Wei L, Ruan DY, Lin ZX, Wu XY, et al. Platelet-to-lymphocyte ratio acts as a prognostic factor for patients with advanced hepatocellular carcinoma. Tumour Biol. 2015; 36:2263–2269.

24. Grivennikov SI, Greten FR, Karin M. Immunity, inflammation, and cancer. Cell. 2010; 140:883–899.

25. Gay LJ, Felding-Habermann B. Contribution of platelets to tumour metastasis. Nat Rev Cancer. 2011; 11:123–134.

26. Coffelt SB, de Visser KE. Cancer: Inflammation lights the way to metastasis. Nature. 2014; 507:48–49.

27. Dikken JL, Baser RE, Gonen M, Kattan MW, Shah MA, Verheij M, van de Velde CJ, Brennan MF, Coit DG. Conditional probability of survival nomogram for 1-, 2-, and 3-year survivors after an R0 resection for gastric cancer. Ann Surg Oncol. 2013; 20:1623–1630.

28. Kent MS, Mandrekar SJ, Landreneau R, Nichols F, Foster NR, DiPetrillo TA, Meyers B, Heron DE, Jones DR, Tan AD, Starnes S, Putnam JB Jr, Fernando HC. A Nomogram to Predict Recurrence and Survival of High-Risk Patients Undergoing Sublobar Resection for Lung Cancer: An Analysis of a Multicenter Prospective Study (ACOSOG Z4032). Ann Thorac Surg. 2016; 102:239–246.

29. Tokumitsu Y, Tamesa T, Matsukuma S, Hashimoto N, Maeda Y, Tokuhisa Y, Sakamoto K, Ueno T, Hazama S, Ogihara H, Fujita Y, Hamamoto Y, Oka M, et al. An accurate prognostic staging system for hepatocellular carcinoma patients after curative hepatectomy. Int J Oncol. 2015; 46:944–952.

30. Kim JM, Kwon CH, Joh JW, Park JB, Lee JH, Kim SJ, Paik SW, Park CK, Yoo BC. Differences between hepatocellular carcinoma and hepatitis B virus infection in patients with and without cirrhosis. Ann Surg Oncol. 2014; 21:458–465.

31. Goh BK, Teo JY, Chan CY, Lee SY, Jeyaraj P, Cheow PC, Chow PK, Ooi LL, Chung AY. Importance of tumor size as a prognostic factor after partial liver resection for solitary hepatocellular carcinoma: Implications on the current AJCC staging system. J Surg Oncol. 2016; 113:89–93.

32. Yang SL, Liu LP, Yang S, Liu L, Ren JW, Fang X, Chen GG, Lai PB. Preoperative serum alpha-fetoprotein and prognosis after hepatectomy for hepatocellular carcinoma. Br J Surg. 2016.

33. Elnekave E, Erinjeri JP, Brown KT, Thornton RH, Petre EN, Maybody M, Maluccio MA, Hsu M, Sofocleous CT, Getrajdman GI, Brody LA, Solomon SB, Alago W, et al. Long-term outcomes comparing surgery to embolization-ablation for treatment of solitary HCC < 7 cm. Ann Surg Oncol. 2013; 20:2881–2886.

34. Li J, Zhou J, Yang PH, Xia Y, Shi YH, Wu D, Lv G, Zheng W, Wang K, Wan XY, Lau WY, Wu MC, Fan J, et al. Nomograms for survival prediction in patients undergoing liver resection for hepatitis B virus related early stage hepatocellular carcinoma. Eur J Cancer (Oxford, England: 1990). 2016; 62:86–95.

35. Li Y, Xia Y, Li J, Wu D, Wan X, Wang K, Wu M, Liu J, Lau WY, Shen F. Prognostic Nomograms for Pre- and Postoperative Predictions of Long-Term Survival for Patients Who Underwent Liver Resection for Huge Hepatocellular Carcinoma. J Am Coll Surg. 2015; 221:962–974.e964.

36. Torzilli G, Donadon M, Belghiti J, Kokudo N, Takayama T, Ferrero A, Nuzzo G, Vauthey JN, Choti MA, De Santibanes E, Makuuchi M. Predicting Individual Survival After Hepatectomy for Hepatocellular Carcinoma: a Novel Nomogram from the “HCC East & West Study Group”. J Gastrointest Surg. 2016; 20:1154–1162.

37. An C, Kim DW, Park YN, Chung YE, Rhee H, Kim MJ. Single Hepatocellular Carcinoma: Preoperative MR Imaging to Predict Early Recurrence after Curative Resection. Radiology. 2015; 276:433–443.

38. Bruix J, Han KH, Gores G, Llovet JM, Mazzaferro V. Liver cancer: Approaching a personalized care. J Hepatol. 2015; 62:S144-S156.

39. Minagawa M, Ikai I, Matsuyama Y, Yamaoka Y, Makuuchi M. Staging of hepatocellular carcinoma: assessment of the Japanese TNM and AJCC/UICC TNM systems in a cohort of 13,772 patients in Japan. Ann Surg. 2007; 245:909–922.

40. A new prognostic system for hepatocellular carcinoma: a retrospective study of 435 patients: the Cancer of the Liver Italian Program (CLIP) investigators. Hepatology. 1998; 28:751–755.

41. Yau T, Tang VYF, Yao T-J, Fan S-T, Lo C-M, Poon RTP. Development of Hong Kong Liver Cancer Staging System With Treatment Stratification for Patients With Hepatocellular Carcinoma. Gastroenterology. 2014; 146:1691–1700.e1693.

42. Hsiao W, Herrel LA, Yu C, Kattan MW, Canter DJ, Carthon BC, Ogan K, Master VA. Nomograms incorporating serum C-reactive protein effectively predict mortality before and after surgical treatment of renal cell carcinoma. Int J Urol. 2015; 22:264–270.

43. Dhir M, Smith LM, Ullrich F, Leiphrakpam PD, Ly QP, Sasson AR, Are C. A preoperative nomogram to predict the risk of perioperative mortality following gastric resections for malignancy. J Gastrointest Surg. 2012; 16:2026–2036.

Creative Commons License All site content, except where otherwise noted, is licensed under a Creative Commons Attribution 4.0 License.
PII: 13038