Comparative analysis of diagnostic performance, feasibility and cost of different test-methods for thyroid nodules with indeterminate cytology
Metrics: PDF 1216 views | HTML 2135 views | ?
Salvatore Sciacchitano1,2, Luca Lavra2, Alessandra Ulivieri2, Fiorenza Magi2, Gian Paolo De Francesco3, Carlo Bellotti4, Leila B. Salehi2,5, Maria Trovato6, Carlo Drago7 and Armando Bartolazzi8,9
1Department of Clinical and Molecular Medicine, Sapienza University, 00161 Rome, Italy
2Laboratory of Biomedical Research, Niccolò Cusano University Foundation, 00166 Rome, Italy
3Department of Oncological Science, Breast Unit, St Andrea University Hospital, 00189 Rome, Italy
4Operative Unit Surgery of Thyroid and Parathyroid, Sapienza University of Rome, St Andrea Hospital, 00189 Rome, Italy
5Department of Biopathology and Diagnostic Imaging, Tor Vergata University, 00133 Rome, Italy
6Department of Clinical and Experimental Medicine, Pad D 2° piano-AOU Policlinico “G. Martino”, 98125 Messina, Italy
7Department of Economics, Niccolò Cusano University, 00166 Rome, Italy
8Laboratory of Surgical and Experimental Pathology, St Andrea University Hospital, 00189 Rome, Italy
9Department of Oncology-Pathology, Cancer Center Karolinska Universitetssjukhuset Solna, S-17176 Stockholm, Sweden
Salvatore Sciacchitano, email: firstname.lastname@example.org
Keywords: thyroid FNA cytology, indeterminate thyroid nodules, systematic review, meta-analysis, diagnostic performance
Received: January 27, 2017 Accepted: March 22, 2017 Published: April 19, 2017
Since it is impossible to recognize malignancy at fine needle aspiration (FNA) cytology in indeterminate thyroid nodules, surgery is recommended for all of them. However, cancer rate at final histology is <30%. Many different test-methods have been proposed to increase diagnostic accuracy in such lesions, including Galectin-3-ICC (GAL-3-ICC), BRAF mutation analysis (BRAF), Gene Expression Classifier (GEC) alone and GEC+BRAF, mutation/fusion (M/F) panel, alone, M/F panel+miRNA GEC, and M/F panel by next generation sequencing (NGS), FDG-PET/CT, MIBI-Scan and TSHR mRNA blood assay.
We performed systematic reviews and meta-analyses to compare their features, feasibility, diagnostic performance and cost. GEC, GEC+BRAF, M/F panel+miRNA GEC and M/F panel by NGS were the best in ruling-out malignancy (sensitivity = 90%, 89%, 89% and 90% respectively). BRAF and M/F panel alone and by NGS were the best in ruling-in malignancy (specificity = 100%, 93% and 93%). The M/F by NGS showed the highest accuracy (92%) and BRAF the highest diagnostic odds ratio (DOR) (247). GAL-3-ICC performed well as rule-out (sensitivity = 83%) and rule-in test (specificity = 85%), with good accuracy (84%) and high DOR (27) and is one of the cheapest (113 USD) and easiest one to be performed in different clinical settings.
In conclusion, the more accurate molecular-based test-methods are still expensive and restricted to few, highly specialized and centralized laboratories. GAL-3-ICC, although limited by some false negatives, represents the most suitable screening test-method to be applied on a large-scale basis in the diagnostic algorithm of indeterminate thyroid lesions.
Follicular thyroid nodules with indeterminate pattern at fine needle aspiration (FNA) cytology are called in different ways, according to the different classification systems adopted. They are classified as thy3a in the presence of atypical features and as thy3f when a follicular neoplasm is suspected, according to the British Thyroid Association (BTA) . They are defined as category III (Atypia of Undetermined Significance [AUS] or Follicular Lesion of Undetermined Significance [FLUS]) and IV (Follicular Neoplasm [FN] or Suspicious for a Follicular Neoplasm [SFN]), according to the Bethesda system . In Italy, the Italian Society of Endocrinology (SIE), the Italian Thyroid Association (AIT), the Italian Association of Clinical Endocrinologists (AME) and the Italian Society for Anatomic Pathology and Cytology joint with the Italian Division of the International Academy of Pathology (SIAPEC-IAP) adopt the term Tir3A for low-risk and Tir3B for high-risk indeterminate lesions . Independently of the classification system used, thyroid nodules classified in these categories represent the gray zone of conventional FNA-cytology [4, 5]. They are diagnosed in 15% - 30% of the total FNA cases and are currently referred for surgery more for diagnosis rather than for a real therapeutic necessity. Cancer prevalence in such indeterminate nodules varies according to the larger studies, performed in different Countries (Table 1).
Table 1: Cancer prevalence in thyroid nodules with indeterminate cytology
Nodules with Indeterminate Cytology (resected)
Cancers at Histology (n.)
Cancers at Histology (%) (95% CI)
Major studies (more than 100 cases) published in the literature concerning the occurrence of thyroid malignancy in indeterminate thyroid nodules. Data have been extrapolated by considering only tir3A/Tir3B/thy3a/thy3f/AUF/FLUS/FN/SFN cases. In all studies patients that received a cytological diagnosis of indeterminate thyroid nodules were surgically treated and histologically verified. Percentages of malignancy at histology, with corresponding 95% CI, are reported.
Pooled mean value is 27.6% (95% CI ranging from 26.4% to 28.7%). The lowest prevalence was reported in Boston, MA (11.1%, with 95% CI ranging from 6.5% to 17.4%) . The highest prevalence was registered in South Korea (47.4%, with 95% CI ranging from 40.6% to 54.3%) . In Italy the prevalence of malignancy in this type of nodules was 24.4% (95% CI ranging from 22.3% to 26.6%) and it didn’t change over the time [23, 24], despite the increased incidence of thyroid cancer of 4.3% per year reported in the Italian general population [25, 26]. This means that about 70% of such indeterminate thyroid lesions that are referred to surgery are over-treated. Many different attempts have been made to ameliorate the accuracy of thyroid FNA-cytology by using clinical, ultrasonographic and scintigraphic features, but none of them proved to be accurate enough [27–29], even when a novel scoring system that combines and integrates the cytological information with the clinical and ultrasonographic risk factors of malignancy is used . Several different test-methods have been proposed so far. They include new emerging molecular-based diagnostic tests, directly performed on thyroid FNA samples  or assay performed on peripheral blood , as well as nuclear medicine imaging tests, using tracers that are absorbed (“hot”) or excluded (“cold”) by the nodule, to detect thyroid malignancy [33–35] and expression analysis of putative protein tumor-associated markers, directly performed on thyroid FNA samples . Both ATA Guidelines Task Force on Thyroid Nodules and Differentiated Thyroid Cancer  and NCCN Tumor Marker Task Force  suggested that the clinical utility of a molecular test should be founded in strong evidence proving that use of the marker “improves patient outcomes sufficiently to justify its incorporation into routine clinical practice” and it should not be intended to replace other sources of information or clinical judgment. The most extensively studied genetic marker is represented by a mutation of the BRAF gene. The specific mutation consists in a T1799A transversion resulting in a V600E amino acid substitution, with subsequent constitutive activation of BRAF kinase. The potential diagnostic and prognostic value of this genetic marker is proved by many studies [37, 38]. The diagnostic relevance of such marker is also demonstrated by the fact that it is included in all the composite molecular genetic panels proposed so far for recognizing thyroid malignancy in indeterminate thyroid nodules. Among the various thyroid cancer protein markers, Galectin-3 represents one of the most extensively studied. Galectin-3 is a multifunctional molecule involved in regulation of apoptosis [39, 40] whose potential role as a thyroid cancer marker was recognized by many studies since the first report published in 1995 . A test-method based on Galectin-3 immunocytochemistry (GAL-3-ICC) analysis on thyroid FNA samples, named ThyroTest, has been developed and validated for clinical use in two large multicenter studies [42, 43] as well as in many others studies in different Countries .
The availability of so many different diagnostic tools for the preoperative characterization of thyroid nodules with indeterminate cytology urgently demands a comparative analysis of their diagnostic performance, feasibility, cost and effectiveness. Such a comparison, based on data collected in different clinical settings of various geographical and socio-economical contexts and involving diverse laboratory expertise, may be extremely challenging. For a more accurate comparative analysis the same indeterminate thyroid nodule population should be investigated by different test-methods. Recently, some attempts have been made to compare in the same nodule population some of the available test-methods [45–48]. The present extensive comparative analysis includes many different histopathological, genetic and imaging biomarkers and is aimed to provide to clinicians key information for a more cost-conscious clinical management of patients bearing indeterminate thyroid nodules. We considered the following test-methods: GAL-3-ICC, BRAF mutation analysis, GEC methods alone (Afirma® GEC by Veracyte) and in conjunction with BRAF mutation detection (Afirma® GEC + BRAF by Veracyte), thyroid cancer M/F panel (miRInform™ by Asuragen, and by Quest Diagnostics and ThyGenX® by Interpace Diagnostic), alone and in conjunction with miRNA GEC (ThyGenX® + ThyraMIR™) and thyroid cancer M/F panel analyzed by next generation sequencing (NGS) (Thyroseq® v.2 by CBLPath), [18F]-2-fluoro-2-deoxy-d-glucose–positron-emission-tomography/computed-tomography (FDG-PET/CT), [99mTc]-methoxyisobutylisonitrile scintigraphy (MIBI-Scan) and TSHR mRNA blood assay. A systematic literature search was performed for each one of them. According to established criteria, the most representative studies published from 2000 to 2016 were selected. We focused our attention to analyze the cancer prevalence of the population examined, the technical methodology used, the feasibility, the cost and the diagnostic performance of each one of test-method included in the study. Data regarding the various indicators of diagnostic performance and of the cost for each one of them were used to perform a comparative statistical analysis.
Characteristics of the included studies
A total of 45 different studies were selected on the basis of the criteria described in Materials and Methods section and following current protocols and guidelines . The search strategy and the flow of information of our systematic review are reported in Figure 1. The features of the studies that met all the inclusion criteria are summarized in Table 2.
Table 2: Characteristic of the studies included in the comparative analysis
Figure 1: Flow of information of our systematic review for each test-method, through the four-phase flow, according to the PRISMA statement.
Selected studies were performed in different geographical areas and in different Institutions. The specific features and test outcome, according to the gold standard of final histology, are reported. Patients were enrolled either in Academic Medical Centers, in University Hospitals or in private companies. In some studies, the test was performed in two subsequent periods, by the same Academic Medical Center in U.S.A. [32, 50]. In others, patients were enrolled in thyroid Centers of different Countries, such as U.S.A. [51–54, 59], Denmark , Canada , China  and Italy , and the samples were referred to a single central laboratory for molecular analysis. In other studies the same population of thyroid nodules, analyzed with one test was also subjected to another additional test [54, 61]. There are differences regarding also the total number of cases examined in these studies. In three test-methods, namely the BRAF mutation analysis [46, 51–53, 56–58, 63–79], the M/F panel [51–58] and the GAL-3-ICC [43, 78, 80–86], more than 1,000 cases from different studies were pooled together. In the case of the other six test-methods, the GEC alone , the GEC plus BRAF , the M/F panel plus miRNA GEC , the M/F panel by NGS , the TSHR mRNA [32, 50] and MIBI-scan [34, 35, 46], more than 100 cases were retrieved and pooled together. Finally, in the case of FDG-PET/CT  only slightly more than 50 cases were analyzed from one single study. The cancer prevalence reported in the selected studies ranged from 20% to 44%, and was in line with that reported in the literature for indeterminate nodules (Table 1).
Assessment of study heterogeneity
In 4 test-methods, namely the BRAF mutation analysis, GAL-3-ICC, MIBI-Scan and M/F panel, the systematic literature search, based on the established criteria, allowed us to select multiple studies, suitable to perform a meta-analysis. The graphical representations of these four meta-analyses are visualized in Figure 2. In the forest plot of GAL-3-ICC and MIBI-Scan no overlapping of the vertical line, corresponding to odds ratio = 1, with the confidence intervals of all studies was observed, indicating that all these studies are significant at 5% level. The same vertical line (odds ratio = 1) overlaps the confidence intervals of 7 out of 24 studies in BRAF mutation analysis, and of 2 out of 8 studies in M/F panel, indicating that these studies were less significant. In the forest plot of BRAF mutation, the last study  was excluded from the analysis because statistical calculations were not feasible. In that study, in fact, no positive results, either true or false, were reported. The I-squared (I2) was measured for the selected studies of each test-method to evaluate study heterogeneity. The overall I2 was 0% in the BRAF group, indicating that inconsistency across studies may not be important. The overall I2 was 39.7% in MIBI-Scan group and 68.7% in GAL-3-ICC group, indicating occurrence of moderate heterogeneity. Finally, The overall I2 was 84% in the M/F panel group, suggesting occurrence of substantial heterogeneity.
Figure 2: Forest plots of individual studies and pooled odds ratio of the four test-methods for which more then 2 studies were selected from the systematic literature search. For each study the 95% confidence interval (95% CI) and the weight (%) were also reported. The open diamond at the bottom of the graph shows the average effect size of the examined studies.
Tests classified according to their ability to exclude (rule-out) malignancy
The ability of a negative diagnostic test-method to exclude malignancy in a thyroid nodule with indeterminate cytology would be extremely useful in surgical decision-making, contributing to promptly identify those benign lesions that can be directed to follow-up. We therefore classified the different diagnostic test-methods analyzed based on this ability (Table 3).
Table 3: Test methods classified according their ability in ruling-out or ruling-in malignancy, to their diagnostic performance and their cost
The best rule-out indicator is the sensitivity (“positivity in disease”) that refers to the proportion of subjects who have the target condition (malignancy at histology) and gives a positive test result. It corresponds to a high NPV and a low FNR. The present comparative analysis indicates that among all test-methods considered M/F panel by NGS, GEC alone, GEC + BRAF and M/F panel + miRNA GEC showed the highest sensitivities (90%, 90%, 89% and 89% respectively), the highest NPV (96%, 94%, 92% and 85% respectively), and the lowest FNR (10%, 10%, 11% and 11% respectively). These four test-methods appear, indeed, to be the most reliable ones for cancer exclusion (best rule-out methods). GAL-3-ICC and FDG-PET/CT were both characterized by high sensitivity (83% and 80% respectively), high NPV (91% and 93% respectively), with a low, but significant FNR (17% and 20% respectively) and cancer risk in negative lesions (9% and 7% respectively). TSHR mRNA blood assay, and MIBI-Scan showed a lower sensitivity (70% and 67% respectively), a lower NPV (78% and 86% respectively) and a higher FNR (30% and 33% respectively). The BRAF mutation analysis showed the lowest sensitivity among all tests (41%), the lowest NPV (68%) and the highest FNR observed (59%). The diagnostic performance of this test-method in excluding malignancy didn’t improve much even if it was integrated with the analysis of a panel of thyroid specific M/F gene alterations. The use of M/F panel, in fact, yields only a slight increase in sensitivity (51%), of NPV (86%), a slightly reduced, but still elevated FNR (49%) as well as a high cancer risk in negative lesions (14%). Therefore, BRAF Mutation analysis and M/F panel are not adequate to efficiently exclude malignancy (worst rule-out methods).
Tests classified according to their ability to detect (rule-in) malignancy
The ability of identifying malignancy among indeterminate thyroid nodules represents an important clinical achievement. Surgical decision based on a good rule-in test may lead clinicians to selectively refer to surgery only thyroid cancers, reducing the over-treatments of benign lesions and consequently the social costs. The test-methods were then classified according to this ability (Table 3). The best rule-in indicator is the specificity (“negativity in health”) that refers to the proportion of subjects without the target condition (malignancy at histology) and gives negative test results. It corresponds to high PPV and low FPR. There are many test-methods that proved to be good in detecting malignancy among the indeterminate thyroid follicular lesions. The best rule-in method is the BRAF mutation analysis. It showed an absolute specificity (100%) an almost absolute PPV (99%), with no occurrence of false positives (FPR = 0%). Many test-methods were characterized by a very high specificity (≥ 85%), namely the three variants of M/F panel-based test-methods (alone, + miRNA GEC and by NGS) and the GAL-3-ICC. They showed also a high PPV value (70%, 74%, 83% and 73% respectively) and a low FPR (7%, 15%, 7% and 27% respectively) (Table 3). Adjunction of the miRNA GEC to the M/F panel didn’t seem to increase the ability of this method in identifying malignancy and the combination of these two methods, compared to the M/F panel alone displayed a slightly reduction in specificity (85%) and moderate increase in NPV (74%), with a higher FPR (15%). The MIBI-Scan and the TSHR mRNA showed a lower specificity (84% and 81% respectively), with a lower PPV (63% and 74% respectively), and a rather higher FPR (16% and 19% respectively). The FGD-PET/CT was characterized by a very low specificity (61%), the lowest PPV observed (33%) and a very high FPR (39%). GEC method, alone or in combination with BRAF mutation detection, didn’t show a good rule-in performance, with the lowest specificity (52% and 50% respectively), a rather low PPV (37% and 39% respectively) and with the highest FPR (48% and 50% respectively). Both GEC alone and GEC + BRAF mutation analysis, therefore, appear to be not reliable for cancer detection (worst rule-in tests).
Tests classified according to their combined ability to detect (rule-in) and to exclude (rule-out) malignancy
Sensitivity and specificity of all test-methods analyzed were graphically expressed in a two-dimensional scatterplot diagram (Figure 3). FDG-PET/CT and GEC alone or in conjunction with BRAF mutation analysis, all characterized by high sensitivity (upper part of the diagram), showed a rather low specificity (left part of the panel). Many different test-methods reached very high specificity and are consequently plotted at the very right extremity of the diagram. However, they showed different levels of sensitivity. In the cases of the BRAF mutation analysis an absolute specificity (right-most side of the diagram) was associated with a rather low sensitivity (lowest part of the diagram). The M/F panel alone also showed a combination of high specificity (right extremity of the diagram) and low sensitivity (lower part of the diagram). The MIBI-Scan and TSHR mRNA were plotted in the lower part of the diagram, with their low sensitivities, combined with slightly better specificities. The adjunction of the miRNA GEC analysis to the M/F panel or its analysis by NGS greatly improved the sensitivity of this method and contributed to locate these two methods in the upper right part of the diagram. The M/F by NGS reached the best combination of sensitivity and specificity among all the test-methods analyzed. GAL-3-ICC showed equally good levels of sensitivity and specificity and is plotted in the most favorable upper right part of the diagram.
Figure 3: Comparative two-dimensional scatterplot diagram of sensitivity and specificity of each test-method. Arbitrary cut-off lines at 80% of specificity and at 80% of sensitivity were included in the diagram.
Tests classified according to their likelihood ratios
In the decision process among competing diagnostic test-methods in a clinical application the use of positive and negative likelihood ratios, rather than simple value of sensitivity and specificity, as measures of diagnostic ability has been recommended . Likelihood ratios have a number of useful properties, including the fact that they do not vary in different populations or settings and are independent of prevalence of the disease . They are generally considered one of the best ways to measure and express diagnostic accuracy . Larger values of LR+ and smaller values of LR- indicate greater diagnostic ability (discrimination ability). Therefore, when choosing a diagnostic test, one would prefer those with LR+ as high as possible and, simultaneously, with LR- as low as possible . Data concerning LR+ and LR- values of the different test-methods are reported in Table 3 and visualized in Figure 4. Usually a value of LR+ >5 indicates that the test result has a moderate/large effect on increasing the probability of disease, while value of LR+ <5 indicates a small effect on increasing the probability of disease. On the other side, an LR- <0.3 indicates that the result has a large/moderate effect on decreasing the probability of disease presence, while a value of LR- >0.3 indicates a small effect on decreasing disease probability. The present comparative analysis indicates that some test-methods such as FDG-PET/CT, MIBI-Scan and TSHR mRNA, showed the unfavorable combination of very low LR+ and a high LR- and are plotted on the lower right part of the diagram. The test-methods that showed the most favorable combination of high LR+ and low LR- are the M/F panel by NGS, the M/F panel + miRNA GEC and the GAL-3-ICC, all plotted in the left upper part of the diagram. The two test-methods that were characterized by high LR+ and high LR- are BRAF mutation and M/F panel alone. In particular, the BRAF mutation was the method with the highest value of LR+ (out of scale in the diagram), combined, however, with the highest LR- value. Finally the GEC method alone and GEC + BRAF showed a low LR- combined with a low LR+.
Figure 4: Comparative two-dimensional scatterplot diagram of LR+ and LR- of each test-method. (LR+ Positive Likelihood Ratio, LR- Negative Likelihood Ratio). Arbitrary cut-off lines at 5 of LR+ and at 0.3 of LR- were included in the diagram.
Tests classified according to their diagnostic performance
Three different parameters, all related to the ability to discriminate between benign and malignant thyroid nodules were measured, namely the accuracy, the F1 score and the DOR (Table 3). The test-method with the best accuracy is the M/F panel by NGS (92%), followed by M/F + miRNA GEC (86%), by GAL-3-ICC (84%) and by M/F panel alone (83%). The diagnostic accuracy of the remaining test-methods, namely the MIBI-Scan (79%), the TSHR mRNA (76%), the BRAF mutation analysis (73%), the FDG-PET/CT (65%), the GEC (61%) and the GEC+ BRAF (60%) were the lowest among all test-methods considered. We then classify the test-methods according to their F1 score, which equally weights recall (ratio of true positives to all actual positives) and precision (ratio of true positives to all predicted positives) and illustrates the overall accuracy of a test. According to this calculation, M/F panel by NGS and M/F panel + miRNA GEC were the two best test-methods among all. They showed, in fact, an F1 score of 86% and 81% respectively. GAL-3-ICC ranked among the top ones (78%), followed by the TSHR mRNA (72%) and the MIBI-Scan (65%). The M/F panel alone (59%), the BRAF mutation analysis (58%), both GEC test-methods, alone (53%) or + BRAF (54%), and the FDG-PET/CT (47%) showed the lowest F1 score among all. When test-methods were analyzed using the DOR we observed that the best value was obtained by BRAF mutation analysis (247), followed by M/F panel by NGS (121) and by M/F panel + miRNA GEC (44). GAL-3-ICC showed a good DOR (27). A lower DOR was measured for M/F panel alone (14), GEC alone (10), TSHR mRNA (10) and MIBI-Scan (10), while the lowest values were observed for GEC + BRAF (8) and FGD-PET/CT (6).
Tests classified according to their cost, effectiveness and feasibility
In the effort to control expenses we focused our attention not only on the possible benefits, practical feasibility and the diagnostic value of each test-method but also on the single test cost and, hence, the estimated costs for the community. Costs were expressed as 2016 USD (1 USD = 1,1306 Euro) . A comparative analysis of the costs is shown in Table 3. All molecular based test-methods require the use of sophisticated instruments and reagents by specialized physicians in centralized well-equipped molecular laboratories and that is the reason why they are very expensive. In particular, the cost of each single GEC test was the highest one (3,200 USD/test) and the cost for a single M/F panel-based was 2,250 USD/test for Quest Diagnostic, 1,675 USD/test for ThyGenX® alone and 4,975 USD/test for the combination of ThyGenX® + ThyraMIR™. Compared to these molecular approaches, GAL-3-ICC is by far one of the cheapest, with its cost of 113 USD/test. Moreover GAL-3-ICC analysis is easy to be performed in any clinical context, in which a conventional surgical pathology laboratory is equipped to provide an immuno-cyto/histochemistry service. This assay integrates the diagnostic performance of conventional thyroid FNA-cytology and use the same cell substrates, which can be morphologically classified. Methods and reagents for GAL-3-ICC have been standardized for clinical use . TSHR mRNA blood assay and BRAF mutation analysis are also cheap with their costs of 97.45 USD/test and 300 USD/test respectively. Unlike the other test-methods, TSHR mRNA blood assay doesn’t require an FNA sampling of the thyroid nodule. The average cost of FDG-PET/CT is 1,132 USD/test  and it is similar to that for MIBI-Scan (1,648 USD/test) . Both these procedures can only be performed in a highly specialized radiology and nuclear medicine Units, and they expose patients to radiations, that can be reduced if only the thyroid bed is scanned. However, for these reasons they are not recommended as routine screening methods. The comparative combined analysis of cost and effectiveness of the test-methods included in the study was conducted using both the two-dimensional (Figure 5) and the three-dimensional scatterplot diagrams (Figure 6). In the two-dimensional diagram the most accurate test-methods are plotted on the right part and the cheapest on the lower part of the diagram. GAL-3-ICC is the only test method to be plotted in the most favorable lower right part of the diagram, showing the best combination of high accuracy (84%) and low cost (113 USD/test). Cost and effectiveness of this procedure is optimal and, therefore, it represents a suitable screening method for the preoperative characterization of indeterminate thyroid nodules on a large-scale basis. BRAF mutation analysis and TSHR mRNA blood assay also ranked as cheap test-methods (97.45 USD/test and 300 USD/test respectively), but they showed lower accuracy rate (73% and 76% respectively) and they are, therefore, both plotted in the left lower part of the diagram. The three methods based on M/F panel analysis were located in the upper right part of the diagram, indicating an excellent accuracy but a high cost. Among them the one that is based on the NGS technique showed the best accuracy (92%), but its cost was rather high (3,200 USD/test). The two test-methods based on GEC analysis are both located in upper left part of the diagram, indicating a rather unsatisfactory combination of low accuracy and high cost, compared to the other test-methods analyzed. FDG-PET/CT and MIBI-Scan showed a combination of intermediate values of both accuracy (65% and 79% respectively) and cost (both tests > 1,000 USD and < 2,000 USD). To better analyze the effectiveness and cost sensitivity, specificity and cost of each single test was visualized on a three-dimensional scatterplot diagram (Figure 6). The diagram indicates that, as previously observed, the two molecular test-methods characterized by very high sensitivity, namely GEC alone and GEC + BRAF, do not combine this favorable feature with a correspondingly high specificity and, in addition, they are among the most expensive ones. For this reason they are plotted in the left/posterior/high sector of the 3D diagram. BRAF mutation, characterized by absolute specificity and low sensitivity, is one of the cheapest ones and is, therefore, plotted in right/anterior/low sector of the 3D diagram. M/F panel based test-methods, especially the one analyzed by NGS and the M/F panel + miRNA CEG, reached an excellent combination of very high sensitivity and very high specificity. However, the clinical use of all these molecular-based test-methods is hampered by its very high cost. FDG-PET/CT and MIBI-Scan are both characterized by a medium cost of each single exam. However, MIBI-Scan showed a slightly better specificity, while FDG-PET/CT was characterized by a slightly better sensitivity. The test-method that showed the best combination of high sensitivity, high specificity and low cost is the GAL-3-ICC, characterized, in fact, by good specificity (85%) and sensitivity (83%), combined with a very low cost (113 USD). This test-method, the only one that is plotted in the anterior and lower part of the 3D diagram, appears to be suitable to be chosen as a screening test on large-scale basis.
Figure 5: Comparative two-dimensional scatterplot diagram of cost and accuracy of each test-method. Arbitrary cut-off lines at 80% of accuracy and at 1,000 and 2,000 USD were included in the diagram.
Figure 6: Comparative three-dimensional scatterplot diagram of cost, sensitivity and specificity of each test-method. Arbitrary cut-off lines at 80% of sensitivity, at 80% of specificity and at 1,500 of single test cost, expressed in USD, were included in the diagram.
Proposed diagnostic algorithm for indeterminate thyroid nodules
Based on the results of our comparative analysis we propose an algorithm that includes cytology and other ancillary test-methods in the management of patients with thyroid nodules (Figure 7). The advantage of this algorithm relies in the reduction of unnecessary surgery by means of a first level, low-cost test-method, which can be integrated, in selected cases, with a second-level high-cost molecular-based test-method. In fact, on the basis of our comparative data, we believe that patients with indeterminate thyroid nodules should be initially considered for GAL-3-ICC, a low-cost procedure that proved to be sufficiently highly sensitive and specific. Thyroid nodules with indeterminate cytology that were positive at GAL-3-ICC analysis should be considered for surgery, while GAL-3-ICC negative ones can be monitored by repeated ultrasonographic evaluation, without surgery, as recently suggested . Molecular-based test-methods should be considered as second-line tests, appropriate in high-income Countries where highly specialized molecular genetics laboratory are available. In GAL-3-ICC-positive nodules the use of a more efficient rule-in test, such as M/F panel by NGS, would be useful to confirm malignancy and to better plan the extent of thyroidectomy. Conversely, in GAL-3-ICC-negative nodules the use of a more efficient rule-out test, such as GEC, would allow a better and prompt identification of the possible GAL-3-ICC false negative results. The use of GAL-3-ICC was also proposed in suspicious for malignancy thyroid nodules, in association with HBME-1, to reduce surgical risk especially in elderly patients with advanced age and co-morbidities . A detailed cost-effectiveness analysis of the GAL-3-ICC is needed to compare results obtained with either GEC  or M/F panel , both characterized by a favorable cost-effectiveness profile when compared to standard of care and, in particular, to surgery. The real cost-effectiveness of the proposed algorithm also remains to be systematically analyzed.
Figure 7: Algorithm for management of thyroid nodules.
Preoperative characterization of thyroid nodules is one of the major problems in the clinical practice . Thyroid FNA-cytology consistently improved preoperative cancer detection but the finding of indeterminate follicular lesions still represents an area of ambiguity . Clinical criteria, ultrasonography as well as scintigraphy, should always be considered in the management of such nodules, but they are not accurate enough in ruling-in or ruling-out thyroid malignancies, because their unfavorable likelihood ratios [28, 98, 99]. Founded on these criteria, many unnecessary surgical procedures are still performed to remove benign lesions [29, 100–103]. The real innovation in this field, however, is the availability of new techniques, designed to identify specific genetic and epigenetic markers of thyroid malignancy. Whether their accuracy is good enough to significantly ameliorate diagnosis and treatment of such patients and, most important, to justify their cost is an open question. The AACE Thyroid scientific Committee evaluated these molecular test-methods, together with a TSHR mRNA blood assay, and stated that, these diagnostic approaches cannot replace the traditional clinical, US and cytopathology criteria, but integrate them . The same issue was raised by the American Thyroid Association Clinical Affairs Committee, which concluded that no evidence-based recommendation could be made in favor or against the use of these methods, but they should be used with caution after a careful case-by-case evaluation . A projected five-years cost-effectiveness analysis of the GEC, estimated that its translation in the clinical practice would result in a reduction of approximately 2,000 USD/patient, in a hypothetical cohort of subjects bearing indeterminate thyroid nodules, primarily because of the reduction of unnecessary diagnostic surgery . Despite the large number of studies recently published on this field, especially those comparing new molecular-based test-methods characterized by rule-out versus rule-in approaches , there is lack of studies comparing these methods with all the others currently available, in term of diagnostic accuracy, feasibility, and most importantly in term of their cost. Our comparative analysis is based on data obtained from different populations in different settings and in different Countries and, therefore, it should not be considered as a formal comparison among cost-effectiveness analyses. Our intention was to perform a comparison of the diagnostic abilities and single test cost of competing test-methods available, all intended to ameliorate thyroid cancer detection among indeterminate thyroid nodules. Comparative analysis was performed not only using the classical indicators of sensitivity and specificity, but also using the likelihood ratios, that have been reported to be more useful [87–89]. Considering the specific features of each test a diagnostic algorithm for the clinical management of indeterminate thyroid nodules was recently proposed . According to this flow chart, the GEC test-methods should be routinely used to rule-out malignancy. However, data reported in the literature and the present analysis, clearly indicate that the M/F panel + miRNA GEC and M/F by NGS could perform equally well in this context. In the same algorithm the use of M/F panel has been restricted to confirm malignancy in nodules suspicious for malignancy (thy4 according to BTA, tir4 according to SIE/AIT/AME/SIAPEC and category V, according to the Bethesda System), commonly referred to surgery, for a more appropriate planning of the extent of surgery (i.e. lobectomy vs total thyroidectomy). Although some concern has been raised regarding the ability of M/F panel to rule-out cancer, because even if the M/F panel includes the largest set of known mutations, it is possible to detect only a portion of thyroid carcinomas , the limitation in the use of the M/F panel appears not justified. The results of the present comparative analysis clearly indicate that M/F panel by NGS, in fact, reached an optimal results in term of sensitivity, specificity, likelihood ratios, accuracy and DOR and represents the most effective test-method that combines the ability in excluding (ruling-out) and in identifying (ruling-in) thyroid malignancy (Table 3 and Figure 4). The same result is obtained when likelihood ratios (Figure 5), accuracy (Figure 6) or DOR (Table 3) are considered. Interestingly, when the test-methods are analyzed in terms of cost and feasibility, the scenario changes. The two new molecular-based test-methods, either alone or in combination with additional molecular tests, markedly differ from the others because their costs exceed the limit of 2,000 USD (Figure 5 and Figure 6). Therefore, it seems unlikely that these methods will be used as screening test-methods in the next future, especially in low-income Countries . Moreover, for optimal performance these molecular assays require centralization in a super specialized laboratory. The cost for FDG-PET/CT in Europe is approximately 1,132 USD . However, it should be emphasized that this technique as well as the MIBI-Scan requires a specialized division and a trained team of experts. In addition, these exams expose the patients to potentially damaging radiations. In this regard, it has been calculated by the International Atomic Energy Agency (see IAEA, safety reports series no. 58, 2008) that the total effective dose for the whole body FDG–PET/CT averages 25 mSv, with 8 mSv due to PET and 7-30 mSv due to CT scan elements and final diagnostic scan . Even if the dose can be lowered by examining only the neck, this method appears not suitable as a screening method for thyroid nodules population with indeterminate cytology. The charge for both BRAF mutation analysis and TSHR mRNA blood assay is effectively low, with a reported cost of 97.45 and 300 USD/test respectively. Considering their good diagnostic performance as rule-in tests, they could represent a suitable potential screening test for characterizing thyroid nodules with indeterminate cytology. However, use of BRAF mutation analysis is hampered by a rather low sensitivity. It is expressed in a fraction of papillary thyroid cancer (PTC) and in anaplastic thyroid cancer arising from PTC as well as in the follicular variant of PTC (FVPTC), but not in follicular thyroid cancer (FTC) [108, 109]. The indeterminate category is mainly constituted of FVPTC, FTC, adenomatoid hyperplasia, and follicular adenoma, all of which harbor low prevalence of BRAF mutation. It is, therefore, hard for BRAF testing to determine malignancy in this category of nodules. FVPTC and FTC may therefore represent the main source of false-negative results . The published data for TSHR mRNA are too preliminary and are affected by some selection bias. Pooled cancer prevalence in reported studies concerning both BRAF mutation and TSHR mRNA were rather high (45% and 44% respectively), comparable to the highest value observed and reported in South Korea (47.4%) , suggesting possible selection bias (Table 1). In addition mRNA stability in peripheral blood may represent a limitation, which could affect the diagnostic accuracy of this specific test. There is still need for high quality validation studies before recommending the use of this procedure in large clinical settings. The clinically validated test-method with one of the lowest cost is, indeed, the GAL-3-ICC. The cost of this test-method (113 USD/test) is very competitive, compared with those estimated for FDG-PET/CT and is remarkably low compared to that reported for the molecular genetic test-methods (up to 20 times cheaper). For this reason it has been previously suggested that GAL-3-ICC could have a potential screening role, particularly in low-income Countries . The present comparative analysis shows that GAL-3-ICC performs well both as an efficient rule-out and rule-in test-method, with rather good likelihood ratios and diagnostic accuracy. As previously suggested its clinical utility is, therefore, very high [111, 112]. Visualization of sensitivity, specificity, likelihood ratios, accuracy and, more importantly, cost, in both two- and three-dimensional scatterplot diagrams, clearly indicates that GAL-3-ICC represents, at the present time, the candidate test-method to be chosen on large-scale basis. Moreover, GAL-3-ICC uses conventional FNA cytological substrates, is very easy to be performed in different clinical settings and does not require to be centralized in high specialized laboratories. Recently, we demonstrated that the sensitivity of GAL-3-ICC can be further improved by combination with clinical and ultrasound follow-up of negative nodules . For all these reasons GAL-3-ICC can be proposed as a screening test-method for the preoperative characterization of indeterminate thyroid nodules in different clinical settings. GAL-3-ICC was recently included in a new algorithm for the management of patients with indeterminate FNA that was based on four different markers . According to this decision model the use of GAL-3-ICC was suggested in those indeterminate nodules that were negative for BRAF mutation. In addition, to further increase diagnostic accuracy, the indeterminate nodules that were negative at both BRAF mutation analysis and GAL-3-ICC were finally evaluated by real-time RT-PCR assay to detect miR-221/miR-222 expression. The proposed original sequential combination of these 4 low-cost markers may eventually lead to a better definition without increasing too much the cost. It is likely that further technical improvements of each one of the test-methods considered in this analysis, as well as the optimal combination of them, will shortly lead to a corresponding increases in the overall diagnostic accuracy and cost-effectiveness. Results of the present analysis are summarized in a proposed comprehensive algorithm (Figure 7), which differs from that previously suggested by Xing , because we include GAL-3-ICC as the initial screening test-method for indeterminate thyroid nodules. In case of negative test, the nodule will be monitored and eventually re-biopsied during follow-up. In those suspicious cases, in which a more accurate exclusion of malignancy is required, an additional test, with higher sensitivity/NPV (such as M/F panel by NGS and GEC) may be considered. In case of positive test, the nodule should be directly referred to surgery. However, in high-income Countries, an additional test, with higher specificity/PPV (such as the BRAF mutation analysis or M/F panel by NGS) may be suggested to confirm malignancy and confidently plane in advance the extent of surgery.
Considering that the occurrence of indeterminate thyroid nodules at conventional cytology has been reported in approximately 10-40% of FNA specimens , the cost saving offered by the proposed GAL-3-ICC based approach would result significant for Thyroid Centers that examine thousands of patients per year, not only in low-income countries.
MATERIALS AND METHODS
Literature search and study selection
We performed a systematic review and meta-analysis on the selected test-methods used for the identification of thyroid cancer in indeterminate thyroid nodules, following current protocols and guidelines . A systematic search was performed on September 9, 2016, with PubMed database. We used a search query containing a combination of Medical Subject Headings (MeSH) or keywords and truncated synonyms (Boolean operators). The process of article search and selection is reported in a four-phase flow of information diagram, modified from that indicated in the PRISMA statement  (Figure 1). Briefly, PubMed search was initially performed by using the following search terms: “thyroid neoplasms”[MeSH Terms] OR “thyroid”[All Fields] AND “neoplasms”[All Fields] OR “thyroid neoplasms”[All Fields] OR “thyroid”[All Fields] AND “cancer”[All Fields] OR “thyroid cancer”[All Fields] OR nodule[All Fields] AND “diagnosis”[Subheading] OR “diagnosis”[All Fields] OR “diagnosis”[MeSH Terms] AND (“biomarkers”[MeSH Terms] OR “biomarkers”[All Fields] OR “marker”[All Fields] AND hasabstract[text] AND “2000/01/01”[PDAT] : “2016/12/31”[PDAT] AND English[lang]. A total of 29,307 papers were initially retrieved and then further reduced to 3,020 using the following additional search terms: “Galectin-3” [MeSH Terms], “BRAF mutation analysis” [MeSH Terms], “Gene Expression Classifier” [MeSH Terms], “FDG-PET/CT” [MeSH Terms], MIBI scan [MeSH Terms], “TSHR mRNA” [MeSH Terms] and “mutation/fusion panel” [MeSH Terms]. For each test-method selected we retrieved available information regarding the cost of a single test, as reported below. In particular, 259 papers were retrieved using the term “Galectin-3”, 1,060 with “BRAF mutation analysis”, 64 with “Gene Expression Classifier”, 839 with “Mutation/fusion panel”, 596 with “FDG-PET/CT”, 156 with “MIBI-scan” and 46 using the term “TSHR mRNA”. Subsequently, another selection criteria was applied using the term “Fine Needle Aspiration Cytology” that reduced the number of papers down to 83 for Galectin-3-ICC, to 224 for “BRAF mutation analysis”, to 44 for “Gene Expression Classifier”, to 143 for “Mutation Fusion Panel”, to 88 for “FDG-PET/CT”, to 26 for “MIBI-scan” and to 5 for “TSHR mRNA”. Finally, our comparative analysis was performed on those studies that, were chosen according to the following inclusion criteria: a) thyroid nodule population examined that was classified as thy3a/thy3f/tir3A/tir3B/III/IV/indeterminate thyroid nodules; b) studies that were based on more than 50 indeterminate thyroid lesions; c) studies in which all examined patients were surgically treated and cytologic reports as well as the results of the different test-methods used were verified at the final histology; d) validation studies in which patients were recruited either in one single or in more than one clinical center. Conversely, studies showing the following exclusion criteria were not considered in this analysis: a) thyroid nodule population examined that was classified as suspicious for malignancy (thy4/tir4/V), unequivocal cancer at cytology (thy5/tir5/VI) and follicular tumors with undefined malignant potential (FTUMP); b) studies that were based on less than 50 cases; c) post-validation studies in which not all patients were surgically treated and/or the final histology was lacking; d) studies in which the exact number of true and false positive and negative cases wasn’t clearly reported. No specific data have been published yet regarding the diagnostic accuracy of anyone of the different test-methods examined in the new recently proposed nosological thyroid cancer entity, named “encapsulated follicular variant of papillary thyroid carcinoma” (EFVPTC)  that was not included in the study. By adopting such criteria we were able to select a total of 9 papers for GAL-3-ICC, 24 for BRAF mutation analysis, 2 for GEC, 9 for M/F panel, 1 for FDG-PET/CT, 3 for MIBI-Scan and 2 for TSHR mRNA. Study eligibility and quality appraisal of retrieved full-text articles were all evaluated and graded independently by 2 investigators. Discrepancies were resolved by consensus. All these selected studies were included in the present comparative analysis.
Analysis of study heterogeneity
The possible occurrence of systematic heterogeneity was evaluated in the four test-methods subjected to meta-analysis using the forest plot. In order to use the appropriate method significance of heterogeneity was preliminary assessed for each method and fixed effect model, according to the method of Mantel and Haenszel  was used for the analysis of BRAF mutation and MIBI-Scan selected studies, while random effect model, using the method of DerSimonian and Laird , was applied for the analysis of GAL3-ICC and M/F panel selected studies. The estimate of heterogeneity was obtained using the Mantel–Haenszel model . The software used for meta-analysis was the Stata Statistical Software (Release 12, 2011, StataCorp LP, College Station, TX) [115, 116].
Analysis of diagnostic test accuracy
Diagnostic performances of the seven different test-methods considered in the analysis were evaluated by applying the basic 2-by-2-table for estimating the diagnostic accuracy of a dichotomous or dichotomized quantitative test result. Patients with follicular thyroid proliferations with and without atypia as well as Hürthle cell follicular proliferations were included in the calculations, while follicular tumors with undefined malignant potential (FT-UMP) were excluded from statistical analyses because they remain indeterminate also at final histology. For each reported test-method sensitivity, specificity, PPV, NPV, FPR, FNR, FDR, LR+ and LR-, Cancer risk rate in positive test and Cancer risk rate in negative test were calculated, as well as three measures of diagnostic test accuracy, namely accuracy, F1 score and DOR. The following formulas were used for calculations: sensitivity or true positive rate (TPR)=TP/(TP+FN), negative predictive value (NPV)=TN/(TN+FN), cancer risk in negatives test=FN/(FN+TN), false negative rate (FNR)=1-TPR, negative likelihood ratio (LR-)=(FN/(TP+FN))/(TN/(FP+TN)), specificity or true negative rate (TNR)=TN/(TN+FP), cancer risk in positives test or positive predictive value (PPV)=TP/(TP+FP), false positive rate (FPR)=1-TNR, positive likelihood ratio (LR+)=(TP/(TP+FN))/(FP/(FP+TN)), accuracy=(TP+TN)/(P+N), F1 score=2TP/(2TP+FP+FN), and diagnostic odds ratio (DOR)=(TP/FP)/(FN/TN). The diagnostic performance values of all studies included in the meta-analyses were pooled together.
Comparative two- and three-dimensional scatterplot diagrams
In order to comparatively evaluate accuracy, sensitivity, specificity and costs of each test-method two- and three-dimensional scatterplot diagrams were analyzed and visualized using the Stata Statistical Software (Release 12, 2011, StataCorp LP, College Station, TX) [115, 116] and the online visualization option from Plotly .
Reported cost of each test-method
A detailed cost effectiveness analysis is available for only few methods, while for the others we are able to report only the cost of each single test. In particular, for Gal-3-ICC a detailed study regarding its cost efficacy has not been performed so far. The cost of a single Gal-3-ICC test may change in the different context but, as an average in Italy, it can be estimated as 100 euro, corresponding to 113 USD (1 USD = 1.1306 EUR) . A projected five-years cost-effectiveness analysis of the GEC was published in 2011 . According to this study and to another recently published study , the base case cost of this test-method is 3,200 USD. The reported cost of BRAF mutation analysis is 475 USD [118, 119]. Combination of the cost of this test together with the cost of the GEC alone, gives a total price of 3,675 USD. The BRAF medical cost is USD 97,45 (range 55-123) according to published studies as well as Medicare reimbursement rate [95, 120]. A detailed cost-effectiveness analysis of M/F panel applied to FNA samples was performed and published . The single test cost is 2,250 USD. Medicare reimbursement is currently 650 USD, while private reimbursement is 950 USD . The cost of a single test using the M/F panel by NGS was reported to be 3,200 USD . The Medicare reimbursement for the TSHR mRNA test is 300 USD . To date a cost efficacy analysis for this method has not been published yet. An accurate cost-effectiveness analysis of FDG-PET/CT was recently published . The mean cost of a single FDG-PET/CT in the Netherlands was 1,002 EUR , equivalent to 1,132 USD/test  and is similar to that reported in Great Britain  and in Germany . In the United States, the Medicare program provides reimbursement for PET and PET/CT. In particular, for examinations performed on inpatients or at hospital outpatient departments, a median amount of 952.83 USD is reimbursed. The cost as well as the radiation exposure, expressed in terms of millisievert (mSv), can be lowered if the scan is restricted to the neck and focused to the thyroid bed. The reported mean cost of a single MIBI-Scan in Germany was 1,459 EUR , equivalent to 1,648 USD/test .
SS, CB, GPDF, LBS, CD, MT and AB contributed to the study design and are responsible for the searching in the scientific literature and data collection. SS and CD performed the statistical analysis of the data. SS was responsible for the writing of the report. LL, FM and AU contributed to production of the artwork. All authors contributed to review of the report and approved the final submitted version.
The authors dedicate this article to the memory of Prof. Mario Andreoli, a pioneer in the field of thyroid research, an excellent endocrinologist, a great mentor and a good friend.
CONFLICTS OF INTEREST
The authors declare no conflicts of interest.
1. Perros P, Boelaert K, Colley S, Evans C, Evans RM, Gerrard Ba G, Gilbert J, Harrison B, Johnson SJ, Giles TE, Moss L, Lewington V, Newbold K, et al. Guidelines for the management of thyroid cancer. Clin Endocrinol (Oxf). 2014; 81:1–122.
2. Cibas ES, Ali SZ. The Bethesda System for Reporting Thyroid Cytopathology. Thyroid. 2009; 19:1159–65.
3. Nardi F, Basolo F, Crescenzi A, Fadda G, Frasoldati A, Orlandi F, Palombini L, Papini E, Zini M, Pontecorvi A, Vitti P. Italian consensus for the classification and reporting of thyroid cytology. J Endocrinol Invest. 2014; 37:593–99.
4. Haugen BR, Alexander EK, Bible KC, Doherty GM, Mandel SJ, Nikiforov YE, Pacini F, Randolph GW, Sawka AM, Schlumberger M, Schuff KG, Sherman SI, Sosa JA, et al. 2015 American Thyroid Association Management Guidelines for Adult Patients with Thyroid Nodules and Differentiated Thyroid Cancer: The American Thyroid Association Guidelines Task Force on Thyroid Nodules and Differentiated Thyroid Cancer. Thyroid. 2016; 26:1–133.
5. Baloch ZW, Fleisher S, LiVolsi VA, Gupta PK. Diagnosis of “follicular neoplasm”: a gray zone in thyroid fine-needle aspiration cytology. Diagn Cytopathol. 2002; 26:41–44.
6. Davis NL, Gordon M, Germann E, Robins RE, McGregor GI. Clinical parameters predictive of malignancy of thyroid follicular neoplasms. Am J Surg. 1991; 161:567–69.
7. Tuttle RM, Lemar H, Burch HB. Clinical features associated with an increased risk of thyroid malignancy in patients with follicular neoplasia by fine-needle aspiration. Thyroid. 1998; 8:377–83.
8. Raber W, Kaserer K, Niederle B, Vierhapper H. Risk factors for malignancy of thyroid nodules initially identified as follicular neoplasia by fine-needle aspiration: results of a prospective study of one hundred twenty patients. Thyroid. 2000; 10:709–12.
9. Kim ES, Nam-Goong IS, Gong G, Hong SJ, Kim WB, Shong YK. Postoperative findings and risk for malignancy in thyroid nodules with cytological diagnosis of the so-called “follicular neoplasm”. Korean J Intern Med. 2003; 18:94–97.
10. Sclabas GM, Staerkel GA, Shapiro SE, Fornage BD, Sherman SI, Vassillopoulou-Sellin R, Lee JE, Evans DB. Fine-needle aspiration of the thyroid and correlation with histopathology in a contemporary series of 240 patients. Am J Surg. 2003; 186:702–09.
11. Giorgadze T, Rossi ED, Fadda G, Gupta PK, Livolsi VA, Baloch Z. Does the fine-needle aspiration diagnosis of “Hürthle-cell neoplasm/follicular neoplasm with oncocytic features” denote increased risk of malignancy? Diagn Cytopathol. 2004; 31:307–12.
12. Pu RT, Yang J, Wasserman PG, Bhuiya T, Griffith KA, Michael CW. Does Hurthle cell lesion/neoplasm predict malignancy more than follicular lesion/neoplasm on thyroid fine-needle aspiration? Diagn Cytopathol. 2006; 34:330–34.
13. Wu HH, Jones JN, Osman J. Fine-needle aspiration cytology of the thyroid: ten years experience in a community teaching hospital. Diagn Cytopathol. 2006; 34:93–96.
14. Yassa L, Cibas ES, Benson CB, Frates MC, Doubilet PM, Gawande AA, Moore FD Jr, Kim BW, Nosé V, Marqusee E, Larsen PR, Alexander EK. Long-term assessment of a multidisciplinary approach to thyroid nodule diagnostic evaluation. Cancer. 2007; 111:508–16.
15. Yang J, Schnadig V, Logrono R, Wasserman PG. Fine-needle aspiration of thyroid nodules: a study of 4703 patients with histologic and clinical correlations. Cancer. 2007; 111:306–15.
16. Oertel YC, Miyahara-Felipe L, Mendoza MG, Yu K. Value of repeated fine needle aspirations of the thyroid: an analysis of over ten thousand FNAs. Thyroid. 2007; 17:1061–66.
17. Mihai R, Parker AJ, Roskell D, Sadler GP. One in four patients with follicular thyroid cytology (THY3) has a thyroid carcinoma. Thyroid. 2009; 19:33–37.
18. Banks ND, Kowalski J, Tsai HL, Somervell H, Tufano R, Dackiw AP, Marohn MR, Clark DP, Umbricht CB, Zeiger MA. A diagnostic predictor model for indeterminate or suspicious thyroid FNA samples. Thyroid. 2008; 18:933–41.
19. Theoharis CG, Schofield KM, Hammers L, Udelsman R, Chhieng DC. The Bethesda thyroid fine-needle aspiration classification system: year 1 at an academic institution. Thyroid. 2009; 19:1215–23.
20. Sorrenti S, Trimboli P, Catania A, Ulisse S, De Antoni E, D’Armiento M. Comparison of malignancy rate in thyroid nodules with cytology of indeterminate follicular or indeterminate Hürthle cell neoplasm. Thyroid. 2009; 19:355–60.
21. Asari R, Niederle BE, Scheuba C, Riss P, Koperek O, Kaserer K, Niederle B. Indeterminate thyroid nodules: a challenge for the surgical strategy. Surgery. 2010; 148:516–25.
22. Lubitz CC, Faquin WC, Yang J, Mekel M, Gaz RD, Parangi S, Randolph GW, Hodin RA, Stephen AE. Clinical and cytological features predictive of malignancy in thyroid follicular neoplasms. Thyroid. 2010; 20:25–31.
23. Rago T, Scutari M, Latrofa F, Loiacono V, Piaggi P, Marchetti I, Romani R, Basolo F, Miccoli P, Tonacchera M, Vitti P. The large majority of 1520 patients with indeterminate thyroid nodule at cytology have a favorable outcome, and a clinical risk score has a high negative predictive value for a more cumbersome cancer disease. J Clin Endocrinol Metab. 2014; 99:3700–07.
24. Rago T, Di Coscio G, Basolo F, Scutari M, Elisei R, Berti P, Miccoli P, Romani R, Faviana P, Pinchera A, Vitti P. Combined clinical, thyroid ultrasound and cytological features help to predict thyroid malignancy in follicular and Hupsilonrthle cell thyroid lesions: results from a series of 505 consecutive patients. Clin Endocrinol (Oxf). 2007; 66:13–20.
25. AIRTUM Working Group. Italian cancer figures, report 2009: cancer trend (1998-2005). Epidemiol Prev. 2009; 33:1–168.
26. AIOM-AIRTUM Working Group. I numeri del cancro in Italia AIOM-AIRTUM Report, in: Intermedia editors, Brescia, Italy; 2014. pp. 127-131.
27. de Roy van Zuidewijn DB, Songun I, Hamming J, Kievit J, van de Velde CJ, Veselic M. Preoperative diagnostic tests for operable thyroid disease. World J Surg. 1994; 18:506–10.
28. Maia FF, Zantut-Wittmann DE. Thyroid nodule management: clinical, ultrasound and cytopathological parameters for predicting malignancy. Clinics (Sao Paulo). 2012; 67:945–54.
29. Brito JP, Gionfriddo MR, Al Nofal A, Boehmer KR, Leppin AL, Reading C, Callstrom M, Elraiyah TA, Prokop LJ, Stan MN, Murad MH, Morris JC, Montori VM. The accuracy of thyroid nodule ultrasound to predict thyroid cancer: systematic review and meta-analysis. J Clin Endocrinol Metab. 2014; 99:1253–63.
30. Ianni F, Campanella P, Rota CA, Prete A, Castellino L, Pontecorvi A, Corsello SM. A meta-analysis-derived proposal for a clinical, ultrasonographic, and cytological scoring system to evaluate thyroid nodules: the “CUT” score. Endocrine. 2016; 52:313–21.
31. Xing M, Haugen BR, Schlumberger M. Progress in molecular-based management of differentiated thyroid cancer. Lancet. 2013; 381:1058–69.
32. Milas M, Shin J, Gupta M, Novosel T, Nasr C, Brainard J, Mitchell J, Berber E, Siperstein A. Circulating thyrotropin receptor mRNA as a novel marker of thyroid cancer: clinical applications learned from 1758 samples. Ann Surg. 2010; 252:643–51.
33. Vriens D, de Wilt JH, van der Wilt GJ, Netea-Maier RT, Oyen WJ, de Geus-Oei LF. The role of [18F]-2-fluoro-2-deoxy-d-glucose-positron emission tomography in thyroid nodules with indeterminate fine-needle aspiration biopsy: systematic review and meta-analysis of the literature. Cancer. 2011; 117:4582–94.
34. Saggiorato E, Angusti T, Rosas R, Martinese M, Finessi M, Arecco F, Trevisiol E, Bergero N, Puligheddu B, Volante M, Podio V, Papotti M, Orlandi F. 99mTc-MIBI Imaging in the presurgical characterization of thyroid follicular neoplasms: relationship to multidrug resistance protein expression. J Nucl Med. 2009; 50:1785–93.
35. Campennì A, Giovanella L, Siracusa M, Alibrandi A, Pignata SA, Giovinazzo S, Trimarchi F, Ruggeri RM, Baldari S. (99m)Tc-Methoxy-Isobutyl-Isonitrile Scintigraphy Is a Useful Tool for Assessing the Risk of Malignancy in Thyroid Nodules with Indeterminate Fine-Needle Cytology. Thyroid. 2016; 26:1101–09.
36. Febbo PG, Ladanyi M, Aldape KD, De Marzo AM, Hammond ME, Hayes DF, Iafrate AJ, Kelley RK, Marcucci G, Ogino S, Pao W, Sgroi DC, Birkeland ML. NCCN Task Force report: evaluating the clinical utility of tumor markers in oncology. J Natl Compr Canc Netw. 2011; 9:S1–32.
37. Xing M. BRAF mutation in thyroid cancer. Endocr Relat Cancer. 2005; 12:245–62.
38. Caronia LM, Phay JE, Shah MH. Role of BRAF in thyroid oncogenesis. Clin Cancer Res. 2011; 17:7511–17.
39. Liu FT, Rabinovich GA. Galectins as modulators of tumour progression. Nat Rev Cancer. 2005; 5:29–41.
40. Cecchinelli B, Lavra L, Rinaldo C, Iacovelli S, Gurtner A, Gasbarri A, Ulivieri A, Del Prete F, Trovato M, Piaggio G, Bartolazzi A, Soddu S, Sciacchitano S. Repression of the antiapoptotic molecule galectin-3 by homeodomain-interacting protein kinase 2-activated p53 is required for p53-induced apoptosis. Mol Cell Biol. 2006; 26:4746–57.
41. Xu XC, el-Naggar AK, Lotan R. Differential expression of galectin-1 and galectin-3 in thyroid tumors. Potential diagnostic implications. Am J Pathol. 1995; 147:815–22.
42. Bartolazzi A, Gasbarri A, Papotti M, Bussolati G, Lucante T, Khan A, Inohara H, Marandino F, Orlandi F, Nardi F, Vecchione A, Tecce R, Larsson O, and Thyroid Cancer Study Group. Application of an immunodiagnostic method for improving preoperative diagnosis of nodular thyroid lesions. Lancet. 2001; 357:1644–50.
43. Bartolazzi A, Orlandi F, Saggiorato E, Volante M, Arecco F, Rossetto R, Palestini N, Ghigo E, Papotti M, Bussolati G, Martegani MP, Pantellini F, Carpi A, et al. Galectin-3-expression analysis in the surgical selection of follicular thyroid nodules with indeterminate fine-needle aspiration cytology: a prospective multicentre study. Lancet Oncol. 2008; 9:543–49.
44. de Matos LL, Del Giglio AB, Matsubayashi CO, de Lima Farah M, Del Giglio A, da Silva Pinhal MA. Expression of CK-19, galectin-3 and HBME-1 in the differentiation of thyroid lesions: systematic review and diagnostic meta-analysis. Diagn Pathol. 2012; 7:97.
45. Piccardo A, Puntoni M, Treglia G, Foppiani L, Bertagna F, Paparo F, Massollo M, Dib B, Paone G, Arlandini A, Catrambone U, Casazza S, Pastorino A, et al. Thyroid nodules with indeterminate cytology: prospective comparison between 18F-FDG-PET/CT, multiparametric neck ultrasonography, 99mTc-MIBI scintigraphy and histology. Eur J Endocrinol. 2016; 174:693–703.
46. Giovanella L, Campenni A, Treglia G, Verburg FA, Trimboli P, Ceriani L, Bongiovanni M. Molecular imaging with (99m)Tc-MIBI and molecular testing for mutations in differentiating benign from malignant follicular neoplasm: a prospective comparison. Eur J Nucl Med Mol Imaging. 2016; 43:1018–26.
47. Hodak SP, Rosenthal DS, and American Thyroid Association Clinical Affairs Committee. Information for clinicians: commercially available molecular diagnosis testing in the evaluation of thyroid nodule fine-needle aspiration specimens. Thyroid. 2013; 23:131–34.
48. Heinzel A, Müller D, Behrendt FF, Giovanella L, Mottaghy FM, Verburg FA. Thyroid nodules with indeterminate cytology: molecular imaging with 99mTc-methoxyisobutylisonitrile (MIBI) is more cost-effective than the Afirma gene expression classifier. Eur J Nucl Med Mol Imaging. 2014; 41:1497–500.
49. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009; 6:e1000100.
50. Chia SY, Milas M, Reddy SK, Siperstein A, Skugor M, Brainard J, Gupta MK. Thyroid-stimulating hormone receptor messenger ribonucleic acid measurement in blood as a marker for circulating thyroid cancer cells and its role in the preoperative diagnosis of thyroid cancer. J Clin Endocrinol Metab. 2007; 92:468–75.
51. Nikiforov YE, Steward DL, Robinson-Smith TM, Haugen BR, Klopper JP, Zhu Z, Fagin JA, Falciglia M, Weber K, Nikiforova MN. Molecular testing for mutations in improving the fine-needle aspiration diagnosis of thyroid nodules. J Clin Endocrinol Metab. 2009; 94:2092–98.
52. Nikiforov YE, Ohori NP, Hodak SP, Carty SE, LeBeau SO, Ferris RL, Yip L, Seethala RR, Tublin ME, Stang MT, Coyne C, Johnson JT, Stewart AF, Nikiforova MN. Impact of mutational testing on the diagnosis and management of patients with cytologically indeterminate thyroid nodules: a prospective analysis of 1056 FNA samples. J Clin Endocrinol Metab. 2011; 96:3390–97.
53. Moses W, Weng J, Sansano I, Peng M, Khanafshar E, Ljung BM, Duh QY, Clark OH, Kebebew E. Molecular testing for somatic mutations improves the accuracy of thyroid fine-needle aspiration biopsy. World J Surg. 2010; 34:2589–94.
54. Labourier E, Shifrin A, Busseniers AE, Lupo MA, Manganelli ML, Andruss B, Wylie D, Beaudenon-Huibregtse S. Molecular Testing for miRNA, mRNA, and DNA on Fine-Needle Aspiration Improves the Preoperative Diagnosis of Thyroid Nodules With Indeterminate Cytology. J Clin Endocrinol Metab. 2015; 100:2743–50.
55. Eszlinger M, Krogdahl A, Münz S, Rehfeld C, Precht Jensen EM, Ferraz C, Bösenberg E, Drieschner N, Scholz M, Hegedüs L, Paschke R. Impact of molecular screening for point mutations and rearrangements in routine air-dried fine-needle aspiration samples of thyroid nodules. Thyroid. 2014; 24:305–13.
56. Gill MS, Nayan S, Kocovski L, Cutz JC, Archibald SD, Jackson BS, Young JE, Gupta MK. Local molecular analysis of indeterminate thyroid nodules. J Otolaryngol Head Neck Surg. 2015; 44:52.
57. Liu S, Gao A, Zhang B, Zhang Z, Zhao Y, Chen P, Ji M, Hou P, Shi B. Assessment of molecular testing in fine-needle aspiration biopsy samples: an experience in a Chinese population. Exp Mol Pathol. 2014; 97:292–97.
58. Eszlinger M, Piana S, Moll A, Bösenberg E, Bisagni A, Ciarrocchi A, Ragazzi M, Paschke R. Molecular testing of thyroid fine-needle aspirations improves presurgical diagnosis and supports the histologic identification of minimally invasive follicular thyroid carcinomas. Thyroid. 2015; 25:401–09.
59. Nikiforov YE, Carty SE, Chiosea SI, Coyne C, Duvvuri U, Ferris RL, Gooding WE, LeBeau SO, Ohori NP, Seethala RR, Tublin ME, Yip L, Nikiforova MN. Impact of the Multi-Gene ThyroSeq Next-Generation Sequencing Assay on Cancer Diagnosis in Thyroid Nodules with Atypia of Undetermined Significance/Follicular Lesion of Undetermined Significance Cytology. Thyroid. 2015; 25:1217–23.
60. Alexander EK, Kennedy GC, Baloch ZW, Cibas ES, Chudova D, Diggans J, Friedman L, Kloos RT, LiVolsi VA, Mandel SJ, Raab SS, Rosai J, Steward DL, et al. Preoperative diagnosis of benign thyroid nodules with indeterminate cytology. N Engl J Med. 2012; 367:705–15.
61. Kloos RT, Reynolds JD, Walsh PS, Wilde JI, Tom EY, Pagan M, Barbacioru C, Chudova DI, Wong M, Friedman L, LiVolsi VA, Rosai J, Lanman RB, Kennedy GC. Does addition of BRAF V600E mutation testing modify sensitivity or specificity of the Afirma Gene Expression Classifier in cytologically indeterminate thyroid nodules? J Clin Endocrinol Metab. 2013; 98:E761–68.
62. Traugott AL, Dehdashti F, Trinkaus K, Cohen M, Fialkowski E, Quayle F, Hussain H, Davila R, Ylagan L, Moley JF. Exclusion of malignancy in thyroid nodules with indeterminate fine-needle aspiration cytology after negative 18F-fluorodeoxyglucose positron emission tomography: interim analysis. World J Surg. 2010; 34:1247–53.
63. Cohen Y, Rosenbaum E, Clark DP, Zeiger MA, Umbricht CB, Tufano RP, Sidransky D, Westra WH. Mutational analysis of BRAF in fine needle aspiration biopsies of the thyroid: a potential application for the preoperative assessment of thyroid nodules. Clin Cancer Res. 2004; 10:2761–65.
64. Marchetti I, Lessi F, Mazzanti CM, Bertacca G, Elisei R, Coscio GD, Pinchera A, Bevilacqua G. A morpho-molecular diagnosis of papillary thyroid carcinoma: BRAF V600E detection as an important tool in preoperative evaluation of fine-needle aspirates. Thyroid. 2009; 19:837–42.
65. Zatelli MC, Trasforini G, Leoni S, Frigato G, Buratto M, Tagliati F, Rossi R, Cavazzini L, Roti E, degli Uberti EC. BRAF V600E mutation analysis increases diagnostic accuracy for papillary thyroid carcinoma in fine-needle aspiration biopsies. Eur J Endocrinol. 2009; 161:467–73.
66. Kim SW, Lee JI, Kim JW, Ki CS, Oh YL, Choi YL, Shin JH, Kim HK, Jang HW, Chung JH. BRAFV600E mutation analysis in fine-needle aspiration cytology specimens for evaluation of thyroid nodule: a large series in a BRAFV600E-prevalent population. J Clin Endocrinol Metab. 2010; 95:3693–700.
67. Kim SK, Hwang TS, Yoo YB, Han HS, Kim DL, Song KH, Lim SD, Kim WS, Paik NS. Surgical results of thyroid nodules according to a management guideline based on the BRAF(V600E) mutation status. J Clin Endocrinol Metab. 2011; 96:658–64.
68. Pelizzo MR, Boschin IM, Barollo S, Pennelli G, Toniato A, Zambonin L, Vianello F, Piotto A, Ide EC, Pagetta C, Sorgato N, Torresan F, Girelli ME, et al. BRAF analysis by fine needle aspiration biopsy of thyroid nodules improves preoperative identification of papillary thyroid carcinoma and represents a prognostic factor. A mono-institutional experience. Clin Chem Lab Med. 2011; 49:325–29.
69. Yeo MK, Liang ZL, Oh T, Moon Y, An S, Kim MK, Kim KS, Shong M, Kim JM, Jo YS. Pyrosequencing cut-off value identifying BRAFV600E mutation in fine needle aspiration samples of thyroid nodules. Clin Endocrinol (Oxf). 2011; 75:555–60.
70. Kang G, Cho EY, Shin JH, Chung JH, Kim JW, Oh YL. Role of BRAFV600E mutation analysis and second cytologic review of fine-needle aspiration for evaluating thyroid nodule. Cancer Cytopathol. 2012; 120:44–51.
71. Lee ST, Kim SW, Ki CS, Jang JH, Shin JH, Oh YL, Kim JW, Chung JH. Clinical implication of highly sensitive detection of the BRAF V600E mutation in fine-needle aspirations of thyroid nodules: a comparative analysis of three molecular assays in 4585 consecutive cases in a BRAF V600E mutation-prevalent area. J Clin Endocrinol Metab. 2012; 97:2299–306.
72. Rossi M, Buratto M, Bruni S, Filieri C, Tagliati F, Trasforini G, Rossi R, Beccati MD, Degli Uberti EC, Zatelli MC. Role of ultrasonographic/clinical profile, cytology, and BRAF V600E mutation evaluation in thyroid nodule screening for malignancy: a prospective study. J Clin Endocrinol Metab. 2012; 97:2354–61.
73. Koh J, Choi JR, Han KH, Kim EK, Yoon JH, Moon HJ, Kwak JY. Proper indication of BRAF(V600E) mutation testing in fine-needle aspirates of thyroid nodules. PLoS One. 2013; 8:e64505.
74. Park SJ, Sun JY, Hong K, Kwak JY, Kim EK, Chung WY, Choi JR. Application of BRAF, NRAS, KRAS mutations as markers for the detection of papillary thyroid cancer from FNAB specimens by pyrosequencing analysis. Clin Chem Lab Med. 2013; 51:1673–80.
75. Beaudenon-Huibregtse S, Alexander EK, Guttler RB, Hershman JM, Babu V, Blevins TC, Moore P, Andruss B, Labourier E. Centralized molecular testing for oncogenic gene mutations complements the local cytopathologic diagnosis of thyroid nodules. Thyroid. 2014; 24:1479–87.
76. Johnson SJ, Hardy SA, Roberts C, Bourn D, Mallick U, Perros P. Pilot of BRAF mutation analysis in indeterminate, suspicious and malignant thyroid FNA cytology. Cytopathology. 2014; 25:146–54.
77. Agretti P, Niccolai F, Rago T, De Marco G, Molinaro A, Scutari M, Di Cosmo C, Di Coscio G, Vitale M, Maccheroni M, Vitti P, Tonacchera M. BRAF mutation analysis in thyroid nodules with indeterminate cytology: our experience on surgical management of patients with thyroid nodules from an area of borderline iodine deficiency. J Endocrinol Invest. 2014; 37:1009–14.
78. Paskaš S, Janković J, Živaljević V, Tatić S, Božić V, Nikolić A, Radojković D, Savin S, Cvejić D. Malignant risk stratification of thyroid FNA specimens with indeterminate cytology based on molecular testing. Cancer Cytopathol. 2015; 123:471–79.
79. Krane JF, Cibas ES, Alexander EK, Paschke R, Eszlinger M. Molecular analysis of residual ThinPrep material from thyroid FNAs increases diagnostic sensitivity. Cancer Cytopathol. 2015; 123:356–61.
80. Saggiorato E, De Pompa R, Volante M, Cappia S, Arecco F, Dei Tos AP, Orlandi F, Papotti M. Characterization of thyroid ‘follicular neoplasms’ in fine-needle aspiration cytological specimens using a panel of immunohistochemical markers: a proposal for clinical application. Endocr Relat Cancer. 2005; 12:305–17.
81. Rossi ED, Raffaelli M, Minimo C, Mule A, Lombardi CP, Vecchio FM, Fadda G. Immunocytochemical evaluation of thyroid neoplasms on thin-layer smears from fine-needle aspiration biopsies. Cancer. 2005; 105:87–95.
82. Carpi A, Naccarato AG, Iervasi G, Nicolini A, Bevilacqua G, Viacava P, Collecchi P, Lavra L, Marchetti C, Sciacchitano S, Bartolazzi A. Large needle aspiration biopsy and galectin-3 determination in selected thyroid nodules with indeterminate FNA-cytology. Br J Cancer. 2006; 95:204–09.
83. Franco C, Martínez V, Allamand JP, Medina F, Glasinovic A, Osorio M, Schachter D. Molecular markers in thyroid fine-needle aspiration biopsy: a prospective study. Appl Immunohistochem Mol Morphol. 2009; 17:211–15.
84. Pennelli G, Mian C, Pelizzo MR, Naccamulli D, Piotto A, Girelli ME, Mescoli C, Rugge M. Galectin-3 cytotest in thyroid follicular neoplasia: a prospective, monoinstitutional study. Acta Cytol. 2009; 53:533–39.
85. Fadda G, Rossi ED, Raffaelli M, Pontecorvi A, Sioletic S, Morassi F, Lombardi CP, Zannoni GF, Rindi G. Follicular thyroid neoplasms can be classified as low- and high-risk according to HBME-1 and Galectin-3 expression on liquid-based fine-needle cytology. Eur J Endocrinol. 2011; 165:447–53.
86. Rossi ED, Bizzarro T, Martini M, Straccia P, Lombardi CP, Pontecorvi A, Larocca LM, Fadda G. The role of fine-needle aspiration in the thyroid nodules of elderly patients. Oncotarget. 2016; 7:11850–59. doi: 10.18632/oncotarget.7643.
87. Biggerstaff BJ. Comparing diagnostic tests: a simple graphic using likelihood ratios. Stat Med. 2000; 19:649–63.
88. Attia J. Moving beyond sensitivity and specificity: using likelihood ratios to help interpret diagnostic tests. Aust Prescr. 2003; 26:111–13.
89. McGee S. Simplifying likelihood ratios. J Gen Intern Med. 2002; 17:646–49.
90. Bank of Italy. Euro foreign exchange reference rates. https://www.bancaditalia.it/compiti/operazioni-cambi/cambio/cambi_rif_20160822. Accessed 23-08-16.
91. Bartolazzi A, Bellotti C, Sciacchitano S. Methodology and technical requirements of the galectin-3 test for the preoperative characterization of thyroid nodules. Appl Immunohistochem Mol Morphol. 2012; 20:2–7.
92. Vriens D, Adang EM, Netea-Maier RT, Smit JW, de Wilt JH, Oyen WJ, de Geus-Oei LF. Cost-effectiveness of FDG-PET/CT for cytologically indeterminate thyroid nodules: a decision analytic approach. J Clin Endocrinol Metab. 2014; 99:3263–74.
93. Sciacchitano S, Lavra L, Ulivieri A, Magi F, Porcelli T, Amendola S, De Francesco GP, Bellotti C, Trovato MC, Salehi LB, Bartolazzi A. Combined clinical and ultrasound follow-up assists in malignancy detection in Galectin-3 negative Thy-3 thyroid nodules. Endocrine. 2016; 54:139–47.
94. Li H, Robinson KA, Anton B, Saldanha IJ, Ladenson PW. Cost-effectiveness of a novel molecular test for cytologically indeterminate thyroid nodules. J Clin Endocrinol Metab. 2011; 96:E1719–26.
95. Yip L, Farris C, Kabaker AS, Hodak SP, Nikiforova MN, McCoy KL, Stang MT, Smith KJ, Nikiforov YE, Carty SE. Cost impact of molecular testing for indeterminate thyroid nodule fine-needle aspiration biopsies. J Clin Endocrinol Metab. 2012; 97:1905–12.
96. Mazzaferri EL. Thyroid cancer in thyroid nodules: finding a needle in the haystack. Am J Med. 1992; 93:359–62.
97. Paschke R, Hegedüs L, Alexander E, Valcavi R, Papini E, Gharib H. Thyroid nodule guidelines: agreement, disagreement and need for future research. Nat Rev Endocrinol. 2011; 7:354–61.
98. Cuasay AB, Alfonso CR, Cabatu RE. Prospective validation of clinical predictors scoring in determining thyroid malignancy. St Tomas J Med. 1999; 48:139–42.
99. Hamming JF, Goslings BM, van Steenis GJ, van Ravenswaay Claasen H, Hermans J, van de Velde CJ. The value of fine-needle aspiration biopsy in patients with nodular thyroid disease divided into groups of suspicion of malignant neoplasms on clinical grounds. Arch Intern Med. 1990; 150:113–16.
100. Evans DM. Diagnostic discriminants of thyroid cancer. Am J Surg. 1987; 153:569–70.
101. Hoffmann GL, Thompson NW, Heffron C. The solitary thyroid nodule: a reassessment. Arch Surg. 1972; 105:379–85.
102. Saxe AW. Thyroid scans and the diagnosis of carcinoma of the thyroid. Surg Gynecol Obstet. 1979; 149:729–30.
103. Bartolazzi A. Improving accuracy of cytology for nodular thyroid lesions. Lancet. 2000; 355:1661–62.
104. Bernet V, Hupart KH, Parangi S, Woeber KA. AACE/ACE disease state commentary: molecular diagnostic testing of thyroid nodules with indeterminate cytopathology. Endocr Pract. 2014; 20:360–63.
105. Eszlinger M, Hegedüs L, Paschke R. Ruling in or ruling out thyroid malignancy by molecular diagnostics of thyroid nodules. Best Pract Res Clin Endocrinol Metab. 2014; 28:545–57.
106. Pagan M, Kloos RT, Lin CF, Travers KJ, Matsuzaki H, Tom EY, Kim SY, Wong MG, Stewart AC, Huang J, Walsh PS, Monroe RJ, Kennedy GC. The diagnostic application of RNA sequencing in patients with thyroid cancer: an analysis of 851 variants and 133 fusions in 524 genes. BMC Bioinformatics. 2016; 17:6.
107. Brix G, Lechel U, Glatting G, Ziegler SI, Münzing W, Müller SP, Beyer T. Radiation exposure of patients undergoing whole-body dual-modality 18F-FDG PET/CT examinations. J Nucl Med. 2005; 46:608–13.
108. Musholt PB, Musholt TJ, Morgenstern SC, Worm K, Sheu SY, Schmid KW. Follicular histotypes of oncocytic thyroid carcinomas do not carry mutations of the BRAF hot-spot. World J Surg. 2008; 32:722–28.
109. Carta C, Moretti S, Passeri L, Barbi F, Avenia N, Cavaliere A, Monacelli M, Macchiarulo A, Santeusanio F, Tartaglia M, Puxeddu E. Genotyping of an Italian papillary thyroid carcinoma cohort revealed high prevalence of BRAF mutations, absence of RAS mutations and allowed the detection of a new mutation of BRAF oncoprotein (BRAF(V599lns)). Clin Endocrinol (Oxf). 2006; 64:105–09.
110. Su X, Jiang X, Xu X, Wang W, Teng X, Shao A, Teng L. Diagnostic value of BRAF (V600E)-mutation analysis in fine-needle aspiration of thyroid nodules: a meta-analysis. Onco Targets Ther. 2016; 9:2495–509.
111. Alexander EK. Approach to the patient with a cytologically indeterminate thyroid nodule. J Clin Endocrinol Metab. 2008; 93:4175–82.
112. Chiu CG, Strugnell SS, Griffith OL, Jones SJ, Gown AM, Walker B, Nabi IR, Wiseman SM. Diagnostic utility of galectin-3 in thyroid cancer. Am J Pathol. 2010; 176:2067–81.
113. Nikiforov YE, Seethala RR, Tallini G, Baloch ZW, Basolo F, Thompson LD, Barletta JA, Wenig BM, Al Ghuzlan A, Kakudo K, Giordano TJ, Alves VA, Khanafshar E, et al. Nomenclature revision for Encapsulated Follicular Variant of Papillary Thyroid Carcinoma: a paradigm shift to reduce overtreatment of indolent tumors. JAMA Oncol. 2016; 2:1023–29.
114. Bradburn MJ, Deeks JJ, Altman DG. Metan - an alternative meta-analysis command. Stata Tech Bull. 1998; STB-44:4–15.
115. Fox J. The R Commander: A Basic Statistics Graphical User Interface to R. J Stat Softw. 2005; 14:1–42.
116. R Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. 2015 ISBN 3-900051-07-0 URL https://www.R-project.org/.
117. Plotly Technologies Inc. Collaborative data science. Montréal, QC, 2015. https://plot.ly.
118. Nishino M. Molecular cytopathology for thyroid nodules: A review of methodology and test performance. Cancer Cytopathol. 2016; 124:14–27.
119. American Medical Association. CPT code/relative value search [cited 2013 Feb 1]. Available from: https://ocm.ama-assn.org/OCM/CPTRelativeValueSearch.do.
120. Illumina. Latest developments in molecular pathology rate setting [updated 2013; cited 2013 Oct]. http://res.illumina.com/documents/clinical/reimbursement-latest-developments-mopath.pdf.
121. Hodak SP, Rosenthal DS, and American Thyroid Association Clinical Affairs Committee. Information for clinicians: commercially available molecular diagnosis testing in the evaluation of thyroid nodule fine-needle aspiration specimens. Thyroid. 2013; 23:131–34.
122. Facey K, Bradbury I, Laking G, Payne E. Overview of the clinical effectiveness of positron emission tomography imaging in selected cancers. Health Technol Assess. 2007; 11: iii-iv, xi-267. https://doi.org/10.3310/hta11440.
123. Buck AK, Herrmann K, Stargardt T, Dechow T, Krause BJ, Schreyögg J. Economic evaluation of PET and PET/CT in oncology: evidence and methodologic approaches. J Nucl Med Technol. 2010; 38:6–17.
All site content, except where otherwise noted, is licensed under a Creative Commons Attribution 3.0 License.