Nothing Special   »   [go: up one dir, main page]
Skip to main content
Download PDF

Improving the prediction accuracy in classification using the combined data sets by ranks of gene expressions

BMC Bioinformatics volume 9, Article number: 283 (2008) Cite this article

Abstract

Background

The information from different data sets experimented under different conditions may be inconsistent even though they are performed with the same research objectives. More than that, even when the data sets were generated from the same platform, the data agreement may be affected by the technical variation among the laboratories. In this case, it is necessary to use the combined data set after adjusting the differences between such data sets, for detecting the more reliable information.

Results

The proposed method combines data sets posterior to the discretization of data sets based on the ranks of the gene expression ratios, and the statistical method is applied to the combined data set for predictive gene selection. The efficiency of the proposed method was evaluated using five colon cancer related data sets, which were experimented using cDNA microarrays with different RNA sources, and one experiment utilized oligonucleotide arrays. NCI-60 cell lines data sets were used, which were performed with two different platforms of cDNA microarrays and Affymetrix HU6800 oligonucleotide arrays. The combined data set by the proposed method predicted the test data sets more accurately than the separated data sets did. The biological significant genes were detected from the combined data set, which were missed on the separated data sets.

Conclusion

By transforming gene expressions using ranks, the proposed method is not influenced by systematic bias among chips and normalization method. The method may be especially more useful to find predictive genes from data sets which have different scale in gene expressions.

Background

Data sets that are created for the same purpose in different laboratories have accumulated rapidly. The results are often inconsistent due to the utilization of different platforms, sample preparations, or various technical variations. In this case, if a combined data set were analyzed after adjusting systematic biases that exist among different data sets derived from different experimental conditions, the power of statistical tests would be improved by an increase in the sample size.

When the results from different data sets are inconsistent, usually the common portions can be adapted for stability. This type of meta-analysis involves a set of classical statistical techniques [1] and has been applied to microarray data sets [2, 3]. As a method to combine data sets, Lee et al. [4] simply standardized gene expression ratios of human and mouse microarray data sets and combined these two data sets for comparative functional genomics. To analyze a combined data set of two different data sets, the transformation of gene expression was introduced [5]. This method transforms the gene expression ratios of two data sets in the form of a reference experiment and the reference experiment is created as a mean vector for all experiments. Consequently, this method does not consider the difference in gene expression patterns that exists between different experimental groups. To account for the variability that resulted from the various confounding factors such as different experimental conditions, an ANOVA (Analysis Of Variance) model was introduced [6]. It is a flexible method for considering gene expression ratios and other clinical variables together, although it does not create a combined large data set for applying various analytical methods.

Sometimes gene expression ratios may include outliers as a result of incomplete experimental conditions, and these values can cause unreliable results by their strong influence. The usage of the categorized values of gene expression ratios can reduce the influence of outliers in this case and may improve the prediction accuracies in the classification of different experimental classes. The usage of the discrete values has advantage that is more concise to represent and specify, easier to use, and conducive to improved predictive accuracy [7]. The discretization of gene expression levels has been achieved [8].

The simplest discretization methods are the Equal Interval Width and Equal Frequency Intervals methods. Kerber [9] suggested the ChiMerge method and this method begins by placing each observed value into its own interval and proceeds by using the χ2 test to determine when adjacent intervals should be merged. A number of entropy-based methods have recently come to the forefront of work on discretization [10]. Fayyad and Irani [10] use a recursive entropy minimization heuristic for discretization and couple this method with the Minimum Description Length criterion [11] to control the number of intervals produced over the continuous space. In addition, a nonparametric scoring method was applied to gene expression data to discretize gene expression ratios [12], which usually transforms expression ratios based on their ranks by each experiment. In this case, some genes are included in the same rank and the score can be calculated differently according to the order of ranks with same values, which requires more time to score as the number of samples increases.

In this study, gene expression ratios were transformed with their ranks for each data set. Next, the transformed data sets were combined and a nonparametric statistical method was applied to the combined data set to detect informative genes with high prediction accuracy. The performance of the proposed method using data sets derived from different platforms and different RNA sources was evaluated.

Results

A. The necessity of combining data sets

The relationship between the number of genes and OOB (Out of Bag) error rates was investigated using data A, data B and data AB, which represent the data sets with total RNA, amplified RNA, and the combined data, respectively.

The OOB error rates were calculated for randomly selected genes 500 times repeatedly with the same size and averaged them. The OOB error rates decreased as the number of informative genes increased.

As shown in Figure 1A, the OOB error rates were decreased with a small number of genes when informative genes were used by their significance in discrimination. While there was a large variation in OOB error rates in the separated data sets, it was even more stable in the combined data set. Therefore, it was confirmed that the more stable discriminative gene set can be detected from the combined data set. In this case, that the OOB error rates had large variations as the number of informative genes was increased can be attributed to the addition of redundant genes. In data mining processes, it is generally known that the exclusion of redundant variables improves the power in discrimination [13]. Therefore, both significance and redundancy should be considered to detect the most discriminative gene set. Figure 1B showed that the variations among the three averaged OOB error rates were stable at 80–90 informative genes. This indicates that two separated data sets and a combined data set have almost the same power in discrimination with 80–90 informative genes. However, OOB error rates in a combined data set were stable with about 20 genes (Figure 1A).

Figure 1
figure 1

Relationship of OOB error rates to the number of significant genes. (A) Red: data A, black: data B, blue: data AB, which is a combined data set by the proposed method. (B) Variations of averaged OOB error rates among three different data sets, data A, data B, and data AB.

Full size image

B. Improvement of prediction accuracy using combined data sets by the proposed method

The prediction accuracies were compared using two original colon cancer data sets as training data sets, which were experimented with different RNA sources.

While the prediction accuracy of data B using data A as a train data set was higher than 95%, the accuracy of data A using data B was lower than 80% (Figure 2A). This indicated that the data set created using total RNA predicted the data set using amplified RNA more correctly. Figure 2B shows that the prediction accuracies of the two test data sets, Tumor 211 and Tumor 86. The prediction accuracy of the combined data set was higher than the separated data sets on two test data sets. Also, data B predicted test data sets with higher accuracy than data A, it could be caused that the two test data sets were also experimented using amplified RNA. The prediction accuracy was higher in Batch II-86 tumor than in Batch I-211 tumor data set.

Figure 2
figure 2

Comparison of the prediction accuracies. The number by the name of each data set represents the sample size of the data set. Seven significant genes with high prediction accuracy were used.

Full size image

C. Comparison of the prediction accuracy with the Minimal Entropy (ME) method

Figure 3 shows the prediction accuracies of the separated and combined data sets transformed by the Minimal Entropy (ME) method.

Figure 3
figure 3

Comparison of the prediction accuracies in ME method.

Full size image

Tumor 211 and Tumor 86 data sets were predicted more accurately with train data A and data B, respectively. This indicated that the prediction accuracy depends on train data sets in the ME method. Figure 3 also showed that there was not any improvement in prediction accuracy when a combined data set by ME method was used as train data set.

Figure 4 shows the comparison of prediction accuracies between the proposed method and ME method. While the combined data set by the ME method did not show any improvement in prediction accuracy compared with separated data sets, the proposed method improved it by combining data sets. The two combined data sets predicted the test data sets with high accuracy and the proposed method showed higher accuracies and smaller variations in accuracies on test data sets than did the ME method

Figure 4
figure 4

Comparison of the prediction accuracies between the proposed method and the ME method.

Full size image

D. Description of significant genes selected from a combined data set by the proposed method

The descriptions of six discriminative genes selected from the combined data set, not two separated data sets, are summarized in Table 1.

Table 1 Description of six informative genes (one is duplicated among seven genes) selected from the combined data set after transformation by the proposed method.
Full size table

AA485151 was upregulated by over five-fold in colorectal adenocarcinoma [14]. AA425217 was published as a significant gene in colorectal cancer [15], and 16q22.1, where AA425217 is located, is a region that includes CDH1, which encodes cell-cell adhesion protein and is expressed in gastric cancer and lobular breast cancer. AA464731 is known to be a downregulated gene in the SW620 cell line [16], a metastatic colorectal cancer cell line. It is also significantly overexpressed in pancreatic cell lines [17]. AA504130 is located on 13q12.3, similarly to BRCA2, which is known as a marker of breast and ovarian cancer. The mutated gene for retinoblastoma is located on chromosome 13q14 [18], on which AA504130 is also located.

AA455925 is known as a E2F-1 regulated gene [19]. Xq26 is a region of two common chromosomal deletion regions, Xq25 and Xq26 [20], and is known to contribute to the malignant progression of gastric epithelial progenitor (GEP) endocrine carcinomas. Colorectal cancer is thought to be more common in men than in women. Xq26 is known as one of regions that contained multiple gains-of-function that were significantly more common in males than in females [21]. Since AW050510 is located at 17q25.3 and BIRC5 is at 17q25 and is known as a 'survivin expression colorectal cancer' [22, 23], AW050510 is also expected to have similar characteristic to BIRC5.

The descriptions of 4 colorectal cancer related genes and 9 cancer related genes are summarized in Table 2. These genes were selected from a combined data set.

Table 2 Summarization of cancer related genes selected from a combined data set http://david.abcc.ncifcrf.gov/.
Full size table

E. Improvement of prediction accuracies by combining data sets performed using different platforms

The prediction accuracies of combined data sets derived from different platforms were investigated.

While the prediction accuracies of data A and data B on affy were low with a small number of genes, it increased as the number of genes was increased. By combining data A and data B, the prediction accuracy on affy was improved, as shown in Figure 5A. When affymetrix data was used as a train data set, its prediction accuracies on data A and data B were lower than 60%. However, after combining with data A or data B, it improved to higher than 90% (Figure 5B).

Figure 5
figure 5

Comparison of prediction accuracies of single and combined data sets.

Full size image

F. Comparison of prediction accuracies of the proposed method in different platforms

The proposed method was evaluated using a NCI 60 cell line data set, and the prediction accuracies of the proposed method and the ME method were compared.

The prediction accuracies of both methods were compared as the number of genes was increased to 300, and they improved as the number of genes was increased, regardless of train and test data sets (Figure 6A). The prediction accuracies in the data sets that were transformed by the ME method were greatly different according to the train sets. The red and blue lines of Figure 6A displayed more stable fluctuation in the prediction accuracies than the green line, and they also showed similar patterns in prediction accuracies.

Figure 6
figure 6

Comparison of prediction accuracies under conditions of two test data sets and the number of informative genes. (A) Blue: test Oligo data with cDNA by proposed method; Red: test cDNA data with Oligo data by proposed method; Green: test Oligo data with cDNA by ME method; Cyan: test cDNA data with Oligo data by ME method. (B) Summary of prediction accuracies using a boxplot. cDNA_R and Oligo_R are data sets transformed by the proposed method. cDNA_ME and Oligo_ME are data sets transformed by the ME method.

Full size image

When Oligo data was used for train, the variation in accuracies was relatively small and prediction accuracy was high. It indicated that the Oligo data set predicted the cDNA data set more stably and accurately than the cDNA data set did. There was rare improvement in prediction after 20 or 30 genes, and this showed that a small informative gene set is sufficient for discrimination. It was also confirmed that the prediction accuracies were robust against the train data sets in the proposed method, while those in the ME method depended on the train data sets and there was significant difference between them (Figure 6B).

Discussion

The designed 25-mer oligochips from Affymetrix provide an absolute value of expression in an RNA sample, while cDNA microarrays perform a two-color competitive hybridization that gives the transcript expression in two samples. Also, long oligonucleotide platforms (typically 60 to 80-mers) also use hybridization, the relative measurements resulted in higher precision than did absolute measurements on this platform [3]. Therefore, some experimental biases can exist as a result of the differences in the usage of absolute measurements and ratios.

Additionally, some previous studies indicated that the data sets from different microarray platforms should not be combined straightforwardly [24–27]. However, even when the data sets were generated from the same platform, the lab effect, especially when compounded with the RNA sample effect, plays a bigger role than the platform effect on data agreement [28].

There also exist inter-study biases among several microarray data sets tested with different RNA sources even when they are from the same laboratory and platform. Previous studies showed that there were some differences in results from data sets tested with different RNA sources, and the sensitivity to detect differential gene expression from a microarray data set using amplified RNA was also different compared to using total RNA [29, 30].

An attempt to combine these different types of data sets is the usage of abstraction of expression values such as ranks or discretized values [9–12]. These methods reduce the variability in expression values from different microarray data sets. While there may be a slight loss of information by discretization, it is robust against outliers and fast and simple to understand.

In colon cancer data sets derived from cDNA microarrays, a data set created with total RNA predicted more accurately a data set created using amplified RNA than vice versa (Figure 2A). However, the data set, which was experimented upon using amplified RNA, showed better performance in the prediction of two test data sets than did a data set from total RNA (Figure 2B). It can be interpreted that the usage of same source can improve the prediction power. Also, the combined data set predicted two test data sets more accurately than did the separated data sets. With the ME method, there existed some interaction between test and train data sets even though it preserved high prediction accuracies on test data sets (Figure 3). This indicated that its prediction accuracy depended on test data sets and was not stable. Consequently, a combined data set by the proposed method showed the best performance in the prediction of test data sets (Figure 4). The top six discriminative genes selected from a combined data set, which were not detected from two separated data sets, were proven as genes associated with colon cancer by previous studies. Therefore, we believe that the usage of a combined data set is more reliable to detect biologically significant genes compared with separated data sets.

In the colon cancer data set derived from oligonucleotide arrays, the prediction accuracies were improved by combination with cDNA data sets. Although two data sets derived from different experimental conditions have different scales in gene expressions, such a different scale of gene expressions could be compensated by discretizing gene expression. Therefore, no transformation method was required to match these two types of data sets except only the ranking of gene expressions.

In the NCI 60 cell line data sets from two different platforms, different types of two data sets were used by alternating train and test data sets. The prediction accuracies in datasets that were transformed by the ME method were greatly different according to train sets, while those by the proposed method were accompanied by stable fluctuation in the prediction accuracies. The Oligo data set predicted the cDNA data set more stably and accurately than vice versa. While the prediction accuracies in the ME method depended on train and test data sets and the significant difference existing between them, they were more robust against train data in the proposed method (Figure 6B). In spite of the increase in the number of genes, the prediction power was not improved after 20 or 30 genes, and this indicated that small significant gene set is sufficient to predict different experimental groups.

In this study, we transformed microarray data using ranks of gene expressions to combine data sets created in different experimental conditions. The proposed method may be especially more useful to find discriminative genes from data sets that have different scales of gene expression ratios.

Methods

Data set

The data sets used in this study are summarized in Table 3.

Table 3 Colon cancer data sets for train and test (genes with missing entries were excluded).
Full size table

Two cDNA microarray data sets, data A and data B, experimented with 154 colorectal tissues (82 tumor and 72 normal) were used as train data sets for evaluation of the proposed method. These two cDNA microarray data sets derive from different RNA sources, which were total RNA and amplified RNA. Previous studies have concluded that there were differences between the results from these two types of data sets and the sensitivity to detect differential gene expression from microarray data sets using amplified RNA was also different compared to using total RNA [29, 30]. It was also confirmed that systematic biases existed between these two data sets using unsupervised hierarchical cluster analysis [31].

Two more cDNA data sets, Tumor 86 and Tumor 211, were experimented with amplified RNA and under different batches, and they were used as test data sets. They included only colon tumor tissues. These colon cancer data sets performed with cDNA microarrays were from the Cancer Metastasis Research Center of Yonsei University, Seoul, Korea. One more colon cancer data set was used, which was performed with the Human 6800 Gene Chip Set (Affymetrix). It was obtained from microarray database of Princeton University [32] and it included experiments with the adenomas and their paired normal tissue [33].

To evaluate the performance of the proposed method in different platforms, NCI 60 cell line data sets derived from different platforms were also used. Gene expression data sets for NCI-60 using 9,706 cloned cDNA microarrays and 6,810 gene Affymetrix HU6800 oligonucleotide arrays were obtained separately from the additional files of Lee et al. [25], and the common 2,344 UniGene clusters were used for this study. Ovarian and colon cancer cell lines were used for this study among nine tumor cell lines, and these two groups included six and seven replications.

Transformation method of gene expression ratios

Data preprocessing

Gene expression ratios were normalized such that they would have similar distributions across a series of arrays and the normalization process was executed using the 'limma' library of the R package [34]. The cDNA data in the NCI 60 cell line data sets included missing entries, and these were estimated by using the SeqKnn (Sequential k nearest neighbor) imputation method [35] before analysis.

Discretization by proposed method using rank of gene expression

For transformation of the data set, gene expression ratios are rearranged in order of expression ratios by each gene, and the ranks are matched with the corresponding experimental group. If the experimental groups are homogenous, the ranks within the same experimental group would be neighboring. This process can be seen as similar to the first step in the nonparametric Mann-Whitney U test. The process of discretization of gene expressions is summarized in the following steps:

  1. (1)

    Rank the gene expression ratios within a gene for each data set.

  2. (2)

    List in order of the ranks and assign the order of gene expressions to the corresponding experimental groups.

  3. (3)

    Summarize the result of (2) in the form of a contingency table for each gene.

  4. (4)

    Test the relationship between the gene expression patterns and experimental groups for each gene.

When there are three data sets to be combined, the data sets can be added by each entry as shown in Table 4 after the transformation of each data set by rank.

Table 4 Combination of contingency tables for three data sets (t ij = a ij + b ij + c ij )
Full size table

Discretization of expression ratios using recursive minimal entropy

A method for discretizing continuous attributes based on a minimal entropy (ME) heuristic, presented by Catlett [36] and Fayyad and Irani [10], was compared with the proposed method in the experimental study. The algorithm uses the class information entropy of candidate partitions to select binary boundaries for discretization. If there is a given set of instances S, a feature A, and a partition boundary T, the class information entropy of the partition induced by T, denoted E(A, T, S) is given by:

E ( A , T ; S ) = | S 1 | | S | E n t ( S 1 ) + | S 2 | | S | E n t ( S 2 ) MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaGaemyrauKaeiikaGIaemyqaeKaeiilaWIaemivaqLaei4oaSJaem4uamLaeiykaKIaeyypa0tcfa4aaSaaaeaacqGG8baFcqWGtbWudaWgaaqaaiabigdaXaqabaGaeiiFaWhabaGaeiiFaWNaem4uamLaeiiFaWhaaOGaemyrauKaemOBa4MaemiDaqNaeiikaGIaem4uam1aaSbaaSqaaiabigdaXaqabaGccqGGPaqkcqGHRaWkjuaGdaWcaaqaaiabcYha8jabdofatnaaBaaabaGaeGOmaidabeaacqGG8baFaeaacqGG8baFcqWGtbWucqGG8baFaaGaemyrauKccqWGUbGBcqWG0baDcqGGOaakcqWGtbWudaWgaaWcbaGaeGOmaidabeaakiabcMcaPaaa@5A2B@

For a given feature A, the boundary T min , which minimizes the entropy function over all possible partition boundaries, is selected as a binary discretization boundary. This method can be applied recursively to both of the partitions induced by T min until some stopping condition is achieved, thus creating multiple intervals on feature A. It must be evaluated N-1 times for each attribute with N the number of attribute values [37]. The library 'dprep' in R [34] was used for this method.

Nonparametric method for significant gene selection

After the summarization of gene expression ratios in the form of a contingency table for each gene, as shown in Table 5, a nonparametric statistical method was applied to the data sets for independency testing between gene expression patterns and experimental groups. The test statistics are calculated as follows for each gene:

Table 5 Summarization of discretized data using ranks of gene expressons.
Full size table
χ 2 = ∑ [ n i j − E ˆ ( n i j ) ] 2 E ˆ ( n i j ) , E ˆ ( n i j ) = r i c j n MathType@MTEF@5@5@+=feaafiart1ev1aaatCvAUfKttLearuWrP9MDH5MBPbIqV92AaeXatLxBI9gBaebbnrfifHhDYfgasaacPC6xNi=xI8qiVKYPFjYdHaVhbbf9v8qqaqFr0xc9vqFj0dXdbba91qpepeI8k8fiI+fsY=rqGqVepae9pg0db9vqaiVgFr0xfr=xfr=xc9adbaqaaeGaciGaaiaabeqaaeqabiWaaaGcbaqbaeqabeGaaaqaaiabeE8aJnaaCaaaleqabaGaeGOmaidaaOGaeyypa0JaeyyeIuEcfa4aaSaaaeaacqGGBbWwcqWGUbGBdaWgaaqaaiabdMgaPjabdQgaQbqabaGaeyOeI0IafmyrauKbaKaacqGGOaakcqWGUbGBdaWgaaqaaiabdMgaPjabdQgaQbqabaGaeiykaKIaeiyxa01aaWbaaeqabaGaeGOmaidaaaqaaiqbdweafzaajaGaeiikaGIaemOBa42aaSbaaeaacqWGPbqAcqWGQbGAaeqaaiabcMcaPaaakiabcYcaSaqaaiqbdweafzaajaGaeiikaGIaemOBa42aaSbaaSqaaiabdMgaPjabdQgaQbqabaGccqGGPaqkcqGH9aqpjuaGdaWcaaqaaiabdkhaYnaaBaaabaGaemyAaKgabeaacqWGJbWydaWgaaqaaiabdQgaQbqabaaabaGaemOBa4gaaaaaaaa@5A0E@

When the sample size for each experiment is small, generally less than five, Fisher's exact test is recommended rather than the Chi-square test.

Classification method to evaluate the informative gene set selected from the combined data set

In order to evaluate the predictive accuracy of the selected significant gene set, the Random Forest (RF) test [38] was used to enable re-sampling while allowing repetition. The RF program in the R package [34] was used and it works using the following steps:

  1. (1)

    Generate n data sets of bootstrap samples {B1, B2, ..., Bn} by allowing repetition. (2) Use a Bk to build a tree classifier Tk, and classify Bms (m≠k) data (out-of-bag (OOB) samples). (3) Calculate classification errors of Bms and obtain an average for them which is the overall classification error (OOB error). (4) Calculate the prediction accuracy of test data sets using the classifier built in (2).

Abbreviations

ANOVA:

Analysis Of Variance

OOB error:

Out Of Bag error

ME:

Minimal Entropy.

References

  1. Hedges LV, Olkin I: Statistical Methods for Meta-Analysis. Orlando: Academic Press; 1985.

    Google Scholar 

  2. Rhodes DR, Miller JC, Haab BB, Furge KA: Identification of differentially expressed clusters of genes from microarray data. Bioinformatics 2002, 18: 205–206. 10.1093/bioinformatics/18.1.205

    Article  CAS  PubMed  Google Scholar 

  3. Moreau Y, Aerts S, De Moor B, De Strooper B, Dabrowski M: Comparison and meta-analysis of microarray data: from the bench to the computer desk. Trends in Genetics 2003, 19: 570–577. 10.1016/j.tig.2003.08.006

    Article  CAS  PubMed  Google Scholar 

  4. Lee JS, Chu IS, Mikaelyan A, Calvisi DF, Heo J, Reddy JK, Thorgeirsson SS: Application of comparative functional genomics to identify best-fit mouse models to study human cancer. Nature Genetics 2004, 36: 1306–1311. 10.1038/ng1481

    Article  CAS  PubMed  Google Scholar 

  5. Jiang H, Deng Y, Chen HS, Tao L, Sha Q, Chen J, Tsai CJ, Zhang S: Joint analysis of two microarray gene-expression data sets to select lung adenocarcinoma marker genes. BMC Bioinformatics 2004, 81. 10.1186/1471-2105-5-81

    Google Scholar 

  6. Park T, Yi SG, Shin YK, Lee S: Combining multiple microarrays in the presence of controlling variables. Bioinformatics 2006, 2: 1682–1689. 10.1093/bioinformatics/btl183

    Article  Google Scholar 

  7. Liu H, Hussain H, Tan CL, Dash M: Discretization: An Enabling Technique. Data Mining and Knowledge Discovery 2002, 6: 393–423. 10.1023/A:1016304305535

    Article  Google Scholar 

  8. Potamias G, Koumakis L, Moustakis V: Gene Selection via Discretized Gene-Expression Profiles and Greedy Feature-Elimination. 3rd Hellenic Conference on Artificial Intelligence (SETN04) 2004.

    Google Scholar 

  9. Kerber R: Chimerge: Discretization of numeric attributes. In Proceedings of the Tenth National Conference on Artificial Intelligence. MIT Press; 1992:123–128.

    Google Scholar 

  10. Fayyad UM, Irani KB: Multi-interval discretization of continuous-valued attributes for classification learning. Proceedings of the 13th International Joint Conference on Artificial Intelligence, Morgan Kaufamann 1993, 1022–1027.

    Google Scholar 

  11. Rissanen J: Stochastic complexity and modelling. Ann Statist 1986, 14: 1080–1100. 10.1214/aos/1176350051

    Article  Google Scholar 

  12. Park PJ, Pagano M, Bonetti M: A nonparametric scoring algorithm for identifying informative genes from microarray data. Pacific Symposium on Biocomputing 2001, 52–63.

    Google Scholar 

  13. Ramsey FL, Schafer DW: The Statistical Sleuth, a course in methods of data analysis. Duxbury Learning Publishing; 2002.

    Google Scholar 

  14. Choi KU, Park DY, Kim JY, Lee JS, Sol MY: Overexpression of Insulin-like Growth Factor Binding Protein 3 in Colorectal Carcinoma Identified by cDNA Microarray and Immunohistochemical Analysis. The Korean Journal of Pathology 2003, 37: 166–73.

    Google Scholar 

  15. Han H, Bearss DJ, Browne LW, Calaluce R, Nagle RB, Von Hoff DD: Identification of Differentially Expressed Genes in Pancreatic Cancer Cells Using cDNA Microarray. Cancer Res 2002, 2: 2890–2896.

    Google Scholar 

  16. Kim BS, Kim I, Lee S, Kim S, Rha SY, Chung HC: Statistical methods of translating microarray data into clinically relevant diagnostic information in colorectal cancer. Bioinformatics 2005, 21: 517–528. 10.1093/bioinformatics/bti029

    Article  CAS  PubMed  Google Scholar 

  17. Futschik M, Jeffs A, Pattison S, Kasabov N, Sullivan M, Merrie A, Reeve A: Gene Expression Profiling of Metastatic and Nonmetastatic Colorectal Cancer Cell Lines. Genome letters 2002, 1: 26–34. 10.1166/gl.2002.005

    Article  CAS  Google Scholar 

  18. Friend SH, Bernards R, Rogelj S, Weinberg RA, Rapaport JM, Albert DM, Dyja TP: A human DNA segment with properties of the gene that redisposes to retinoblastoma and osteosarcoma. Nature 1986, 323: 643–646. 10.1038/323643a0

    Article  CAS  PubMed  Google Scholar 

  19. Nowak K, Kerl K, Fehr D, Kramps C, Gessner C, Killmer K, Samans B, Berwanger B, Christiansen H, Lutz W: BMI1 is a target gene of E2F-1 and is strongly expressed in primary neuroblastomas. Nucleic Acids Research 2006, 34: 1745–1754. 10.1093/nar/gkl119

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  20. Azzoni C, Bottarelli L, Pizzi S, D'Adda T, Rindi G, Bordi C: Xq25 and Xq26 identify the common minimal deletion region in malignant gastro enteropancreatic endocrine carcinomas. Virchows Arch 2006, 448: 119–126. 10.1007/s00428-005-0058-4

    Article  PubMed  Google Scholar 

  21. Unotoro J, Kamiyama H, Ishido Y, Yaginuma Y, Kasamaki S, Sakamoto K, Oota A, Ishibashi Y, Kamano T: Analysis of the Relationship between Sex and Chromosomal Aberrations in Colorectal Cancer by Comparative Genomic Hybridization. J Int Med Res 2006, 34: 397–405.

    Article  CAS  PubMed  Google Scholar 

  22. Sarela AI, Macadam RC, Farmery SM, Markham AF, Guillou PJ: Expression of the antiapoptosis gene, survivin, predicts death from recurrent colorectal carcinoma. Gut 2000, 46: 645–650. 10.1136/gut.46.5.645

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  23. Rohayem J, Diestelkoetter P, Weigle B, Oehmichen A, Schmitz M, Mehlhorn J, Conrad K, Rieber EP: Antibody response to the tumor-associated inhibitor of apoptosis protein survivin in cancer patients. Cancer Research 2000, 60: 1815–1817.

    CAS  PubMed  Google Scholar 

  24. Kuo WP, Jenssen TK, Butte AJ, Ohno-Machado L, Kohane IS: Analysis of matched mRNA measurements from two different microarray technologies. Bioinformatics 2002, 18: 405–412. 10.1093/bioinformatics/18.3.405

    Article  CAS  PubMed  Google Scholar 

  25. Lee JK, Bussey KJ, Gwadry FG, Reinhold W, Riddick G, Pelletier SL, Nishizuka S, Szakacs G, Annereau JP, Shankavaram U, Lababidi S, Smith LH, Gottesman MM, Weinstein JN: Comparing cDNA and oligonucleotide array data: concordance of gene expression across platforms for the NCI-60 cancer cells. Genome Biol 2003, R82. 10.1186/gb-2003-4-12-r82

    Google Scholar 

  26. Järvinen AK, Hautaniemi S, Edgren H, Auvinen P, Saarela J, Kallioniemi OP, Monni O: Are data from different gene expression microarray platforms comparable? Genomics 2004, 83: 1164–1168. 10.1016/j.ygeno.2004.01.004

    Article  PubMed  Google Scholar 

  27. Zhu B, Ping G, Shinohara Y, Zhang Y, Baba Y: Comparison of gene expression measurements from cDNA and 60-mer oligonucleotide microarrays. Genomics 2005, 85: 657–665. 10.1016/j.ygeno.2005.02.012

    Article  CAS  PubMed  Google Scholar 

  28. Wang H, He X, Band M, Wilson C, Liu L: A study of inter-lab and inter-platform agreement of DNA microarray data. BMC Genomics 2005, 6: 71. 10.1186/1471-2164-6-71

    Article  PubMed Central  PubMed  Google Scholar 

  29. Feldman AL, Costouros NG, Wang E, Qian M, Marincola FM, Alexander HR, Libutti SK: Advantages of mRNA amplification for microarray analysis. Biotechniques 2002, 33: 906–914.

    CAS  PubMed  Google Scholar 

  30. Schneider J, Buness A, Huber W, Volz J, Kioschis P, Hafner M, Poustka A, Sültmann H: Systematic analysis of T7 RNA polymerase based in vitro linear RNA amplification for use in microarray experiments. BMC Genomics 2004, 5: 29. 10.1186/1471-2164-5-29

    Article  PubMed Central  PubMed  Google Scholar 

  31. Kim KY, Ki DH, Jeong HJ, Jeung HC, Chung HC, Rha SY: Novel and simple transformation algorithm for combining microarray data sets. BMC Bioinformatics 2007, 8: 218. 10.1186/1471-2105-8-218

    Article  PubMed Central  PubMed  Google Scholar 

  32. Microarray database of Princeton University[http://microarray.princeton.edu/oncology/]

  33. Notterman DA, Alon U, Sierk AJ, Levine AJ: Transcriptional Gene Expression Profiles of Colorectal Adenoma, Adenocarcinoma, and Normal Tissue Examined by Oligonucleotide Arrays. Cancer Research 2001, 61: 3124–3130.

    CAS  PubMed  Google Scholar 

  34. The R Project for Statistical Computing[http://www.r-project.org]

  35. Kim KY, Kim BJ, Yi GS: Reuse of imputed data in microarray analysis increases imputation efficiency. BMC Bioinformatics 2004, 5: 160. 10.1186/1471-2105-5-160

    Article  PubMed Central  PubMed  Google Scholar 

  36. Catlett J: On changing continuous attributes into ordered discrete attributes. In Proceedings of the European Working Session on Learning. Berlin, Germany: Springer-Verlag; 1991:164–178.

    Google Scholar 

  37. Dougherty J, Kohavi R, Sahami M: Supervised and Unsupervised of Continuous Features, Machine Learning. In Proceedings of the Twelfth International Conference. San Francisco, CA; 1995.

    Google Scholar 

  38. Breiman L: Random Forests. Berkeley, CA, Statistics Department, University of California; 2001:1–33.

    Google Scholar 

Download references

Acknowledgements

This study was supported by a grant of the Korea Health 21 R&D Project, Ministry of Health & Welfare (0405-BC01-0604-0002), and Korea Research Foundation Grant funded by Korean Government (KRF-2005-005-J05904). We thank the members of National Biochip Research Center, Yonsei University, and the Genomic Tree Incorporation, Korea for the current project.

Author information

Authors and Affiliations

  1. Oral Cancer Research Institute, Yonsei University College of Dentistry, Seoul, 120-752, South Korea

    Ki-Yeol Kim

  2. Cancer Metastasis Research Center, Yonsei University College of Medicine, Seoul, 120-752, South Korea

    Dong Hyuk Ki, Hei-Cheul Jeung, Hyun Cheol Chung & Sun Young Rha

  3. National Biochip Research Center, Seoul, 120-752, South Korea

    Dong Hyuk Ki, Hyun Cheol Chung & Sun Young Rha

  4. Brain Korea 21 Project for Medical Science, Yonsei University College of Medicine, Seoul, 120-752, South Korea

    Dong Hyuk Ki, Hei-Cheul Jeung, Hyun Cheol Chung & Sun Young Rha

  5. Yonsei Cancer Center, Yonsei University College of Medicine, Seoul, 120-752, South Korea

    Dong Hyuk Ki

  6. Department of Internal Medicine, Yonsei University College of Medicine, Seoul, 120-752, South Korea

    Hyun Cheol Chung & Sun Young Rha

Authors
  1. Ki-Yeol Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dong Hyuk Ki
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hei-Cheul Jeung
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hyun Cheol Chung
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Sun Young Rha
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sun Young Rha.

Additional information

Authors' contributions

KYK participated in the design of algorithms, performed statistical analysis and drafted the manuscript. DHK performed the microarray experiments. HCJ participated in getting the consent form the patients and obtained the clinical data. HCC participated in the study design and data interpretation. SYR conceived of the study, participated in its design and coordination, and finalized manuscript.

Authors’ original submitted files for images

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Kim, KY., Ki, D.H., Jeung, HC. et al. Improving the prediction accuracy in classification using the combined data sets by ranks of gene expressions. BMC Bioinformatics 9, 283 (2008). https://doi.org/10.1186/1471-2105-9-283

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2105-9-283

Keywords

BMC Bioinformatics

ISSN: 1471-2105

Contact us