Abstract
Over the last decade, the introduction of microarray technology has had a profound impact on gene expression research. The publication of studies with dissimilar or altogether contradictory results, obtained using different microarray platforms to analyze identical RNA samples, has raised concerns about the reliability of this technology. The MicroArray Quality Control (MAQC) project was initiated to address these concerns, as well as other performance and data analysis issues. Expression data on four titration pools from two distinct reference RNA samples were generated at multiple test sites using a variety of microarray-based and alternative technology platforms. Here we describe the experimental design and probe mapping efforts behind the MAQC project. We show intraplatform consistency across test sites as well as a high level of interplatform concordance in terms of genes identified as differentially expressed. This study provides a resource that represents an important first step toward establishing a framework for the use of microarrays in clinical and regulatory settings.
This is a preview of subscription content, access via your institution
Access options
Subscribe to this journal
Receive 12 print issues and online access
209,00 ⬠per year
only 17,42 ⬠per issue
Buy this article
- Purchase on SpringerLink
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout






Similar content being viewed by others
Accession codes
References
Lesko, L.J. & Woodcock, J. Translation of pharmacogenomics and pharmacogenetics: a regulatory perspective. Nat. Rev. Drug Discov. 3, 763â769 (2004).
Frueh, F.W. Impact of microarray data quality on genomic data submissions to the FDA. Nat. Biotechnol. 24, 1105â1107 (2006).
Dix, D.J. et al. A framework for the use of genomics data at the EPA. Nat. Biotechnol. 24, 1108â1111 (2006).
Tan, P.K. et al. Evaluation of gene expression measurements from commercial microarray platforms. Nucleic Acids Res. 31, 5676â5684 (2003).
Ramalho-Santos, M., Yoon, S., Matsuzaki, Y., Mulligan, R.C. & Melton, D.A. âStemnessâ: transcriptional profiling of embryonic and adult stem cells. Science 298, 597â600 (2002).
Ivanova, N.B. et al. A stem cell molecular signature. Science 298, 601â604 (2002).
Miller, R.M. et al. Dysregulation of gene expression in the 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine-lesioned mouse substantia nigra. J. Neurosci. 24, 7445â7454 (2004).
Fortunel, N.O. et al. Comment on â'Stemness': transcriptional profiling of embryonic and adult stem cellsâ and âa stem cell molecular signatureâ. Science 302, 393 author reply 393 (2003).
Miklos, G.L. & Maleszka, R. Microarray reality checks in the context of a complex disease. Nat. Biotechnol. 22, 615â621 (2004).
Frantz, S. An array of problems. Nat. Rev. Drug Discov. 4, 362â363 (2005).
Marshall, E. Getting the noise out of gene arrays. Science 306, 630â631 (2004).
Michiels, S., Koscielny, S. & Hill, C. Prediction of cancer outcome with microarrays: a multiple random validation strategy. Lancet 365, 488â492 (2005).
Ein-Dor, L., Zuk, O. & Domany, E. Thousands of samples are needed to generate a robust gene list for predicting outcome in cancer. Proc. Natl. Acad. Sci. USA 103, 5923â5928 (2006).
Petersen, D. et al. Three microarray platforms: an analysis of their concordance in profiling gene expression. BMC Genomics 6, 63 (2005).
Dobbin, K.K. et al. Interlaboratory comparability study of cancer gene expression analysis using oligonucleotide microarrays. Clin. Cancer Res. 11, 565â572 (2005).
Irizarry, R.A. et al. Multiple-laboratory comparison of microarray platforms. Nat. Methods 2, 345â350 (2005).
Larkin, J.E., Frank, B.C., Gavras, H., Sultana, R. & Quackenbush, J. Independence and reproducibility across microarray platforms. Nat. Methods 2, 337â344 (2005).
Kuo, W.P. et al. A sequence-oriented comparison of gene expression measurements across different hybridization-based technologies. Nat. Biotechnol. 24, 832â840 (2006).
Shi, L. et al. QA/QC: challenges and pitfalls facing the microarray community and regulatory agencies. Expert Rev. Mol. Diagn. 4, 761â777 (2004).
Shi, L. et al. Cross-platform comparability of microarray technology: intra-platform consistency and appropriate data analysis procedures are essential. BMC Bioinformatics 6 Suppl. 2, S12 (2005).
Ji, H. & Davis, R.W. Data quality in genomics and microarrays. Nat. Biotechnol. 24, 1112â1113 (2006).
Canales, R.D. et al. Evaluation of DNA microarray results with quantitative gene expression platforms. Nat. Biotechnol. 24, 1115â1122 (2006).
Shippy, R. et al. Using RNA sample titrations to assess microarray platform performance and normalization techniques. Nat. Biotechnol. 24, 1123â1131 (2006).
Patterson, T.A. et al. Performance comparison of one-color and two-color platforms within the MicroArray Quality Control (MAQC) project. Nat. Biotechnol. 24, 1140â1150 (2006).
Tong, W. et al. Evaluation of external RNA controls for the assessment of microarray performance. Nat. Biotechnol. 24, 1132â1139 (2006).
Guo, L. et al. Rat toxicogenomic study reveals analytical consistency across microarray platforms. Nat. Biotechnol. 24, 1162â1169 (2006).
Mecham, B.H. et al. Sequence-matched probes produce increased cross-platform consistency and more reproducible biological results in microarray-based gene expression measurements. Nucleic Acids Res. 32, e74 (2004).
Carter, S.L., Eklund, A.C., Mecham, B.H., Kohane, I.S. & Szallasi, Z. Redefinition of Affymetrix probe sets by sequence overlap with cDNA microarray probes reduces cross-platform inconsistencies in cancer-associated gene expression measurements. BMC Bioinformatics 6, 107 (2005).
Draghici, S., Khatri, P., Eklund, A.C. & Szallasi, Z. Reliability and reproducibility issues in DNA microarray measurements. Trends Genet. 22, 101â109 (2006).
Irizarry, R.A., Wu, Z. & Jaffee, H.A. Comparison of Affymetrix GeneChip expression measures. Bioinformatics 22, 789â794 (2006).
Pruitt, K.D., Tatusova, T. & Maglott, D.R. NCBI Reference Sequence (RefSeq): a curated non-redundant sequence database of genomes, transcripts and proteins. Nucleic Acids Res. 33, D501âD504 (2005).
Thierry-Mieg, D. & J, T.-M. AceView: a comprehensive cDNA-supported gene and transcripts annotation. Genome Biology 7, Suppl. 1, S12 (2006).
Bammler, T. et al. Standardizing global gene expression analysis between laboratories and across platforms. Nat. Methods 2, 351â356 (2005).
Harr, B. & Schlotterer, C. Comparison of algorithms for the analysis of Affymetrix microarray data as evaluated by co-expression of genes in known operons. Nucleic Acids Res. 34, e8 (2006).
Tusher, V.G., Tibshirani, R. & Chu, G. Significance analysis of microarrays applied to the ionizing radiation response. Proc. Natl. Acad. Sci. USA 98, 5116â5121 (2001).
Thompson, K.L. et al. Use of a mixed tissue RNA design for performance assessments on multiple microarray formats. Nucleic Acids Res. 33, e187 (2005).
Baker, S.C. et al. The External RNA Controls Consortium: a progress report. Nat. Methods 2, 731â734 (2005).
Reid, L.H. The value of a proficiency testing program to monitor performance in microarray laboratories. Pharm. Discov. 5, 20â25 (2005).
Ball, C.A. et al. Standards for microarray data. Science 298, 539 (2002).
Tong, W. et al. ArrayTrackâsupporting toxicogenomic research at the U.S. Food and Drug Administration National Center for Toxicological Research. Environ. Health Perspect. 111, 1819â1826 (2003).
Tong, W. et al. Development of public toxicogenomics software for microarray data management and analysis. Mutat. Res. 549, 241â253 (2004).
Acknowledgements
All MAQC participants freely donated their time and reagents for the completion and analysis of the MAQC project. Participants from the National Institutes of Health (NIH) were supported by the Intramural Research Program of NIH, Bethesda, Maryland. D.H. thanks Ian Korf for BLAST discussions. This study utilized a number of computing resources, including the high-performance computational capabilities of the Biowulf PC/Linux cluster at the NIH (http://biowulf.nih.gov/) as well as resources at the analysis sites.
Author information
Authors and Affiliations
Consortia
Corresponding author
Ethics declarations
Competing interests
Many of the MAQC participants are employed by companies that manufacture gene expression products and/or perform testing services. J.C.W. is a consultant for and has significant financial interest in Gene Express, Inc.
Supplementary information
Supplementary Table 1
cRNA Size and Yields Collected from Microarray Platforms (XLS 45 kb)
Supplementary Table 2
Genes-to-NM Accession List for All Probes (TXT 2629 kb)
Supplementary Table 3
Most 3â² Probe-to-NM Accession List for 23,971 Common Probes (TXT 3272 kb)
Supplementary Table 4
One Probe-to-One Gene List for All Genes (TXT 1718 kb)
Supplementary Table 5
One Probe-to-One Gene List for 12,091 Common Genes (TXT 1211 kb)
Supplementary Methods
BLAST Analysis for the MAQC Project (PDF 67 kb)
Supplementary Notes
README for Probe Mapping Files (PDF 11 kb)
Supplementary Data
Supplementary Information on MAQC Study (PDF 663 kb)
Rights and permissions
About this article
Cite this article
MAQC Consortium. The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements. Nat Biotechnol 24, 1151â1161 (2006). https://doi.org/10.1038/nbt1239
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/nbt1239
This article is cited by
-
Quartet protein reference materials and datasets for multi-platform assessment of label-free proteomics
Genome Biology (2023)
-
Genetic Programs Between Steroid-Sensitive and Steroid-Insensitive Interstitial Lung Disease
Inflammation (2023)
-
Comprehensive analysis of transcriptomics and metabolomics to understand chronic ethanol induced murine cardiotoxicity
Molecular and Cellular Biochemistry (2023)
-
Genes expressed at low levels raise false discovery rates in RNA samples contaminated with genomic DNA
BMC Genomics (2022)
-
Molecular pathways enhance drug response prediction using transfer learning from cell lines to tumors and patient-derived xenografts
Scientific Reports (2022)