Microarray analysis of relative gene expression stability for selection of internal reference genes in the rhesus macaque brain
BMC Molecular Biology volume 11, Article number: 47 (2010)
Normalization of gene expression data refers to the comparison of expression values using reference standards that are consistent across all conditions of an experiment. In PCR studies, genes designated as "housekeeping genes" have been used as internal reference genes under the assumption that their expression is stable and independent of experimental conditions. However, verification of this assumption is rarely performed. Here we assess the use of gene microarray analysis to facilitate selection of internal reference sequences with higher expression stability across experimental conditions than can be expected using traditional selection methods.
We recently demonstrated that relative gene expression from qRT-PCR data normalized using GAPDH, ALG9 and RPL13A expression values mirrored relative expression using quantile normalization in Robust Multichip Analysis (RMA) on the Affymetrix® GeneChip® rhesus Macaque Genome Array.
Having shown that qRT-PCR and Affymetrix® GeneChip® data from the same hormone replacement therapy (HRT) study yielded concordant results, we used quantile-normalized gene microarray data to identify the most stably expressed among probe sets for prospective internal reference genes across three brain regions from the HRT study and an additional study of normally menstruating rhesus macaques (cycle study). Gene selection was limited to 575 previously published human "housekeeping" genes. Twelve animals were used per study, and three brain regions were analyzed from each animal. Gene expression stabilities were determined using geNorm, NormFinder and BestKeeper software packages.
Sequences co-annotated for ribosomal protein S27a (RPS27A), and ubiquitin were among the most stably expressed under all conditions and selection criteria used for both studies. Higher annotation quality on the human GeneChip® facilitated more targeted analysis than could be accomplished using the rhesus GeneChip®. In the cycle study, multiple probe sets annotated for actin, gamma 1 (ACTG1) showed high signal intensity and were among the most stably expressed.
Using gene microarray analysis, we identified genes showing high expression stability under various sex-steroid environments in different regions of the rhesus macaque brain. Use of quantile-normalized microarray gene expression values represents an improvement over traditional methods of selecting internal reference genes for PCR analysis.
Quantitative real-time reverse transcription polymerase chain reaction (qRT-PCR) [1, 2] has been the technique of choice to confirm or refute interpretations of relative gene expression derived from gene microarray data [3–6], but accurate interpretation requires the qRT-PCR gene expression levels to be normalized against a stably expressed reference . Genes such as Glyceraldehyde-3- phosphate dehydrogenase (GAPDH), β-actin (ACTB) and 18S rRNA have been used as internal reference standards for qRT-PCR normalization mainly due to historical carryover, when they were used as references for semi-quantitative procedures like Northern blots, RNAse protection assays and conventional reverse transcriptase polymerase chain reactions (RT-PCR) . However expression of these genes is regulated according to cellular conditions [9–15], and so their indiscriminate use as internal reference genes is questionable. Many genes previously adopted as standards for normalization of gene expression data show variable expression according experimental conditions [11, 15], thus limiting their suitability. Increasingly, it is viewed as imperative that the expression stability of prospective reference genes be verified under each all experimental conditions specific to a study [16–18]. Gene expression analysis using microarrays facilitates use of an increasingly more complete range of sample variation criteria , and studies using gene microarray analyses are an increasingly common means of identifying experiment-specific internal reference genes for use in PCR verification [20–24].
Few suitable reference genes have been identified within the rhesus macaque brain . Normalizer data for macaque brain tissues is sparse because the availability of genetic material from specific brain regions in properly controlled groups of macaques is very rare and difficult to obtain. To help overcome this problem, we recently used qRT-PCR and gene microarrays to examine expression stability for genes regulating γ-aminobutyric acid (GABA) trafficking in response to variation in circulating levels of ovarian steroids in the arcuate nucleus of the medial basal hypothalamus (MBH), hippocampus (HPC) and amygdala (AMD) in a study designed for examination of effects of hormone replacement therapy on gene expression (HRT study). In the aforementioned analysis , we showed that qRT-PCR results normalized using genes showing high microarray expression stability (GAPDH, ALG9 and RPL13A) mirrored relative microarray expression data normalized using the quantile method [27, 28] as part of Robust Multichip Analysis (RMA) pre-processing  on the Affymetrix® GeneChip® rhesus Macaque Genome Array (rhesus GeneChip®) .
We now present further details of our qRT-PCR relative expression stability analyses using the software algorithm bundles: geNorm , NormFinder  and BestKeeper . We compare these data with relative gene expression stabilities from quantile-normalized RMA pre-processed (RMA-normalized) microarray results from the same (HRT) study examined using the rhesus GeneChip®. In addition we compare relative expression stabilities from a separate study of normally cycling macaques (cycle study) where we conducted microarray analysis of the same brain regions (MBH, HPC and AMD) using the Affymetrix® GeneChip® Human Genome U133 Plus 2.0 microarray (human GeneChip®).
In order to maximize the likelihood of detecting gene sequences that are stably expressed under a variety of conditions (i.e., different brain regions and different sex-steroid environments), gene selection was limited to a published set of 575 human genes expressed under all conditions tested , and expected to meet criteria for "housekeeping" genes. Our goal was to identify the most appropriate normalizer or combination of normalizers for gene expression comparisons, and we selected these criteria to limit inclusion of probe sets to those most likely to be good candidates under variable conditions [22, 34]. The experiments conducted in the current study were designed to test effects of variable ovarian hormone exposure on the function of three brain areas, and we used menstrual cycle variation and hormone therapy effects as two ways of independently assessing ovarian hormone effects.
The results were obtained from two different experiments, which are described in the methods and depicted schematically in Figure 1. Previously qRT-PCR was conducted on samples from the HRT study in order to examine the influence of hormone replacement on gene expression of GABAergic system components . qRT-PCR relative expression stabilities of the six GABAergic components and three normalizers used in the prior qRT-PCR analysis were assessed in the current study, and we compare analyses for these nine genes (Table 1) used for qRT-PCR to analyses of 575 housekeeping genes examined using gene microarray data pre-processed using Robust Multiarray Analysis (RMA normalization) [27, 35, 36]. Differences in annotation quality between the rhesus and human microarray platforms facilitated higher discrimination in probe set selection using the human compared to the rhesus GeneChip®. Because the nature of the probe sets used can affect overall relative expression stability values , we conducted separate analyses according to annotation-based on probe set selection criteria and present the gene microarray results according these selection methods. On both the human and rhesus GeneChip® we compared: 1) all probe sets annotated for the housekeeping genes; and 2) probe sets annotated for "popular normalizers" (see methods). In addition to analysis of all probe sets annotated for housekeeping genes, the annotation quality of the human GeneChip® facilitated selection of "most representative" probe sets (see methods) for the majority of the housekeeping genes as well as all of the popular normalizers. Use of the representative probe sets was intended to increase the specificity of data used for analyses.
qRT-PCR. HRT GeNorm analysis
Five of the original set of nine genes preselected for analysis showed initial expression stability (M) values  within the recommended range (M < 1.5) for consideration as a normalizer . Where lower M indicates higher expression stability, initial M-value ranks (data not shown) were as follows: ALG9 <GAPDH <RPL13A <GAD1 <GABRA4. Sequential stepwise exclusion of the least stable reference genes resulted in final M-values of 0.437 for ALG9 and RPL13A, indicating that either of these genes was equally suitable for selection as the most stably expressed gene (best normalizer) according to the geNorm algorithm. Due to high variance introduced by a single MBH sample, it was removed and reanalysis was performed. The only effect of this change on relative M-values was regarding relative ranks of GAD1 and GAPDH with GAPDH showing higher stability after variation reduction (Figure 2). ALG9 and RPL13A remained the most stably expressed genes.
qRT-PCR. HRT NormFinder analysis
ALG9 showed the highest stability when all three brain regions were compared. When all nine genes were analyzed, the five most stably expressed ones were identically ranked whether or not they were grouped  by brain region. The NormFinder algorithms work most efficiently when all genes used show high expression stability. From these nine genes, the five most stably expressed ones were selected. NormFinder algorithms were then applied to these five genes in order to narrow down the three most stably expressed. Because use of stably expressed genes is important for NormFinder function, we used this sequential method to ensure selection of genes with expression patterns that maximized the effectiveness of the NormFinder algorithm . Where the top five gene candidates were considered separately, ALG9 was still the most stably expressed (stability value 0.255) and the most stable combination (stability value 0.150) was GAPDH + RPL13A (Table 2). Where only the three prospective internal reference genes were considered, ALG9 was again the most stably expressed (0.204), and the most stable combination (0.152) was GAPDH and ALG9.
In comparisons of inter-group and intra-group variation (genes grouped by brain region) GAPDH showed the highest variability in the MBH (Figures 3 and 4) with intra-group variation an order of magnitude higher than that observed for other genes.
qRT-PCR. HRT NormFinder test of separate brain regions
NormFinder analysis of inter-group and intra-group variation highlighted the possibility that the most appropriate internal reference gene would vary according to brain region. For the MBH gene expression analysis, ALG9 was ranked as the most stably-expressed gene in all scenarios. i.e., when all nine genes were included, when only the five most stable genes were selected, or when selection was restricted to the three prospective internal reference genes (three most stably expressed genes). For the HPC and AMD gene expression analysis, GAPDH was ranked as the most stably-expressed gene, with the most stable combination being GAPDH and RPL13A. When only the three prospective internal reference genes were considered, GAPDH was again ranked as the most stably-expressed gene, with the best combination of GAPDH and ALG9 (Table 2).
qRT-PCR. HRT NormFinder deviant sample test
Causes for observed differences in relative expression stability of the most stably expressed genes in the MBH compared to in the extra-hypothalamic regions (HPC and AMD) were elucidated by analysis of intra-group variation (Figures 3 and 4). As previously described, we tested the influence of this variation by omitting the sample contributing the most to MBH gene expression variability. With this omission, GAPDH showed the highest overall expression stability, and as before, stability rankings were identical with and without regional grouping considerations. In the omission test, GAPDH was also the most stable (0.219) when the 5 most stable genes were compared. The most stable combination was GAPDH + RPL13A (0.137). However, when group comparisons were limited to prospective internal reference genes only, the most stable single gene was again ALG9 (0.171) with the most stable combination being GAPDH + ALG9 (0.106).
qRT-PCR. HRT BestKeeper analysis
In the analysis of all three brain regions, only the predicted housekeeping genes GAPDH, RPL13A and ALG9 met BestKeeper crossing point  standard deviation recommendations ((std dev [± CP]) < 1) for consideration as stably expressed genes. RPL13A displayed the lowest indices of variation (Table 3). Aside from the three prospective internal reference genes, GAD1 and GABRA4 showed the next highest expression stability. In light of findings from the NormFinder analysis, the MBH was analyzed separately from the extra-hypothalamic regions. For the separate MBH gene expression analysis, five genes met BestKeeper recommendations based on CP standard deviation for consideration as internal reference genes. They were ranked as follows, from lowest-to-highest variation (i.e., low variation indicates high stability): GABRA1, ALG9, RPL13A, GABRA4 and GABRD. However, when the most deviant MBH sample was omitted, ALG9 and RPL13A received highest (and equal) relative stability rankings followed by GABRA1, GABRA4 and GABRE. For the extra-hypothalamic HPC and AMD analysis, the five genes with lowest crossing point standard deviation from lowest to highest variation were RPL13A, GAPDH, ALG9, GABRE and GABRD.
Rhesus GeneChip® HRT study. All probe sets grouped by region
Our search method (see methods) revealed 1444 probe sets on the rhesus macaque GeneChip® annotated for the housekeeping genes . When data was grouped by region, the most stably expressed probe set: MmugDNA.22897.1.S1_s_at (stability value 0.064) was annotated for Homo sapiens putative translation initiation factor (SUI1), mRNA. The most stable combination of probe sets was MmuSTS.4478.1.S1_at (multiple RefSeq IDs, annotated as "similar to guanine nucleotide binding protein, alpha stimulating activity polypeptide 1 isoform c") and MmugDNA.13670.1.S1_at (multiple RefSeq IDs) annotated for human aspartyl aminopeptidase (DNPEP). The range of stability values for all probe sets considered was 0.064-1.109, however expression levels for most of the most stably expressed probe sets were below levels of detection according to Microarray Suite version 5.0 (MAS 5.0)  analysis (Table 4).
824 "expressed sequences" from the original 1444 ('1c' in the methods) showed gene expression levels above the limits of detection (Table 5). When these were grouped by region the most stably expressed probe set: MmugDNA.22897.1.S1_s_at (stability value 0.065) was the same probe set that scored the highest expression stability rating when all 1444 sequences were considered (Tables 4 and 5). The most stably expressed combination of two probe sets (stability value 0.041) was MmugDNA.22897.1.S1_s_at and MmugDNA.33967.1.S1_at (not annotated). The range of stability values was 0.065-1.124.
Rhesus GeneChip® HRT study. All probe sets grouped by treatment
Using the 1444 probe sets annotated for housekeeping genes, when data were grouped by treatment, the most stably expressed (stability value = 0.053) probe set (MmugDNA.4544.1.S1_at, RefSeq ID XR_010342) was annotated for Rho guanine nucleotide exchange factor 7 (ARHGEF7). The most stably expressed combination of two probe sets (0.038) was for MmugDNA.30089.1.S1_x_at [RefSeq: XR_010595]; similar to Somatostatin receptor type 5) and MmunewRS.652.1.S1_at (multiple RefSeq transcript IDs; similar to calmodulin 1). The range of stability values for all probe sets considered was 0.053-0.396, however, expression levels for many probe sets were below levels of detection using MAS 5.0 analysis (Table 4).
When only the 824 "expressed sequences" from the original 1444 were grouped by treatment ('1c' in the methods, Table 5), the most stably expressed sequence was the same probe set, MmugDNA.22897.1.S1_s_at (stability value 0.059), that was most stably expressed when analysis grouping was done according to region. The most stably expressed combination of two probe sets (stability value 0.038) was the aforementioned MmugDNA.22897.1.S1_s_at and MmugDNA.18192.1.S1_at [RefSeq: XM_001099724], similar to NADH dehydrogenase (ubiquinone) flavoprotein 2, 24 kDa). The range of stability values was 0.059-0.395.
Human GeneChip® cycle study. All probe sets grouped by brain region
Our search method (see methods) revealed 1433 probe sets annotated for housekeeping genes on the human GeneChip®. When all probe sets were compared by brain region, the most stably expressed (stability value = 0.041) was probe set 213214_x_at [RefSeq: NM_001614], which represented actin, gamma 1 (ACTG1). The most stably expressed combination of probe sets, was 216295_s_at with multiple RefSeq transcript IDs for clathrin, light chain (CLTA) together with 202021_x_at, [RefSeq: NM_005801] representing eukaryotic translation initiation factor 1 (EIF1). The range of stability values was 0.041-0.987. Four probe sets annotated for ACTG1 were among the top 20 most stably expressed of the 1433 evaluated, and all four of these showed high expression (Table 6).
Human GeneChip® cycle study. All probe sets grouped by cycle phase
Using the 1433 probe sets annotated for housekeeping genes, when all probe sets were grouped for comparison according to menstrual cycle phase, the most stably expressed (stability value = 0.024) probe set was 216295_s_at, which had multiple RefSeq transcript ID annotations for clathrin, light chain (CLTA). The most stable combination of probe sets (stability value = 0.017) was the aforementioned 216295_s_at combined with 221607_x_at [RefSeq: NM_001614], which represented actin, gamma 1 (ACTG1). The range of stability values for the 1433 evaluated probe sets was 0.024-0.373. Five probe sets annotated for ACTG1 were among the top 20 most stably expressed of the 1433 evaluated, and all four of these showed high expression (Table 6).
Human GeneChip® cycle study. Most representative probe sets grouped by brain region
Using criteria described in the methods for representative probe set selection, our search method revealed 544 probe sets. When comparisons were made across brain regions, the most stably expressed sequence (stability value 0.053) was a probe set (207243_s_at, NCBI representative public ID NM_001743) representing Homo sapiens calmodulin 2 (phosphorylase kinase, delta) (CALM2), mRNA and annotated as calmodulin 1-3 (CALM1 /CALM2 /CALM3) on NetAffx. Sequences representing the most stably expressed combination of two genes (stability value = 0.030) were probe sets 201405_s_at [RefSeq: NM_006833] and 200633_at [RefSeq: NM_018955] which represent COP9 constitutive photomorphogenic homolog subunit 6 (COPS6) and ubiquitin B (UBB) respectively The latter probe set, 200633_at, was also annotated for ribosomal protein S27a (RPS27A) and ubiquitin C (UBC) (Table 7).
Human GeneChip® cycle study. Most representative probe sets grouped by cycle phase
Using the 544 "most representative" probe sets, when comparisons were made across phases of the menstrual cycle, the most stably expressed sequence (stability value = 0.026) was a probe set, 201390_s_at [RefSeq: NM_001320], representing casein kinase 2, beta polypeptide (CSNK2B) and annotated for lymphocyte antigen 6 complex, locus G5B (LY6G5B). The most stably expressed combination of two genes (stability value = 0.019) was represented by the aforementioned CSNK2B probe set (201390_s_at) and a probe set, 200633_at [RefSeq:NM_018955] representing ubiquitin B (UBB) and annotated for ribosomal protein S27a (RPS27A), and ubiquitin C (UBC) (Table 7). Thirteen probe sets among the 20 most stably ranked across cycle phase were also among the 20 most stably ranked across brain region.
Human GeneChip® cycle study. Most representative probe sets: comparison between popular normalizers
We refer to the "popular normalizers" as the thirteen widely used normalizers http://www.compugen.co.il/supp_info/Housekeeping_genes.html in addition to Asparagine-linked glycosylation protein 9 homolog (ALG9) and Ribosomal protein L13a (RPL13A). When the most representative probe sets for the popular normalizers were compared, the probe set 200017_at [RefSeq:NM_002954], representing ribosomal protein S27a (RPS27A) was the most stably expressed (Table 8). This finding was consistent when comparisons were made across brain region or phase of the menstrual cycle. This probe set was also annotated for ubiquitin B (UBB) and ubiquitin C (UBC). In the analysis grouped by brain region, seven probe sets in the top 20 showed expression below limits of detection, whereas with the phase grouping, expression levels for one probe set out of 20 were below limits of detection (Table 8).
Findings common to both (HRT and cycle) studies
In both studies, frequency distributions of expression stability data for the housekeeping gene probe sets were skewed toward the more stably expressed sequences (Figure 5), failing Kolmogorov-Smirnov (P < 0.001) and Shapiro-Wilks (P < 0.001) tests for normality. For the popular normalizers in both studies, probe sets for RPS27A tended to clump according to expression stability among the most stably expressed in the collective set (Table 8).
In six of the analyses conducted between the two experiments, 31 gene annotations were found to be common to multiple analyses, and 12 annotations were common to both experiments (Table 9). Probe sets annotated for RPS27A/ubiquitin were the most commonly observed stably expressed sequences in all analyses between the two studies.
Using three popular algorithms, we assessed relative gene expression stability across the three brain regions, to identify genes that met or exceeded criteria commonly used for selection of internal reference genes used for qRT-PCR normalization [8, 16]. In each case the prospective internal reference genes RPL13A, GAPDH and ALG9 were found to be more reliable normalizers than the selected genes for GABAergic system components , with the exception was GAD1, which was ranked as being more stably expressed than GAPDH using geNorm. We suspected that this stems from the variation in GAPDH expression in the MBH, which the NormFinder intra-group analysis showed to be an order of magnitude higher than the variation in the expression of other examined genes. Reduction of sample variance, by removal of the most deviant MBH value produced a geNorm ranking where GAPDH was more highly ranked than GAD1.
The finding that higher gene expression variability occurred in the MBH compared to the extra-hypothalamic regions (HPC and AMD) was consistent with findings from a principal components (statistical) analysis of gene expression during phases of the rhesus macaque menstrual cycle  under conditions of the current study.
Probe sets annotated for RPS27A/ubiquitin were stably expressed in both studies and provide basis for comparing results in the human and rhesus GeneChips®. Note that in analysis of cycle study data grouped by region, probe sets for RPS27A/ubiquitin do not appear in the top 20 most stably expressed probe sets when all probe sets were considered (Table 6). However the RPS27A/ubiquitin probe set '200633_at' appears as the 26th most stably expressed of the 1433 probe sets tested, and was extremely highly expressed with a rating of "++++" (data not shown). Comparatively, in the HRT study using the rhesus GeneChip®, the probe set 'MmugDNA.43194.1.S1_at' was annotated as "similar to ubiquitin and ribosomal protein S27A", and showed expression levels below MAS 5.0 analysis detection limits (Table 8). However another similarly annotated probe set (MmugDNA.26506.1.S1_at) was highly expressed, had a regional expression stability of 0.15 (rank = 453/1444) and a treatment expression stability of 0.069 (rank = 46/1444) (Data not shown). The rhesus macaque annotations for both of these probe sets are based on a Macaca fascicularis sequence annotated by comparison to the human sequence listed under RefSeq ID [NM_002954.3].
A detailed examination of the NetAffx annotation did not clarify if these probe sets interrogate the RPS27A sequence solely, or the RPS27A/ubiquitin fusion sequence. Note that ubiquitin is covalently bound to proteins targeted for posttranslational modification or degradation, and influences the intracellular localization and stability of proteins. The ubiquitin gene can be fused to a ribosomal protein gene, and this fusion gene may be referenced by RPS27A probe sets in the on the Affymetrix® arrays.
Affymetrix® arrays contain redundant probe sets that interrogate different regions of the same gene , and reflect differential regulation of alternative script production based on alternative splicing or polyadenylation . Screening using qualitative present vs. absent calls from MAS5.0 analysis can improve reliability of evaluation among redundant probe sets [41, 43, 44].
Probe sets for the same gene commonly show differences in expression levels [41, 43–45]. For well annotated genes like ACTB, these probe set sequences are likely to be accurate, and microarray analysis may be detecting variations in expression stability along different portions of the same sequence [44, 46]. Although annotation of rhesus GeneChip® probe sets are based on sequences defined using the human GeneChip® as a template , annotation of many probe sets for the rhesus GeneChip® are inferred and are frequently separated from verified sequences by more levels of interpretation than is the case for the human GeneChip® . For the rhesus macaque, annotation reliability of the subset of the rhesus GeneChip® probe sets that have been verified using rhesus macaque tissues may exceed the reliability of probe sets annotated on the human GeneChip®. However full annotation of the rhesus GeneChip® is still a work in progress  and to date, large numbers of functional rhesus macaque transcripts may be more reliably interrogated using the human GeneChip®.
Robust normalizers identified by microarray analysis
In the cycle study, the occurrence of four highly expressed, well annotated ACTG1 probe sets ranked among the top 20 most stably expressed sequences in both analytical groupings, causes ACTG1 to meet criteria for what we propose to call a "robust normalizer". i.e., multiple segments of the same gene [44, 46] show high expression stability across all experimental conditions.
Identification of a robust normalizer (ACTG1) was accomplished using the human but not the rhesus GeneChip®. In contrast, probe sets annotated for RPS27A showed high stability across all tissues and conditions used in both experiments (Tables 7, 8 and 9). However, annotation on the rhesus GeneChip® was insufficient for exploration of robustness as a potential normalizer.
Twelve annotations from among the various selections of "20 most stably expressed" were common to both experiments (Table 9). Within the cycle study, multiple probe sets for the clathrin light chain (CLTA) were observed among the 20 most stably expressed under two methods of probe set selection, and were robustly expressed using MAS 5.0 detection (Tables 6 and 9).
In both studies, the expression stabilities of popular normalizers were spread across much of the range observed in the overall pool of housekeeping genes. As a group, the popular normalizers did not show tendencies to be more stably expressed than the larger pool of housekeeping genes (See ranks in Table 8).
Probe sets for RPS27A and RPL11 showed high stability rankings among the popular normalizers for all analyses in both studies (Table 8). In analysis of the most representative probe sets for the cycle study, the appearance of clusters (by rank) of probe sets for popular normalizers RPS27A, RPL13A, ARHGDIA, ACTB and GAPDH showing high expression stability (Figure 6) under both regional and phase-based analyses prompted us to identify these genes as robust normalizers among the subset of popular normalizers.
Probe sets for ACTB and GAPHD are well annotated and used as controls on the rhesus GeneChip® , however probe sets for these genes show a high range of expression stabilities (Figure 7). The significance of variable expression among well annotated probe sets for the same gene is under evaluation [41, 44]. Possibly related to this probe set variability in expression and expression stability, we found sequences for ACTB and GAPDH to be problematic in qRT-PCR normalization of the HRT study (unpublished data).
Comparison between qRT-PCR and microarray data
Under all selection criteria used in the current study, we indentified probe sets for genes more stably expressed than probe sets for genes (RPL13A, ALG9 and GAPDH) that we showed to be well suited for qRT-PCR normalization based on high concordance with microarray results, as well as relative expression stability comparisons using three algorithms designed for this purpose . Interestingly, when all rhesus GeneChip® probe sets were restricted to those for popular normalizers, RPL13A and GAPDH were among the more highly ranked (stably expressed) and showed high expression (Table 8). Additional genes may be open for consideration given that many probe sets on the rhesus GeneChip® were more stably expressed than the probe sets for RPL13A, ALG9 and GAPDH. In addition, the probes used for qRT-PCR were derived from the same NCBI sequences as the rhesus GeneChip® probe sets. The noticeable rank separation of ALG9 from RPL13A and GAPDH in the HRT study emphasizes the importance of considering that all genes included in the NormFinder analysis influence systemic variation which affects relative ranking .
Note that how representative we considered a probe set to be was based on the cumulative record of annotation history associated with the probe set. Other investigators performing gene expression comparisons using approximately 500 genes showed high correlation between results from multiple microarray platforms (Affymetrix, Agilent, Illumina, GE Healthcare and NCI) and TaqMan® qRT-PCR results. In addition, high correlations between qRT-PCR and microarray results using RMA-normalized log 2-transformed data in nonhuman primates have been demonstrated elsewhere . The use of publicly available microarray data provides a selection method that is independent of the microarray platform or normalization methodology, and is able to cope with gene lists that overlap only partially . We considered genes showing both low and high expression in addition to high expression stability because the data range between the minimum and maximum expression levels could have a profound influence on normalizer calibration. Although pairwise gene expression stability measures account for effects of large differences in expression levels , having a small range of control gene expression values can skew comparative detection sensitivity.
It is important to note that other methods would likely detect stably expressed genes from the current study which are not included in the published set of 575 human housekeepers. However, our goal was for current study to identify candidates likely enough to be stably expressed over experimental variation so as to allow us to best manage PCR for future macaque studies involving these brain regions, where additional microarray analysis may not be feasible.
Using gene microarray analysis of two experiments, we ranked expression stability of sequences for 575 published housekeeping genes under six sex-steroid environments in three regions of the rhesus macaque brain. Sequences for popularly used normalizing genes did not tend to be more stably expressed than sequences from the overall pool of housekeeping genes, and probe set expression stability values for multiple genes frequently overlapped. Although annotation quality of the rhesus GeneChip® was not sufficient to facilitate detection of robust normalizers, comparisons of relative expression stability values for the same genes between the rhesus and human GeneChips® were possible. Robust normalizer candidates were identified using the human GeneChip®. For example, in the cycle study, multiple probe sets for ACTG1 were stably expressed under all conditions in all brain regions at levels allowing easy detection. Therefore we recommend ACTG1 as a robust normalizer for examination of MBH, HPC and AMD under changing ovarian hormonal conditions. Comparatively, in both studies, probe sets for RPS27A were stably expressed under all conditions in all three brain regions at levels allowing easy detection, and may be the normalizer of choice for MBH, HPC and AMD comparison between both experiments. However, further examination of probe set annotation quality for this gene is recommended.
In summary, we identified multiple genes that were more stably expressed across more experimental conditions and showed less probe set expression variability than popularly used genes meeting typical requirements for qRT-PCR normalization. These findings demonstrate uses for well annotated gene microarray data in addressing widely documented problems associated with the selection of experimentally specific internal reference genes.
Overview (Figure 1)
Tissue from the arcuate nucleus of the medial basal hypothalamus (MBH), hippocampus (HPC) and amygdala (AMD) of rhesus macaques Macaca mulatta were collected for examination in two separates studies. One study was designed to assess effects of three hormone replacement therapy (HRT) conditions on gene expression in the three brain regions collected, and this gene expression was examined using the rhesus GeneChip®. In the HRT study qRT-PCR was conducted on all tissues in addition to microarray analysis. In a second study (cycle study), gene expression in the three brain regions during early follicular (EF) late follicular (LF) and mid luteal (ML) phases of the menstrual cycles of normally menstruating macaques was examined using the human GeneChip®.
In the gene microarray analyses for both the HRT and cycle studies, comparisons of the relative expression stabilities of probe sets annotated for independently assessed human housekeeping genes  were conducted using NormFinder  algorithms equipped to process data from microarrays. Because the reliability of the NormFinder algorithm is dependent on the expression stability of the sequences examined , the most widely used normalizers from the list of housekeeping genes http://www.compugen.co.il/supp_info/Housekeeping_genes.html, as well as RPL13A and ALG9 (the latter two considered noteworthy based on our prior results  and considered here as part of the "popular normalizer" group) were examined in a separate analyses. Again, in efforts to compare probe sets best suited for use in the NormFinder analysis, in the cycle study we designated probe sets as "most representative" according to criteria described later in the current methods section and analyzed these probe sets separately as well.
All analyses from both experiments (Figure 1) are summarized as follows:
1a) HRT study - qRT-PCR: GABAergic component genes, ALG9, GAPDH and RPL13A expression variability compared using geNorm, NormFinder and BestKeeper algorithms.
1b) HRT study - gene microarray -general probe set selection: NormFinder relative expression stability assessments of 1444 rhesus GeneChip® probe sets annotated for housekeeping genes, grouped by brain region or hormone treatment.
1c) HRT study - gene microarray - "expressed sequences" from the general probe set selection: NormFinder relative expression stability assessments of 824 probe sets showing above average signal intensity and receiving "present" calls in MAS 5.0 analysis.
1d) HRT study - gene microarray - probe set selection for popular normalizers: NormFinder relative expression stability assessments of all rhesus GeneChip® probe sets annotated for 15 "popular normalizers", grouped by brain region or hormone treatment.
2a) Cycle study - gene microarray - general probe set selection: NormFinder relative expression stability assessments of 1433 human GeneChip® probe sets annotated for housekeeping genes, grouped by brain region or cycle phase.
2b) Cycle study - gene microarray - most representative probe set selection: NormFinder relative expression stability assessments of 544 human GeneChip® probe sets selected for the highest annotation quality among the 1433 probe sets annotated for housekeeping genes, grouped by brain region or cycle phase.
2c) Cycle study - gene microarray - popular normalizer probe set selection from among the most representative probe sets: NormFinder relative expression stability assessments of most representative human GeneChip® probe sets annotated for 15 "popular normalizers", grouped by brain region or cycle phase.
Adult (age range 9-12 years) female rhesus macaques (Macaca mulatta) were cared for in accordance with IACUC regulations and the National Research Council's Guide for the Care and Use of Laboratory Animals by the Division of Animal Resources at the Oregon National Primate Research Center (ONPRC). All procedures were ethically and legally approved by these overseeing bodies. Twelve animals were used per study, and were housed in a temperature-controlled environment where Primate Chow (Purina Mills Inc., St. Louis, MO) was made available to the animals twice daily, at 8:00 h and again at 15:00 h. This diet was supplemented with fresh fruit and vegetables, and the animals had continuous access to drinking water.
The animals were euthanized using sodium pentobarbital (25-30 mg/kg i.v.) and exsanguinated following procedures recommended by the American Veterinary Medical Association's Panel on Euthanasia. In all cases, necropsies were performed within a narrow window of time (1000-1300 h). Various postmortem tissues were collected and made available to other investigators through the ONPRC Tissue Distribution Program. After a transcardial flush with 1 liter of 0.9% saline, the brains were immediately removed, cut into blocks, and preserved in RNAlater® (Ambion, Austin, TX). Areas of interest (MBH, HPC and AMD) were subsequently dissected from tissue blocks, resulting in a total of 36 individual samples per study.
As previously described , all animals in the HRT study were ovariectomized (OVX). Untreated ovariectomized animals served as controls (OXV), whereas others received subcutaneous SILASTIC implants containing either 17β-estradiol (E2), or E2 and progesterone (E2+P4).
In the cycle study, daily menstrual records were established for each female based on close inspection of the monkey's perineum and cage pan for signs of menstrual bleeding. All females were determined to have regular monthly cycles of approximately 28 days. Only data obtained from healthy monkeys, as determined by the ONPRC veterinary staff, were included in the statistical analyses. Serum E2 levels and serum P4 levels were analyzed to assist in establishing an animal's menstrual cycle phase. Using menstrual cycle monitoring, tissue was timed for collection during the early follicular stage ("EF" = low E2 and P4), late follicular ("LF" = declining E2 after ovulation, low P4) and mid luteal ("ML" = low E2 high P4). Four animals were identified for each of the three phases of the cycle (total = 12). Average values for EF were E2 = 64.8 pg/ml, P4 = 0.18 ng/ml; for LF, E2 = 71 pg/ml, P4 = 0.52 ng/ml; for ML, E2 = 39 pg/ml, P4 = 4.92 ng/ml. At necropsy, menstrual stage was also verified using histological examination of the endometrium, with EF = thin endometrium, ciliated oviduct; LF = thin, proliferative endometrium with ciliated and fully secretory oviduct; ML = thickened endometrium.
Quantitative real-time RT-PCR (qRT-PCR) and data collection were conducted using the 7900HT Fast Real-Time PCR thermal cycler and sequence detection systems (Software version 2.2.1) from Applied Biosystems (Foster City, CA). No-template (negative) controls were included for each gene analysis. Four-point standard curves were constructed using cDNA pooled equally from all brain regions and all animals. The curves were constructed from serial 5- fold dilutions and covered a cDNA dilution range of 0.2 to 0.0016 (larger fold dilutions produced unacceptably high cycle times for some genes in the study).
qRT-PCR reactions for unknowns were conducted in sealed 384-well optical plates in a total volume of 5 μl per well, using 1.0 μl of 1:5-diluted cDNA, and final concentrations of 0.25 μM Taqman® TAMRA probe and 0.3 μM each of forward and reverse primers. Reactions were conducted using thermal cycler conditions of: 2 min at 50°C, 10 min at 95°C and 50 cycles of 15 s at 95°C (DNA melting) and 1 min at 60°C (primer annealing/extension). Baseline and threshold levels for amplification plots were determined automatically using the ABI sequence detection systems software version 2.2.1.
We examined expression of prospective internal reference genes (ALG9, GAPDH and RPL13A), as well as genes encoding GABA receptor subunits (GABRA1, GABRA4, GABRG2, GABRD and GABRE) and a GABA-synthesizing enzyme (GAD1). We compared expression stability across three conditions of ovarian steroid exposure in the three brain regions examined (MBH, HPC and AMD). These comparisons were initially made in an investigation of hormone effects on expression of GABAergic components , but we describe the qRT-PCR results in more detail here for further comparison against results from gene microarray analyses.
qRT-PCR primers and probes
Primers and probes for prospective internal reference genes ALG9, GAPDH and RPL13A as well as GABA subunit receptors GABRA1, GABRA4, GABRG2, GABRD and GABRE and the enzyme GAD1 were designed using Primer Express 2.0 software (Applied Biosystems, Foster City, CA) from sequence sources listed in Table 1. Rhesus macaque sequences for GAPDH and RPL13A were confirmed in-house using RT-PCR primers against source sequences to amplify rhesus macaque hippocampal cDNA pooled from several individuals. These PCR products were sequenced using an ABI 3730×l DNA sequencer (Applied Biosystems) according to manufacturer's instructions.
1a. qRT-PCR GeNorm analysis
Quantity values calculated using the standard curve method  were entered into the geNorm version 3.5 VBA applet for Windows  and used to calculate the gene-stability measure (M) defined as the average pairwise variation of a given gene with all other considered genes. The least stable gene was then eliminated and stability based on pairwise comparisons recalculated to produce a new ranking. This sequential elimination process  was continued until no stability differences were detected between genes. Because one of the MBH OVX samples introduced a high level of variation in gene expression, the analysis was repeated with this sample omitted, in order to test the effects of variation in this group on relative gene expression stability output.
1a. qRT-PCR NormFinder analysis
Quantity values calculated using the standard curve method  were evaluated using the model-based variance estimation approach facilitated by the "NormFinder" Visual Basic application  for Microsoft Excel, available from the Molecular Diagnostics Laboratory (Aarhus University, Denmark). Samples were grouped according to brain region and stability was estimated with and without group identifiers. For each of the three brain regions, intra-group and inter-group variation  was calculated for each gene. Three rounds of analysis were conducted as follows: 1) All nine genes were included in order to test the stability of GABA receptor subunit genes; 2) The five most stable genes (ALG9, GAPDH, RPL13A GAD1 and GABRA4) were analyzed in attempts to maximize the quality of variation estimation methodology based on sample size; 3) Only the three predicted normalizers, ALG9, GAPDH and RPL13A, were analyzed to maximize estimation quality based on removal of systematic variation . As described for the geNorm analysis, all tests were repeated with and without the single MBH OVX sample responsible for most of the MBH variation omitted. High gene expression variation in the MBH also prompted additional stability analysis where the MBH was considered separately from the HPC and AMD.
1a. qRT-PCR BestKeeper analysis
Crossing point values  were examined using the BestKeeper Excel-based tool . Standard curves were used to calculate amplification efficiency (EA) according to the convention EA = 10(-1/slope). All samples were analyzed together, and in light of NormFinder analysis results highlighting GAPDH expression variation in the MBH, the MBH was analyzed separately from the AMD and HPC.
RNA extraction and preparation of cDNA from MBH, HPC and AMD was conducted as previously described [26, 52]. Both RMA and Affymetrix® Microarray Suite version 5.0 (MAS 5.0)  analyses were conducted using methods previously described [26, 52]. RMA-normalized results were analyzed using the NormFinder Visual Basic application  where identifiers were used to conduct two analyses (according to grouping) in each study. In the HRT study, expression values were grouped according to 1) brain region and 2) hormone treatment. For the cycle study, expression values were grouped according to 1) brain region and 2) to phase of the menstrual cycle.
1b. Microarray general probe set selection from the rhesus GeneChip®
A publicly available list of 575 human genes expressed under all conditions tested, and derived from publicly available microarray results, http://www.compugen.co.il/supp_info/Housekeeping_genes.html,
was used to identify genes with high likelihood of meeting criteria required to be considered as appropriate housekeeping genes . NetAffx build number 28 (March 11, 2009) for the Affymetrix® GeneChip® rhesus Macaque Genome Array was used to select rhesus macaque probe sets with RefSeq mRNA transcript IDs matching genes from the publicly available list of 575 proposed human housekeeping genes . Where no matches were found, probe sets were selected if gene symbols for housekeeping genes of interest were included in their annotation. If RefSeq mRNA transcript and gene symbol annotations for probe sets could not be found, the annotation build was searched by gene name.
1c. Microarray selection of "expressed" probe sets from the rhesus GeneChip®
Because many of the sequences obtained from the general probe set selection were poorly annotated or showed low expression, a second pair of NormFinder relative expression stability assessments, grouped by brain region or hormone treatment, was made using only probe sets with average expression levels meeting detection criteria using MAS 5.0 analysis. Probe sets meeting "expressed" criteria (824 probe sets in total) showed average signal detection of 200 (global scaling target intensity) or higher, and had present calls  in more than 50% of the animals.
2a. Microarray general probe set selection from the human GeneChip®
Using annotations from HG-U133 Plus 2.0 NetAffx build number 28 (March 11, 2009), RefSeq record numbers for mature mRNA transcripts, indicated by the prefix "NM_", from the housekeeping gene list were used to identify probe sets on the Affymetrix® U133 Plus 2.0 GeneChip®  representative of the genes in question.
2b. Microarray most representative probe set selection from the Human GeneChip®
Probe set selection using this approach was designed to maximize accuracy while minimizing redundancy in the data used to compare gene expression stability. To maximize annotation consistency between the probe set sequences and the genes listed in the public database of 575 housekeeping genes, probe sets with representative public IDs matching those in the public database list were prioritized. However, if no public ID match was found, RefSeq Transcript ID listings were used. If multiple transcript IDs were listed, or multiple probe sets had the same transcript ID, where possible, we eliminated probe sets with "x" and "s" suffixes  where probes in the probe set may have matched transcripts from different genes. In general we selected final probe sets with the highest annotation grade (A), however, to ensure consistency with original mRNA record numbers, probe sets with B-grade annotations were selected in rare instances. Where probe sets appeared equivalent, we selected the set with the most complete mRNA coding sequence (cds), or more recent submission. If complete cds sequences overlapped then sets with the embedded sequence were selected. Where annotation was unclear, the gene was not included.
1d and 2c. Microarray probe sets from "popular normalizers"
Thirteen genes from the publicly available list of housekeeping genes were designated "in popular use as reference in real-time PCR" http://www.compugen.co.il/supp_info/Housekeeping_genes.html. These 13 genes together with ALG9 and RPL13A are referred to as the "popular normalizers" in this manuscript. Because the relative expression stability values calculated by the NormFinder algorithm can be argued to be more accurate when more stably expressed genes are used, we conducted separate analyses using only the popular normalizers for comparison with the larger publicly available group. Probe sets used in analyses of the popular normalizers were selected using the "general" and "representative" methods described above.
- ACTB :
gene encoding actin, beta
- ACTG1 :
gene encoding actin, gamma 1
- ACVRL1 :
gene encoding activin A receptor type II-like 1
- AHSA1 :
gene encoding activator of heat shock 90 kDa protein ATPase homolog 1
- AKR1A1 :
gene encoding aldo-keto reductase family 1, member A1
- ALDOA :
gene encoding aldolase A, fructose-bisphosphate
- ALG9 :
gene encoding asparagine-linked glycosylation 9 homolog
- API5 :
gene encoding apoptosis inhibitor 5
- ARHGDIA :
gene encoding Rho GDP dissociation inhibitor (GDI) alpha
- ARHGEF7 :
gene encoding Rho guanine nucleotide exchange factor (GEF) 7
- ARL2 :
gene encoding ADP-ribosylation factor-like 2
- ATF4 :
gene encoding activating transcription factor 4 (tax-responsive enhancer element B67)
- ATP5S :
gene encoding ATP synthase, H+ transporting, mitochondrial F0 complex, subunit s (factor B)
- ATP6V1F :
gene encoding ATPase, H+ transporting, lysosomal 14 kDa, V1 subunit F
- B4GALT3 :
gene encoding UDP-Gal:betaGlcNAc beta 1,4- galactosyltransferase, polypeptide 3
- BRI3 :
gene encoding Brain protein I3
- CALM1/CALM2/CALM3 :
gene encoding calmodulin 1/2/3 (phosphorylase kinase, delta)
gene encoding cyclin D3
- CLTA :
gene encoding clathrin, light chain (Lca)
- COL6A1 :
gene encoding collagen alpha-1(VI) chain
- COPS6 :
gene encoding COP9 constitutive photomorphogenic homolog subunit 6 (Arabidopsis)
- COX4I1 :
gene encoding cytochrome c oxidase subunit IV isoform 1
- COX7A2L :
gene encoding polypeptide 2-like cytochrome c oxidase subunit VIIa
- COX7C :
gene encoding cytochrome c oxidase subunit VIIc
- CSNK2B/LY6G5B :
gene encoding casein kinase 2, beta polypeptide/lymphocyte antigen 6 complex, locus G5B
- CYB5R1 :
gene encoding cytochrome b5 reductase 1
- DIAPH1 :
gene encoding diaphanous homolog 1 (Drosophila)
17β-estradiol + progesterone
PCR Amplification efficiency
- EEF1A1 :
gene encoding eukaryotic translation elongation factor 1 alpha 1
- EEF2 :
gene encoding eukaryotic translation elongation factor 2
early follicular (menstrual cycle phase)
- EIF1 :
gene encoding eukaryotic translation initiation factor 1
- EIF4A2 :
gene encoding eukaryotic translation initiation factor 4A, isoform 2 e encoding protein
- GABRA1 :
gene encoding GABAA receptor subunit alpha 1
- GABRA4 :
gene encoding GABAA receptor subunit alpha 4
- GABRD :
gene encoding GABAA receptor subunit delta
- GABRE :
gene encoding GABAA receptor subunit epsilon
- GABRG2 :
gene encoding GABAA receptor subunit gamma 2
- GAD1 :
gene encoding glutamic acid decarboxylase 1 (67 kDa)
- GAPDH :
gene encoding glyceraldehyde 3-phosphate dehydrogenase
- GAPDH :
gene encoding Glyceraldehyde-3-phosphate dehydrogenase
- GP2 :
gene encoding glycoprotein 2 (zymogen granule membrane)
- GPAA1 :
gene encoding glycosylphosphatidylinositol anchor attachment protein 1
- GPX4 :
gene encoding glutathione peroxidase 4 (phospholipid hydroperoxidase)
- GRIK5 :
gene encoding glutamate receptor, ionotropic kainate 5
- H6PD :
gene encoding hexose-6-phosphate dehydrogenase (glucose 1-dehydrogenase)
- HAX1 :
gene encoding HCLS1 associated protein X-1
- HINT1 :
gene encoding histidine triad nucleotide binding protein 1
- HIST1H2BC :
gene encoding histone H2B 291B
- HPCAL1 :
gene encoding hippocalcin-like protein 1
- HSPCB :
gene encoding heat shock protein 90kDa alpha (cytosolic), class B member 1
- INPP5K :
gene encoding inositol polyphosphate-5-phosphatase K
- LDHA :
gene encoding lactate dehydrogenase A
- LDHB :
gene encoding lactate dehydrogenase B
late follicular (menstrual cycle phase)
- MAPKAPK2 :
gene encoding mitogen-activated protein kinase-activated protein kinase 2
arcuate nucleus of the medial basal hypothalamus
mid luteal (menstrual cycle phase)
- MVK :
gene encoding mevalonate kinase
- NACAP1 :
gene encoding nascent-polypeptide-associated complex alpha polypeptide pseudo gene 1
- NDUFA2 :
gene encoding NADH dehydrogenase (ubiquinone) 1 alpha subcomplex, 2, 8kDa
- NDUFS5 :
gene encoding NADH dehydrogenase (ubiquinone) Fe-S protein 5, 15kDa (NADH-coenzyme Q reductase)
- NONO :
gene encoding non-POU domain containing, octamer-binding protein
- NUDT3 :
gene encoding nudix (nucleoside diphosphate linked moiety X)-type motif 3
- PFDN1 :
gene encoding prefoldin subunit 1
- PFDN5 :
gene encoding prefoldin subunit 5
- PGK1 :
gene encoding phosphoglycerate kinase 1
- POLR2A :
gene encoding polymerase (RNA) II (DNA directed) polypeptide A, 220kDa
- PPP2CB :
gene encoding protein phosphatase 2 (formerly 2A), catalytic subunit, beta isoform
- PRPF8 :
gene encoding PRP8 pre-mRNA processing factor 8 homolog (S. cerevisiae)
- PSMD2 :
gene encoding proteasome (prosome, macropain) 26S subunit, non-ATPase, 2
quantitative real-time polymerase chain reaction
- RAC1 :
gene encoding ras-related C3 botulinum toxin substrate 1
- RAD23A :
gene encoding RAD23 homolog A (S. cerevisiae)
- RAD9A :
gene encoding RAD9 homolog
- RPL10 :
gene encoding ribosomal protein L10
- RPL11 :
gene encoding ribosomal protein L11
- RPL13A :
gene encoding ribosomal protein L13a
- RPL19 :
gene encoding ribosomal protein L19
- RPL32 :
gene encoding ribosomal protein L32
- RPL37 :
gene encoding ribosomal protein L37
- RPLP1 :
gene encoding ribosomal protein, large, P1
- RPS14 :
gene encoding ribosomal protein S14
- RPS18 :
gene encoding ribosomal protein S18
- RPS24 :
gene encoding ribosomal protein S24
- RPS25 :
gene encoding 40S ribosomal protein S25
- RPS27A/UBB/UBC :
gene encoding ribosomal protein S27a/ubiquitin B/ubiquitin C
- RPS27A :
gene encoding ribosomal protein S27a
- RRAGA :
gene encoding Ras-related GTP binding A
- SARS :
gene encoding seryl-tRNA synthetase
- SDC3 :
gene encoding similar to Syndecan-3 (SYND3)
- SNRPA :
gene encoding small nuclear ribonucleoprotein polypeptide A
- SNX3 :
gene encoding sorting nexin 3
- SPAG7 :
gene encoding sperm associated antigen 7
- SSR2 :
gene encoding signal sequence receptor, beta (translocon-associated protein beta)
- STK24 :
gene encoding serine/threonine kinase 24
- SUI1 :
gene encoding putative translation initiation factor TADA3L :gene encoding transcriptional adaptor 3 (NGG1 homolog, yeast)-like
- TCF25 :
gene encoding transcription factor 25 (basic helix-loop-helix)
- TCFL1 :
gene encoding vacuolar protein sorting 72 homolog (S. cerevisiae)
- TMED9 :
gene encoding transmembrane emp24 protein transport domain containing 9
- TTC1 :
gene encoding tetratricopeptide repeat domain 1
- UBB :
gene encoding ubiquitin B
- UBC :
gene encoding ubiquitin C
- UQCRH :
gene encoding ubiquinol-cytochrome c reductase hinge protein
gene encoding ubiquinol-cytochrome c reductase, complex III subunit VII, 9.5kDa
- VEGFB :
gene encoding vascular endothelial growth factor B
- VPS72 :
gene encoding vacuolar protein sorting 72 homolog (S. cerevisiae)
- YWHAH :
gene encoding 14-3-3n protein
- ZNF592 :
gene encoding zinc finger protein 592.
Gibson UE, Heid CA, Williams PM: A novel method for real time quantitative RT-PCR. Genome Res 1996, 6: 995-1001. 10.1101/gr.6.10.995 10.1101/gr.6.10.995
Heid CA, Stevens J, Livak KJ, Williams PM: Real time quantitative PCR. Genome Res 1996, 6: 986-994. 10.1101/gr.6.10.986 10.1101/gr.6.10.986
Mutch DM, Berger A, Mansourian R, Rytz A, Roberts MA: Microarray data analysis: a practical approach for selecting differentially expressed genes. Genome Biol 2001, 2: preprint0009.0001-0009.0029. 10.1186/gb-2001-2-12-preprint0009 10.1186/gb-2001-2-12-preprint0009
Mutch DM, Berger A, Mansourian R, Rytz A, Roberts MA: The limit fold change model: a practical approach for selecting differentially expressed genes from microarray data. BMC Bioinformatics 2002, 3: 17. 10.1186/1471-2105-3-17 10.1186/1471-2105-3-17
Wurmbach E, Yuen T, Sealfon SC: Focused microarray analysis. Methods 2003, 31: 306-316. 10.1016/S1046-2023(03)00161-0 10.1016/S1046-2023(03)00161-0
Provenzano M, Mocellin S: Complementary techniques: validation of gene expression data by quantitative real time PCR. Adv Exp Med Biol 2007, 593: 66-73. full_text full_text
Bustin SA, Nolan T: Pitfalls of quantitative real-time reverse-transcription polymerase chain reaction. J Biomol Tech 2004, 15: 155-166.
Huggett J, Dheda K, Bustin S, Zumla A: Real-time RT-PCR normalisation; strategies and considerations. Genes Immun 2005, 6: 279-284. 10.1038/sj.gene.6364190 10.1038/sj.gene.6364190
Tanaka S, Furukawa T, Plotkin SA: Human cytomegalovirus stimulates host cell RNA synthesis. J Virol 1975, 15: 297-304.
Raff T, van der Giet M, Endemann D, Wiederholt T, Paul M: Design and testing of beta-actin primers for RT-PCR that do not co-amplify processed pseudogenes. Biotechniques 1997, 23: 456-460.
Zhong H, Simons JW: Direct comparison of GAPDH, beta-actin, cyclophilin, and 28S rRNA as internal standards for quantifying RNA levels under hypoxia. Biochem Biophys Res Commun 1999, 259: 523-526. 10.1006/bbrc.1999.0815 10.1006/bbrc.1999.0815
Goidin D, Mamessier A, Staquet MJ, Schmitt D, Berthier-Vergnes O: Ribosomal 18S RNA prevails over glyceraldehyde-3-phosphate dehydrogenase and beta-actin genes as internal standard for quantitative comparison of mRNA levels in invasive and noninvasive human melanoma cell subpopulations. Anal Biochem 2001, 295: 17-21. 10.1006/abio.2001.5171 10.1006/abio.2001.5171
Zhu G, Chang Y, Zuo J, Dong X, Zhang M, Hu G, Fang F: Fudenine, a C-terminal truncated rat homologue of mouse prominin, is blood glucose-regulated and can up-regulate the expression of GAPDH. Biochem Biophys Res Commun 2001, 281: 951-956. 10.1006/bbrc.2001.4439 10.1006/bbrc.2001.4439
Selvey S, Thompson EW, Matthaei K, Lea RA, Irving MG, Griffiths LR: Beta-actin--an unsuitable internal control for RT-PCR. Mol Cell Probes 2001, 15: 307-311. 10.1006/mcpr.2001.0376 10.1006/mcpr.2001.0376
Glare EM, Divjak M, Bailey MJ, Walters EH: beta-Actin and GAPDH housekeeping gene expression in asthmatic airways is variable and not suitable for normalising mRNA levels. Thorax 2002, 57: 765-770. 10.1136/thorax.57.9.765 10.1136/thorax.57.9.765
Dheda K, Huggett JF, Bustin SA, Johnson MA, Rook G, Zumla A: Validation of housekeeping genes for normalizing RNA expression in real-time PCR. Biotechniques 2004, 37: 112-114, 116, 118-119.
Dheda K, Huggett JF, Chang JS, Kim LU, Bustin SA, Johnson MA, Rook GA, Zumla A: The implications of using an inappropriate reference gene for real-time reverse transcription PCR data normalization. Anal Biochem 2005, 344: 141-143. 10.1016/j.ab.2005.05.022 10.1016/j.ab.2005.05.022
Sellars MJ, Vuocolo T, Leeton LA, Coman GJ, Degnan BM, Preston NP: Real-time RT-PCR quantification of Kuruma shrimp transcripts: a comparison of relative and absolute quantification procedures. J Biotechnol 2007, 129: 391-399. 10.1016/j.jbiotec.2007.01.029 10.1016/j.jbiotec.2007.01.029
Folkersen L, Kurtovic S, Razuvaev A, Agardh HE, Gabrielsen A, Paulsson-Berne G: Endogenous control genes in complex vascular tissue samples. BMC Genomics 2009, 10: 516. 10.1186/1471-2164-10-516 10.1186/1471-2164-10-516
Hoerndli FJ, Toigo M, Schild A, Gotz J, Day PJ: Reference genes identified in SH-SY5Y cells using custom-made gene arrays with validation by quantitative polymerase chain reaction. Anal Biochem 2004, 335: 30-41. 10.1016/j.ab.2004.08.028 10.1016/j.ab.2004.08.028
Nieto PA, Covarrubias PC, Jedlicki E, Holmes DS, Quatrini R: Selection and evaluation of reference genes for improved interrogation of microbial transcriptomes: case study with the extremophile Acidithiobacillus ferrooxidans. BMC Mol Biol 2009, 10: 63. 10.1186/1471-2199-10-63 10.1186/1471-2199-10-63
Popovici V, Goldstein DR, Antonov J, Jaggi R, Delorenzi M, Wirapati P: Selecting control genes for RT-QPCR using public microarray data. BMC Bioinformatics 2009, 10: 42. 10.1186/1471-2105-10-42 10.1186/1471-2105-10-42
Stamova BS, Apperson M, Walker WL, Tian Y, Xu H, Adamczy P, Zhan X, Liu DZ, Ander BP, Liao IH, et al.: Identification and validation of suitable endogenous reference genes for gene expression studies in human peripheral blood. BMC Med Genomics 2009, 2: 49. 10.1186/1755-8794-2-49 10.1186/1755-8794-2-49
Walker CG, Meier S, Mitchell MD, Roche JR, Littlejohn M: Evaluation of real-time PCR endogenous control genes for analysis of gene expression in bovine endometrium. BMC Mol Biol 2009, 10: 100. 10.1186/1471-2199-10-100 10.1186/1471-2199-10-100
Ahn K, Huh JW, Park SJ, Kim DS, Ha HS, Kim YJ, Lee JR, Chang KT, Kim HS: Selection of internal reference genes for SYBR green qRT-PCR studies of rhesus monkey (Macaca mulatta) tissues. BMC Mol Biol 2008, 9: 78. 10.1186/1471-2199-9-78 10.1186/1471-2199-9-78
Noriega NC, Eghlidi DH, Garyfallou VT, Kohama SG, Kryger SG, Urbanski HF: Influence of 17beta-estradiol and progesterone on GABAergic gene expression in the arcuate nucleus, amygdala and hippocampus of the rhesus macaque. Brain Res 2010, 1307: 28-42. 10.1016/j.brainres.2009.10.011 10.1016/j.brainres.2009.10.011
Irizarry RA, Hobbs B, Collin F, Beazer-Barclay YD, Antonellis KJ, Scherf U, Speed TP: Exploration, normalization, and summaries of high density oligonucleotide array probe level data. Biostatistics 2003, 4: 249-264. 10.1093/biostatistics/4.2.249 10.1093/biostatistics/4.2.249
Boes T, Neuhauser M: Normalization for Affymetrix GeneChips. Methods Inf Med 2005, 44: 414-417.
Affymetrix: Affymetrix Expression Console™ Software Version 1.0 -- User Guide. 2006.
Eisenberg E, Levanon EY: Human housekeeping genes are compact. Trends Genet 2003, 19: 362-365. 10.1016/S0168-9525(03)00140-9 10.1016/S0168-9525(03)00140-9
Vandesompele J, De Preter K, Pattyn F, Poppe B, Van Roy N, De Paepe A, Speleman F: Accurate normalization of real-time quantitative RT-PCR data by geometric averaging of multiple internal control genes. Genome Biol 2002, 3: research0034.0031-0034.0011. 10.1186/gb-2002-3-7-research0034 10.1186/gb-2002-3-7-research0034
Bolstad BM, Irizarry RA, Astrand M, Speed TP: A comparison of normalization methods for high density oligonucleotide array data based on variance and bias. Bioinformatics 2003, 19: 185-193. 10.1093/bioinformatics/19.2.185 10.1093/bioinformatics/19.2.185
Irizarry RA, Wu Z, Jaffee HA: Comparison of Affymetrix GeneChip expression measures. Bioinformatics 2006, 22: 789-794. 10.1093/bioinformatics/btk046 10.1093/bioinformatics/btk046
Andersen CL, Jensen JL, Orntoft TF: Normalization of real-time quantitative reverse transcription-PCR data: a model-based variance estimation approach to identify genes suited for normalization, applied to bladder and colon cancer data sets. Cancer Res 2004, 64: 5245-5250. 10.1158/0008-5472.CAN-04-0496 10.1158/0008-5472.CAN-04-0496
Rasmussen R: Quantification on the LightCycler instrument. In Rapid Cycle Real-Time PCR: Methods and Applications. Edited by: Meuer S, Wittwer C, Nakgawara K. Heidelberg: Springer-Verlag Press; 2001:21-34.
Hubbell E, Liu WM, Mei R: Robust estimators for expression analysis. Bioinformatics 2002, 18: 1585-1592. 10.1093/bioinformatics/18.12.1585 10.1093/bioinformatics/18.12.1585
Urbanski HF, Noriega NC, Lemos DR, Kohama SG: Gene expression profiling in the rhesus macaque: experimental design considerations. Methods 2009, 49: 26-31. 10.1016/j.ymeth.2009.05.009 10.1016/j.ymeth.2009.05.009
Cui X, Loraine AE: Consistency analysis of redundant probe sets on affymetrix three-prime expression arrays and applications to differential mRNA processing. PLoS ONE 2009, 4: e4229. 10.1371/journal.pone.0004229 10.1371/journal.pone.0004229
D'Mello V, Lee JY, MacDonald CC, Tian B: Alternative mRNA polyadenylation can potentially affect detection of gene expression by affymetrix genechip arrays. Appl Bioinformatics 2006, 5: 249-253. 10.2165/00822942-200605040-00007 10.2165/00822942-200605040-00007
McClintick JN, Edenberg HJ: Effects of filtering by Present call on analysis of microarray experiments. BMC Bioinformatics 2006, 7: 49. 10.1186/1471-2105-7-49 10.1186/1471-2105-7-49
Noriega NC, Kohama SG, Urbanski HF: Gene expression profiling in the rhesus macaque: methodology, annotation and data interpretation. Methods 2009, 49: 42-49. 10.1016/j.ymeth.2009.05.008 10.1016/j.ymeth.2009.05.008
Cui X, Loraine A: Global correlation analysis between redundant probe sets using a large collection of Arabidopsis ath1 expression profiling data. Comput Syst Bioinformatics Conf 2006: 223-226.
Stalteri MA, Harrison AP: Interpretation of multiple probe sets mapping to the same gene in Affymetrix GeneChips. BMC Bioinformatics 2007, 8: 13. 10.1186/1471-2105-8-13 10.1186/1471-2105-8-13
Spindel ER, Pauley MA, Jia Y, Gravett C, Thompson SL, Boyle NF, Ojeda SR, Norgren RB Jr: Leveraging human genomic information to identify nonhuman primate sequences for expression array development. BMC Genomics 2005, 6: 160. 10.1186/1471-2164-6-160 10.1186/1471-2164-6-160
Tay SK, Blythe J, Lipovich L: Global discovery of primate-specific genes in the human genome. Proc Natl Acad Sci USA 2009, 106: 12019-12024. 10.1073/pnas.0904569106 10.1073/pnas.0904569106
Karssen AM, Her S, Li JZ, Patel PD, Meng F, Bunney WE Jr, Jones EG, Watson SJ, Akil H, Myers RM, et al.: Stress-induced changes in primate prefrontal profiles of gene expression. Mol Psychiatry 2007, 12: 1089-1102. 10.1038/sj.mp.4002095 10.1038/sj.mp.4002095
Larionov A, Krause A, Miller W: A standard curve based method for relative real time PCR data processing. BMC Bioinformatics 2005, 6: 62. 10.1186/1471-2105-6-62 10.1186/1471-2105-6-62
Pfaffl MW, Tichopad A, Prgomet C, Neuvians TP: Determination of stable housekeeping genes, differentially regulated target genes and sample integrity: BestKeeper--Excel-based tool using pair-wise correlations. Biotechnol Lett 2004, 26: 509-515. 10.1023/B:BILE.0000019559.84305.47 10.1023/B:BILE.0000019559.84305.47
Noriega NC, Garyfallou VT, Kohama SG, Urbanski HF: Glutamate receptor subunit expression in the rhesus macaque locus coeruleus. Brain Res 2007, 1173: 53-65. 10.1016/j.brainres.2007.08.007 10.1016/j.brainres.2007.08.007
NCBI reference sequence (RefSeq): Definitions: Accession Format[http://www.ncbi.nlm.nih.gov/RefSeq/key.html#accessions]
Array Design for the GeneChip ® Human Genome U133 Set
Technical Note: Design and Performance of the GeneChip ® Human Genome U133 Plus 2.0 and Human Genome U133A 2.0 Arrays
This work was supported by National Institutes of Health grants: AG026472, AG029612, HD029186 and RR000163. Gene microarray assays were performed in the Affymetrix Microarray Core of the Gene Microarray Shared Resource facility at OHSU.
The authors declare that they have no competing interests.
SGK and HFU designed and conducted animal treatment regimes, collected and processed brain tissues. NCN performed real-time RT-PCR, conducted geNorm, NormFinder and BestKeeper analyses and wrote the manuscript. All authors read, corrected and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Noriega, N.C., Kohama, S.G. & Urbanski, H.F. Microarray analysis of relative gene expression stability for selection of internal reference genes in the rhesus macaque brain. BMC Molecular Biol 11, 47 (2010). https://doi.org/10.1186/1471-2199-11-47
- Cycle Study
- Internal Reference Gene
- Human GeneChip
- Medial Basal Hypothalamus
- NormFinder Analysis