 Research
 Open Access
 Published:
Adaptive Fisher method detects dense and sparse signals in association analysis of SNV sets
BMC Medical Genomics volume 13, Article number: 46 (2020)
Abstract
Background
With the development of next generation sequencing (NGS) technology and genotype imputation methods, statistical methods have been proposed to test a set of genomic variants together to detect if any of them is associated with the phenotype or disease. In practice, within the set, there is an unknown proportion of variants truly causal or associated with the disease. There is a demand for statistical methods with high power in both dense and sparse scenarios, where the proportion of causal or associated variants is large or small respectively.
Results
We propose a new association test – weighted Adaptive Fisher (wAF) that can adapt to both dense and sparse scenarios by adding weights to the Adaptive Fisher (AF) method we developed before. Using simulation, we show that wAF enjoys comparable or better power to popular methods such as sequence kernel association tests (SKAT and SKATO) and adaptive SPU (aSPU) test. We apply wAF to a publicly available schizophrenia dataset, and successfully detect thirteen genes. Among them, three genes are supported by existing literature; six are plausible as they either relate to other neurological diseases or have relevant biological functions.
Conclusions
The proposed wAF method is a powerful diseasevariants association test in both dense and sparse scenarios. Both simulation studies and real data analysis indicate the potential of wAF for new biological findings.
Background
Single nucleotide variants (SNVs) are a type of chromosome variants where the DNA sequence of an individual is different from the reference genome on only one nucleotide. Before the era of next generation sequencing (NGS), SNP array technology was used to obtain the genotypes of common SNVs with minor allele frequencies (MAFs) larger than a certain cutoff (e.g. 1% or 5%, a.k.a single nucleotide polymorphisms or SNPs). Over the past decades, genomewide association studies (GWASs) have been successfully conducted to discover many diseaseassociated common SNVs with relatively large MAFs [1, 2]. Despite the success of GWAS, the common SNVs detected through this procedure sometimes account for only a small proportion of the heritability, which is known as the problem of “missing heritability” [3]. This problem promotes the researchers to seek heritability outside of the controversial common diseasecommon variant hypothesis, which is the fundamental of GWAS based on common SNVs, but to seek “missing heritability” in rare SNVs [4]. Rare SNVs (a.k.a rare variants) are SNVs with low MAFs (often <1% or <5%). Compared to common SNVs, the number of rare SNVs is much larger, and their locations on the human genome are often unknown before genotyping all the study samples, which makes DNA hybridizationbased genotyping technology (e.g. SNP array) less useful in genotyping rare SNVs. Thanks to the advent of NGS, researchers now are enabled to reliably measure rare SNVs. Furthermore, because of the development of fast imputation tools [5] and the 1000 Genomes project [6], rare SNVs can be imputed for old GWASs where only common SNVs were measured. This helps recycle and add value to the numerous GWASs that are conducted for many complex human diseases and are available on public domain.
However, the technological advancement in genotyping of rare SNVs also presents several statistical challenges for the association analysis method development. First, because of the small MAFs of the rare variants, the statistical power of traditional association methods are very low when applied to detect the association between rare variants and the disease outcome. Second, because the number of SNVs including both common and rare variants is significantly larger than the number of common variants (often more than 100 times larger), the multiple comparison issue is more severe [7]. Therefore, it would be powerless if association analysis were performed on each single SNV separately. A commonly used solution to these issues was to perform the association analysis on SNV sets, where multiple SNVs were grouped together based on their locations on the genome. SNVs on or close to a gene are often grouped together into one SNV set. However, the traditional statistical testing methods such as the score test or likelihood ratio test used in multivariate generalized linear models (GLMs) are not powerful enough when many variants are included in the SNV set. As shown by Fan [8], the tests based on χ^{2} distribution will have no power when the signal is weak or rare as the degree of freedom increases. To solve this problem, three categories of approaches have been proposed, all of them essentially reduced the degree of freedom in some way to boost the statistical power.
The first category is burden tests, which collapse rare variants into genetic burdens, then test the effects of the genetic burden. CAST [9], CMC [10] and wSum [11] all belong to this category. By combining multiple rare variants into a single measurement of genetic burden, these methods essentially reduce the number of parameters to test down to one, which is equivalent to reducing the degree of freedom of the χ^{2} test statistic to one. Despite the popularity of this type of method, the traditional way of calculating genetic burden often ignores the fact that different variants may have opposite effects on the same outcome. Simply pooling or summing the variants together may cause the opposite effects to cancel out, therefore reduce the statistical power. A solution is to calculate genetic burden adaptively based on evidence provided by the data. For example, Price et al. [12] proposed to adjust MAF threshold for the pooling step based on data. Han and Pan [13] and Hoffmann et al. [14] proposed to adaptively choose the sign and magnitude of the weight in the collapsing step to calculate genetic burdens. TARV [7] can also be viewed as this type of method because it adaptively combines multiple variants into a “super variant” based on the strength of evidence provided by each single variant.
The second category of methods is quadratic tests which often base on testing variance component in mixed effect models. The wellknown SKAT [15] belongs to this category. By assuming the effect of each variant to be random, SKAT tests whether the variance of the random effects is zero. The test statistic can be approximated by a χ^{2} distribution with a degree of freedom much smaller than that in the likelihood ratio test (or Rao’s score test) in fixed effect models. SKAT can also test nonlinear effects by adopting an arbitrary kernel matrix. SKAT was also extended to accommodate multiple candidate kernels [16], to jointly test rare and common variants [17], and to apply on family data [18]. Some other popular methods, such as Calpha [19] and SSU [20] can be viewed as special cases of SKAT.
The third category is functional analysis. Because the genomic variants within the same gene are often highly correlated due to linkage disequilibrium (LD), this category of methods treat them as discrete realizations of a hidden continuous function on the genome. Both the variants and their coefficients can then be decomposed in the functional space. Since the number of functional bases used is generally smaller than the number of variants, this is equivalent to a dimensional reduction method which also reduces the degree of freedom of the association test. Different methods under this category have been proposed utilizing different basis including functional principal component basis [21], Bspline basis [22, 23], and Fourier basis [23].
In addition to these three categories of methods, efforts have also been made to combine multiple testing methods into one single test. For example, the popular SKATO [24] is a combination of variance component test (SKAT) and burden test. Similarly, Derkach et al. [25] proposed to combine variance component test and burden test using Fisher’s method or minimal Pvalue.
It should be noted that the power of aforementioned methods relies on the proportion of variants which truly associate with the disease outcome. Under the alternative hypothesis – when the null hypothesis of no association is not true, all three types of methods assume that every SNV included in the test has some nonzero effect more or less. Specifically, burden tests assume the effects of the variants are proportional to each other, with the proportion predefined by the weights used to calculate the genetic burden; variance component tests assume the random effects of the combined variants share a common variance component, if the component is not zero implies all the random effects are nonzero; and the functional analysis based methods test whether any functional basis (a weighted sum of variants) has a nonzero effect, which in turn implies nonzero effects for all or most of the variants. The type I error of these methods is not affected by violation of this assumption of the alternative hypothesis, which does not undermine their validity. However, under the alternative hypothesis where some effects are nonzero (especially when only a small proportion of variants have nonzero effects), the statistical power of these tests will be suboptimal. Therefore there is a demand for statistical methods that can adapt to the proportion of variants with nonzero effects. For the ease of discussion, we call the scenario where this proportion is large as the dense scenario, and call the scenario where this proportion is small as the sparse scenario. For this purpose, Pan et al. [26] proposed an adaptive test named aSPU which has strong statistical power in both the dense and sparse scenarios. This aSPU can also be viewed as a combination of SKAT (with linear kernel) and other tests including burden test. Barnett and Lin [27] suggested that Higher Criticism (HC) can be another potential powerful test that can adaptively detect both dense and sparse signals. Previously, we proposed Adaptive Fisher (AF) method [28] and illustrated in simulation that AF is a very powerful method to detect the mixture distribution in both dense and sparse scenarios, and it can be much more powerful than HC with finite sample. Therefore, we propose to use AF to detect diseaseassociated SNV sets, and compare to existing methods in the following sections.
Methods
Suppose a trait for n independent subjects Y=(Y_{i1},...,Y_{in})^{T} are observed. G_{i}=(G_{i1},...,G_{iK})^{T} denotes the genotypes of K SNVs in a chromosomal region (e.g. a gene) for subject i, where G_{ik}=0,1,2 represents the number of minor alleles at locus k of subject i. We model the association between the trait and SNVs with the following generalized linear model
where β=(β_{1},...,β_{K})^{T} is the vector of SNV effects. h(·) is taken as the logit link function for binary traits (e.g. diseased or nondiseased) or as the identity link function for continuous traits (e.g. blood pressure, height, etc.). If J covariates C_{i}=(C_{i1},...,C_{iJ})^{T}, i=1,2,...,n are also observed for each subject, denoting their effects by α=(α_{1},...,α_{J})^{T}, the model can be extended as
Determining whether there is an association between the trait and any SNV is equivalent to testing the following hypotheses,
The proposed adaptive fisher tests involve the score statistics U=(U_{1},...,U_{K})^{T}. For model (1),
and its estimated covariance matrix under H_{0} is given by
for binary traits, and
for continuous traits, where \(\bar {Y}=\frac {1}{n} \sum _{i=1}^{n} Y_{i}\), \(\hat {\sigma }_{1}^{2}=\frac {1}{n1} \sum _{i=1}^{n} (Y_{i}\bar {Y})^{2}\) and \(\bar {\boldsymbol {G}}=(\bar {G}_{\cdot 1},..., \bar {G}_{\cdot K})^{T}\) with \(\bar {G}_{\cdot k}=\frac {1}{n} \sum _{i=1}^{n} G_{ik}\). For model (2),
for binary traits,
and for continuous traits,
where \(\hat {\mu }_{Y_{i}}=h^{1}\left (\hat {\beta }_{0}+\sum _{j=1}^{J}\hat {\alpha }_{j} C_{ij}\right)\) with \(\hat {\beta }_{0}\) and \(\hat {\alpha }_{j}, \ j=1,2,...,J\) being the maximum likelihood estimators, \(\hat {\boldsymbol {G}_{i}}=\left (\hat {G}_{i1},...,\hat {G}_{ik}\right)^{T}\) with \(\hat {G}_{ik}\) being the predictive value of G_{ik} from a linear regression model with covariates as predictors. \(\hat {\sigma }_{2}^{2}=\frac {1}{n} \sum _{i=1}^{n} \hat {\mu }_{Y_{i}}(1\hat {\mu }_{Y_{i}})\), \(\hat {\sigma }_{3}^{2}=\frac {1}{n1} \sum _{i=1}^{n} (e_{i}\bar {e})^{2}\) with \(e_{i}=Y_{i}\hat {\mu }_{Y_{i}}, \ i=1,2,...,n\) and \(\bar {e}=\frac {1}{n} \sum _{i=1}^{n} e_{i}\).
Adaptive fisher method
Let the standardized score statistics be \(\tilde {U}_{k}=U_{k}/\sqrt {V_{kk}}\), where V_{kk} is the k^{th} diagonal element of V. If β_{k} is tested marginally, the Pvalue for this marginal score test is \(p_{k}=2\left [1\Phi \left (\tilde {U_{k}}\right)\right ]\), k=1,2,...,K, as \(\tilde {U}_{k}\) is asymptotically N(0,1) distributed under H_{0}. Let
Order R’s in descending order R_{(1)}≥⋯≥R_{(K)}. Let S=(S_{1},...,S_{K})^{T} be the partial sums of R_{(1)},...,R_{(K)},
For each S_{k}, k=1,2,...,K, we calculate its Pvalue by
where s_{k} is be observed value of S_{k}. The AF test is based on the AF statistic below
Weighted adaptive fisher method
SNVs can be weighed differently when taking the partial sums. Suppose w=(w_{1},...,w_{K})^{T} are weights of the K SNVs in a genetic region. Define
Order X_{1},...,X_{K} in descending order X_{(1)}≥⋯≥X_{(K)}. Let \(\boldsymbol {S^{*}}=(S^{*}_{1},...,S^{*}_{K})^{T}\) be the partial sums of X_{(1)},...,X_{(K)},
Similar to (12), the Pvalue of \(s^{*}_{k}\) (observed value of \(s^{*}_{k}\)), \(P_{s^{*}_{k}}= \text {Pr}(S^{*}_{k} \geq s^{*}_{k})\), and the weighted AF (wAF) statistic is defined by
Directed wAF method
We use twosided Pvalues of marginal tests to construct AF and wAF methods in the above sections. However, when all or most of the causal variants have effects of the same direction, combining onesided Pvalues using the same strategy may have higher statistical power. Therefore, we propose a directed version of wAF, noted as wAF _{d}. Let \(p_{k}^{+}=1\Phi (\tilde {U_{k}})\), k=1,2,...,K be the onesided Pvalues of testing whether the variants are risk factors (i.e. testing H_{0}:β_{k}=0 versus H_{1}:β_{k}>0), and \(p_{k}^{}=\Phi (\tilde {U_{k}})\) be the onesided Pvalues of testing whether the variants are protective (i.e. testing H_{0}:β_{k}=0 versus H_{1}:β_{k}<0). We first combine p=(p_{1},...,p_{k}), \(\boldsymbol {p}^{+}=\left (p_{1}^{+},..., p_{k}^{+}\right)\) and \(\boldsymbol {p}^{}=\left (p_{1}^{},..., p_{k}^{}\right)\) following Eqs. 10 and (14)(16) to obtain T_{wAF}, T_{wAF+} and T_{wAF} respectively. Then, we define the minimal of three as the wAF _{d} statistic, which is
Computation
We use the following procedure to access \(P_{s_{k}}\) (\(P_{s^{*}_{k}}\)) in (12) and find the null distributions of T_{AF} in (13) (T_{wAF} in (16)). Here the weighted method for model (1) is used as an example. The unweighted method can be regarded as a special case with all weights being equal.

Calculate the residuals \(e_{i}=Y_{i}\bar {Y}\), i=1,2,...,n.

Permute e_{i}’s for a large number B times to obtain \(\boldsymbol {e}^{(b)}=\left (e^{(b)}_{1},...,e^{(b)}_{n}\right)^{T}\), b=1,2,...,B, where \(\left (e^{(b)}_{1},...,e^{(b)}_{n}\right)^{T}\) is a permutation of e^{(0)}=(e_{1},...,e_{n})^{T}.

For each e^{(b)}, calculate \(\boldsymbol {U}^{(b)}=\left (U^{(b)}_{1},...,U^{(b)}_{K}\right)^{T}=\sum _{i=1}^{n} e^{(b)}_{i} \boldsymbol {G}_{i}\) and \(\boldsymbol {p}^{(b)}=\left (p^{(b)}_{1},...,p^{(b)}_{K}\right)^{T}\) with \(p^{(b)}_{k}=2\left [1\Phi \left (\left U^{(b)}_{k}/\sqrt {V_{kk}}\right \right)\right ]\). Then follow Eqs. 10, (14) and (15) to get \(\boldsymbol {S}^{*(b)}=\left (S^{*(b)}_{1},...,S^{*(b)}_{K}\right)^{T}\), b=0,1,2,..,B.

For a fixed b^{∗}∈{0,1,2,...B},
$$P^{(b^{*})}_{S^{*}_{k}}=\frac{1}{B+1} \sum_{b=0}^{B} \mathbb{I} \left\{S^{*(b)}_{k} \geq S^{*(b^{*})}_{k}\right\}.$$ 
For each S^{∗(b)}, \(T_{\text {wAF}}^{(b)}=\min _{1 \leq k \leq K} P_{S^{*}_{k}}^{(b)}\), b=0,1,2,...,B.

The Pvalue of wAF test can be approximated by
$${}\widehat{\text{Pr}}\left\{\left. T_{\text{wAF}} \leq T_{\text{wAF}}^{(0)}\rightH_{0}\right\}=\frac{1}{B+1} \sum_{b=1}^{B} \mathbb{I}\left\{ T_{\text{wAF}}^{(b)} \leq T_{\text{wAF}}^{(0)}\right\},$$where \(T_{\text {wAF}}^{(0)}=\min _{1 \leq k \leq K} P_{S^{*}_{k}}^{(0)}\) is the observed value of the wAF statistic and \(\mathbb {I}(\cdot)\) is the indicator function.
Note that the Pvalue of \(T_{\text {wAF\(_{\mathrm {d}}\)}}\) can be assessed using a similar permutation procedure.
Results
In this section, we evaluate our wAF and wAF _{d} methods by both simulation studies and realdata application. In simulation studies, we compare our methods with SKAT, SKATO, aSPU and MinP (which takes the minimal Pvalue of all the combined variants as the test statistic). In realdata application, we use the GenomeWide Association Study of Schizophrenia (SCZ) data provided by Genetic Association Information Network (GAIN), which is publicly available in the database of Genotypes and Phenotypes (dbGaP).
Simulation studies
Simulation studies are conducted under both dense and sparse scenarios to compare various methods. Genotypes G_{i}=(G_{i1},...,G_{iK})^{T}, i=1,2,...,n are simulated in a similar manner to the framework of Pan et al. [26], by the following steps.

Generate \(\phantom {\dot {i}\!}\boldsymbol {Z_{1}}=(Z_{11},...,Z_{1K})^{T}\) and Z_{2}=(Z_{21},...,Z_{2K})^{T} independently from a multivariate normal distribution N(0,A). A has a firstorder autoregressive (AR(1)) covariance structure with the (k,k^{′})^{th} element \(A_{kk'}=c^{kk'}\phantom {\dot {i}\!}\). c is chosen to be 0.9 to give close loci a higher correlation and distant loci a lower correlation.

Randomly sample MAFs by first generating log(MAF)’s from U(log(0.001), log(0.5)) and then exponentiating them back to MAFs.^{Footnote 1} Set \(G_{ik}=\mathbb {I}(\Phi (Z_{1k}) \leq \text {MAF}_{k})+\mathbb {I}(\Phi (Z_{2k}) \leq \text {MAF}_{k})\), k=1,...,K.

Repeat step 1 and 2 n times to generate genotypes for all subjects.
We randomly sample πK genotype effects among β=(β_{1},...,β_{K})^{T} to be nonzero, whose values are sampled from a uniform distribution within [−δ,δ], while keep the other (1−π)K effects zeros. Trait of n=1,000 subjects are generated from model (1).
The weights of wAF and wAF _{d} tests are chosen to be \(w_{k}=\sqrt {\text {MAF}_{k}(1\text {MAF}_{k})}\), k=1,2,..,K. The weights of SKAT and SKATO are chosen to be flat with w_{k}=1, k=1,2,...,K, so that SKAT is equivalent to SSU [15]. The significance level is set to be 0.05 for every test. All simulation results are based on 5,000 replicates.
Binary traits
When generating binary trait, h(·) is taken to be the logit link function. We increase the number of SNVs, K, from 50 to 500 with an increment 50, while holding the effect proportion π and the effect size δ constant. For the dense scenario, π=20% and δ=0.2. For the sparse scenario, π=2% and δ=1. Figure 1 shows that wAF test results in large powers for both dense and sparse scenarios. Specifically, in the dense scenario, wAF and SKAT have the highest power. SKATO and aSPU are slightly less powerful than SKAT and wAF. wAF _{d} follows behind with almost the same for small K and slightly inferior performance for large K. MinP, on the other hand, is much less powerful than the other methods. For the sparse scenario, MinP is the most powerful method. Our wAF has the second highest power, which is about 5% higher than the other methods including SKAT, SKATO and aSPU. wAF _{d} has the third best performance, following tightly after wAF. For all these compared methods, the type I errors are wellcontrolled empirically as shown in the Additional file 1: Table S1.
Continuous traits
When generating continuous trait, h(·) is taken to be the identity link function and random errors are standard normal random variables. Again, K is increased from 50 to 500 with an increment 50, while π and δ are held constants. For the dense scenario, π=20% and δ=0.1. For the sparse scenario, π=2% and δ=0.5. Based on power curves in Fig. 2, wAF test performs relatively well for both dense and sparse scenarios, similar to what we have seen in the binary traits. In dense scenario, wAF and SKAT enjoy the highest power, which is slightly better than aSPU, SKATO and wAF _{d}, and much better than MinP. Whereas in the sparse scenario, MinP is the most powerful method, seconded by wAF. wAF _{d} has slightly less power than wAF, but has higher power than aSPU, SKAT and SKATO. Similar to the binary traits, all type I errors are wellcontrolled empirically.
We also consider two other cases where 1) all SNV effects are of the same direction; 2) all variants are rare variants (RVs). In the first case, nonzero β_{k}’s are sampled from U[0,δ] distribution. The result shows that wAF _{d} has large powers in both dense and sparse scenarios. wAF has almost the same high power with wAF _{d} in the sparse scenario. In the second case, MAF’s are generated from U(0.001,0.01). wAF and wAF _{d} work well especially in the sparse scenario. Power curves for these two cases are shown in Additional file 1: Figure S1–3.
Real data application
To further evaluate the performance of our methods, we apply wAF and wAF _{d} on EuropeanAmerican subjects from GAIN SCZ data. 2,548 subjects are selected after quality control, including 1,170 cases and 1,378 controls. Genotypes are imputed using Michigan Imputation Server [5] to UCSC Human Genome build hg19. We focus our analysis on variants that are within genes and their flanking regions (5,000 bp upstream and downstream). The analysis is performed on 13,993,898 variants located on 18,296 autosomal genes.
We apply wAF and wAF _{d} methods based on model (1) for each gene, with disease status as the outcome and genotypes of SNVs in this gene as predictors. Pvalues are estimated using a similar stepup procedure as in Pan et al. [26] such that the data analysis can be more computationally efficient. We firstly scan all genes with B=100 permutations. For each gene, if the estimated Pvalue is smaller than 5/B, we continue with B=1,000; otherwise, we stop the procedure for this gene and record the estimated Pvalue. Each round B is increased to 10 times of its current value for those significant genes until no gene has a Pvalue smaller than 5/B.
Table 1 lists the ten most significant genes detected by either wAF or wAF _{d}. FAM69A has the smallest Pvalue by both methods. Two transcriptome studies ([31, 32]) report FAM69A as a differentially expressed gene by affection status of SCZ. Wang et al. [33] identifies two SNPs (rs11164835 and rs12745968) within this gene that are associated with both SCZ and bipolar disorder (BD) by a genomewide metaanalysis. Another gene in our list, HPGDS, is also mentioned as related to both diseases [34]. Besides, GTF2A1 is found associated with BD by Fries et al. [35]. Increasing evidence of SCZ and BD being closely related ([36], [37]) suggests GTF2A1 might be a candidate associated gene with SCZ.
Gene RPL5 is the third significant by wAF and the second significant by wAF _{d}. RPL5 is identified by International Multiple Sclerosis Genetics Consortium (IMSGC) [38] and Rubio et al. [39] as a risk allele for multiple sclerosis (MS), an autoimmune disease which often causes neurological disability. Considering the genetic pleiotropy between SCZ and MS [40], RPL5 is a plausible gene that associates with SCZ. Furthermore, 21 SNPs are identified as positively associated with MS by IMSGC at the GFIEVI5RPL5FAM69A locus. Associations between this region and MS are further replicated in independent studies among different populations [41, 42]. This may shed light on understanding the similarities and differences among SCZ, BD and MS.
For the other genes that we detect, Hek et al. [43] reports that SNP rs161645 near NUDT12 is associated with depressive symptoms; NRN1L expresses predominantly in the nervous system [44] and may play a role in psychiatric diseases [45]; and STRA13 may have an effect on SCZ by influencing gene CHRNA7 [46].
Among the thirteen genes listed in Table 1, FAM69A, HPGDS and STRA13 are previously found associated with SCZ by other researches; five genes (NUDT12, RPL5, GTF2A1, NRN1L and SLC35A5) are reported to be related to neurological diseases other than SCZ; NRN1L and CERCAM are plausible in terms of gene function.
We also compare wAF and wAF _{d} with aSPU, SKAT and SKATO on these genes. It is noticeable that the five methods perform differently on gene CERCAM. wAF, wAF _{d} and aSPU attain Pvalues that reach 1×10^{−4} while SKAT and SKATO can only reach 1×10^{−1}. After calculating the marginal Pvalues for each of the 228 variants on CERCAM, we find that only 1 variant has a Pvalue smaller than 1×10^{−4} while the other Pvalues are all larger than 0.01 (details can be found in Additional file 1: Figure S4). This again shows that wAF, wAF _{d} and aSPU are superior than SKAT and SKATO in the sparse scenario, which is consistent with results from our simulation studies.
In summary, most of the genes we detect are supported by existing literature. This demonstrates the potential of reallife impact of our wAF methods, especially considering that we only used 2,548 subjects and the fact that SCZ GWAS is known to be limited by the sample size, yielding results that are not significant until the sample size reached tens of thousands [47].
Discussion
Based on the simulation and real data analysis results, we found wAF has high power in both dense and sparse scenarios. This is because we adaptively combine the marginal tests based on the strength of evidence. By sorting the marginal Pvalues in ascending order, we only combine the most relevant SNVs into the test. The selection of partial sums allows wAF to have its adaptiveness, as the number of variants combined into the test depends on the unknown proportion of variants that are truly causal or associated. Variants with less or no evidence will not contribute to the final test, which in turn will reduce noise in the test statistic. Therefore, wAF enjoys the comparable or better power in both scenarios.
As stated in the “Background” section, HC is another method that can be used to combine marginal tests of each variant. Although we did not explore the application of HC in SNV set analysis, Barnett et al. [48] proposed a generalized higher criticism (GHC) based on HC. They found that GHC was only powerful in sparse scenario but underperformed in dense scenario, and suggested that one may consider combining GHC and SKAT to boost power when we do not know which scenario the causal gene actually belongs to, which we believe is true for every reallife problem. This conclusion agrees with our previous findings about HC [28].
While comparing wAF and aSPU, we found that their test statistics can be written in the same general format. For both methods, we can think the test statistic as adaptively chosen from a set of weighted sums with different weights. The weighted sums in both methods can be written as \(\sum _{k} v_{c}(\tilde {U}_{k}, G_{k})w(G_{k})f(\tilde {U}_{k})\), where \(v_{c}(\tilde {U}_{k}, G_{k})\) is the cth adaptive weight function depends on the standardized score statistic and the genotype data for variant k, w(G_{k}) is a nonadaptive weight only depends on the genotype data, and \(f(\tilde {U}_{k})\) is a transformation of the standardized score statistic. We can show that for aSPU, \(f(\tilde {U}_{k})=\tilde {U}_{k}\), w(G_{k})=sd(G_{k}), and \(v_{c}(\tilde {U}_{k}, G_{k})=[w(G_{k})f(\tilde {U}_{k})]^{(c1)}\) for c∈{1,2,…,8,∞}; for wAF, \(f(\tilde {U}_{k})=2[1\Phi (\tilde {U}_{k})]\), \(w(G_{k})=\sqrt {\text {MAF}_{k}(1\text {MAF}_{k})}\approx \text {sd}(G_{k})/\sqrt {2}\), and \(v_{c}(\tilde {U}_{k}, G_{k})=\mathbb {I}\{w(G_{k})f(\tilde {U}_{k})\ge [w(G)f(\tilde {U})]_{(c)}\}\) for c∈{1,2,…,K}, where \(\mathbb {I}\{\cdot \}\) is an indicator function and [·]_{(c)} denotes the cth largest order statistics of the quantity inside the bracket. By comparison, we can see that the major difference between aSPU and wAF is how we adaptively weigh the test statistic: aSPU creates the weight by raising the statistics to different powers, whereas wAF sequentially put a 0/1 weight based on the magnitude of the test statistics. This comparison also reveals that although not explicitly mentioned, aSPU also weighs different variants based on their MAFs using almost the same weight as we used in wAF.
Because permutation is needed for wAF, computational burden is a major weakness. To improve computation speed, we adopt the same strategy as Pan et al. [26] to run a hundred permutation first, then choose to increase the number of permutation only for those with small Pvalues. Theoretically, because sorting and order statistics are used in wAF, the computation complexity is higher than aSPU. Specifically, because wAF need sorting and cumulative summation, our complexity is higher than aSPU by an order of logK. In practice, because K is often fixed, the theoretical difference in computational complexity can be ignored.
Conclusions
Association analysis of SNV sets becomes the standard analysis approach in GWAS when rare variants are genotyped or imputed in the dataset. However, when many SNVs are combined together into one omnibus test, the power of the statistical test often depends on the proportion of variants with nonzero effects and how these variants are combined. Most current methods (except aSPU) are not adaptive to this proportion and only applies to either the dense or sparse scenario. In this paper, we proposed a new adaptive method wAF as an alternative to aSPU with better or comparable power. The adaptiveness of wAF allows it to perform better than current available methods in both dense and sparse scenarios, and to detect potential new genes associated with diseases.
Availability of data and materials
Datasets used in this paper are publicly available. R package for wAF method can be downloaded at https://github.com/songbiostat/wAF.
Notes
Because of the logarithm, this MAF sampling algorithm often samples small MAFs and therefore yields more rare variants.
Abbreviations
 AF:

Adaptive fisher
 AR:

Autoregressive
 aSPU:

Adaptive sum of powered score
 BD:

Bipolar disorder
 CAST:

Cohort allelic sums test
 CMC:

Combined multivariate and collapsing
 dbGaP:

Database of genotypes and phenotypes
 GAIN:

Genetic association information network
 GHC:

Generalized higher criticism
 GLM:

Generalized linear model
 GWAS:

Genomewide association study
 HC:

Higher criticism
 IMSGC:

International multiple sclerosis genetics consortium
 MAF:

Minor allele frequency
 MS:

Multiple sclerosis
 NGS:

Next generation sequencing
 RV:

Rare variant
 SCZ:

Schizophrenia
 SKAT:

Sequence kernel association test
 SNP:

Single nucleotide polymorphism
 SNV:

Single nucleotide variant
 SPU:

Sum of powered score
 SSU:

Sum of squared score
 TARV:

Treebased analysis of rare variants
 UCSC:

University of California, Santa Cruz
 wAF:

Weighted adaptive fisher
References
Welter D, MacArthur J, Morales J, Burdett T, Hall P, Junkins H, Klemm A, Flicek P, Manolio T, Hindorff L, et al.The nhgri gwas catalog, a curated resource of snptrait associations. Nucleic Acids Res. 2013; 42(D1):1001–6.
MacArthur J, Bowler E, Cerezo M, Gil L, Hall P, Hastings E, Junkins H, McMahon A, Milano A, Morales J, et al.The new nhgriebi catalog of published genomewide association studies (gwas catalog). Nucleic Acids Res. 2016; 45(D1):896–901.
Manolio TA, Collins FS, Cox NJ, Goldstein DB, Hindorff LA, Hunter DJ, McCarthy MI, Ramos EM, Cardon LR, Chakravarti A, et al.Finding the missing heritability of complex diseases. Nature. 2009; 461(7265):747.
Schork NJ, Murray SS, Frazer KA, Topol EJ. Common vs. rare allele hypotheses for complex diseases. Curr Opin Genet Dev. 2009; 19(3):212–9.
Das S, Forer L, Schönherr S, Sidore C, Locke AE, Kwong A, Vrieze SI, Chew EY, Levy S, McGue M, et al.Nextgeneration genotype imputation service and methods. Nat Genet. 2016; 48(10):1284.
1000 Genomes Project Consortium et al.A global reference for human genetic variation. Nature. 2015; 526(7571):68.
Song C, Zhang H. Tarv: Treebased analysis of rare variants identifying risk modifying variants in ctnna2 and cntnap2 for alcohol addiction. Genet Epidemiol. 2014; 38(6):552–9.
Fan J. Test of significance based on wavelet thresholding and neyman’s truncation. J Am Stat Assoc. 1996; 91(434):674–88.
Morgenthaler S, Thilly WG. A strategy to discover genes that carry multiallelic or monoallelic risk for common diseases: a cohort allelic sums test (cast). Mutat Res Fundam Mol Mech Mutagen. 2007; 615(1):28–56.
Li B, Leal SM. Methods for detecting associations with rare variants for common diseases: application to analysis of sequence data. Am J Hum Genet. 2008; 83(3):311–21.
Madsen BE, Browning SR. A groupwise association test for rare mutations using a weighted sum statistic. PLoS Genet. 2009; 5(2):1000384.
Price AL, Kryukov GV, de Bakker PI, Purcell SM, Staples J, Wei LJ, Sunyaev SR. Pooled association tests for rare variants in exonresequencing studies. Am J Hum Genet. 2010; 86(6):832–8.
Han F, Pan W. A dataadaptive sum test for disease association with multiple common or rare variants. Hum Hered. 2010; 70(1):42–54.
Hoffmann TJ, Marini NJ, Witte JS. Comprehensive approach to analyzing rare genetic variants. PloS ONE. 2010; 5(11):13584.
Wu MC, Lee S, Cai T, Li Y, Boehnke M, Lin X. Rarevariant association testing for sequencing data with the sequence kernel association test. Am J Hum Genet. 2011; 89(1):82–93.
Wu MC, Maity A, Lee S, Simmons EM, Harmon QE, Lin X, Engel SM, Molldrem JJ, Armistead PM. Kernel machine snpset testing under multiple candidate kernels. Genet Epidemiol. 2013; 37(3):267–75.
IonitaLaza I, Lee S, Makarov V, Buxbaum JD, Lin X. Sequence kernel association tests for the combined effect of rare and common variants. Am J Hum Genet. 2013; 92(6):841–53.
Chen H, Meigs JB, Dupuis J. Sequence kernel association test for quantitative traits in family samples. Genet Epidemiol. 2013; 37(2):196–204.
Neale BM, Rivas MA, Voight BF, Altshuler D, Devlin B, OrhoMelander M, Kathiresan S, Purcell SM, Roeder K, Daly MJ. Testing for an unusual distribution of rare variants. PLoS Genet. 2011; 7(3):1001322.
Pan W. Asymptotic tests of association with multiple snps in linkage disequilibrium. Genet Epidemiol. 2009; 33(6):497–507.
Luo L, Boerwinkle E, Xiong M. Association studies for nextgeneration sequencing. Genome Res. 2011; 21(7):1099–108.
Luo L, Zhu Y, Xiong M. Quantitative trait locus analysis for nextgeneration sequencing with the functional linear models. J Med Genet. 2012; 49(8):513–24.
Fan R, Wang Y, Mills JL, Wilson AF, BaileyWilson JE, Xiong M. Functional linear models for association analysis of quantitative traits. Genet Epidemiol. 2013; 37(7):726–42.
Lee S, Emond MJ, Bamshad MJ, Barnes KC, Rieder MJ, Nickerson DA, Christiani DC, Wurfel MM, Lin X, Project NGES, et al.Optimal unified approach for rarevariant association testing with application to smallsample casecontrol wholeexome sequencing studies. Am J Hum Genet. 2012; 91(2):224–37.
Derkach A, Lawless JF, Sun L. Robust and powerful tests for rare variants using fisher’s method to combine evidence of association from two or more complementary tests. Genet Epidemiol. 2013; 37(1):110–21.
Pan W, Kim J, Zhang Y, Shen X, Wei P. A powerful and adaptive association test for rare variants. Genetics. 2014; 197(4):1081–95.
Barnett IJ, Lin X. Analytical pvalue calculation for the higher criticism test in finited problems. Biometrika. 2014; 101(4):964–70.
Song C, Min X, Zhang H. The screening and ranking algorithm for changepoints detection in multiple samples. Ann Appl Stat. 2016; 10(4):2102–29.
Fung HC, Scholz S, Matarin M, SimónSánchez J, Hernandez D, Britton A, Gibbs JR, Langefeld C, Stiegert ML, Schymick J, et al.Genomewide genotyping in parkinson’s disease and neurologically normal controls: first stage analysis and public release of data. Lancet Neurol. 2006; 5(11):911–6.
Quintela I, GomezGuerrero L, FernandezPrieto M, Resches M, Barros F, Carracedo A. Female patient with autistic disorder, intellectual disability, and comorbid anxiety disorder: Expanding the phenotype associated with the recurrent 3q13. 2–q13. 31 microdeletion. Am J Med Genet Part A. 2015; 167(12):3121–9.
Sanders AR, Göring HH, Duan J, Drigalenko EI, Moy W, Freda J, He D, Shi J, Gejman PV. Transcriptome study of differential expression in schizophrenia. Hum Mol Genet. 2013; 22(24):5001–14.
Sanders A, Drigalenko E, Duan J, Moy W, Freda J, Göring H, Gejman P. Transcriptome sequencing study implicates immunerelated genes differentially expressed in schizophrenia: new data and a metaanalysis. Transl Psychiatry. 2017; 7(4):1093.
Wang KS, Liu XF, Aragam N. A genomewide metaanalysis identifies novel loci associated with schizophrenia and bipolar disorder. Schizophr Res. 2010; 124(13):192–9.
De Baumont A, Maschietto M, Lima L, Carraro DM, Olivieri EH, Fiorini A, Barreta LAN, Palha JA, BelmontedeAbreu P, Moreira Filho CA, et al.Innate immune response is differentially dysregulated between bipolar disease and schizophrenia. Schizophr Res. 2015; 161(23):215–21.
Fries G, Quevedo J, Zeni C, Kazimi I, ZuntaSoares G, Spiker D, Bowden C, WalssBass C, Soares J. Integrated transcriptome and methylome analysis in youth at high risk for bipolar disorder: a preliminary analysis. Transl Psychiatry. 2017; 7(3):1059.
International Schizophrenia Consortium. Common polygenic variation contributes to risk of schizophrenia and bipolar disorder. Nature. 2009; 460(7256):748.
Lichtenstein P, Yip BH, Björk C, Pawitan Y, Cannon TD, Sullivan PF, Hultman CM. Common genetic determinants of schizophrenia and bipolar disorder in swedish families: a populationbased study. Lancet. 2009; 373(9659):234–9.
International Multiple Sclerosis Genetics Consortium (IMSGC). Risk alleles for multiple sclerosis identified by a genomewide study. N Engl J Med. 2007; 357(9):851–62.
Rubio JP, Stankovich J, Field J, Tubridy N, Marriott M, Chapman C, Bahlo M, Perera D, Johnson L, Tait B, et al.Replication of kiaa0350, il2ra, rpl5 and cd58 as multiple sclerosis susceptibility genes in australians. Genes Immun. 2008; 9(7):624.
Andreassen OA, Harbo HF, Wang Y, Thompson W, Schork A, Mattingsdal M, Zuber V, Bettella F, Ripke S, Kelsoe J, et al.Genetic pleiotropy between multiple sclerosis and schizophrenia but not bipolar disorder: differential involvement of immunerelated gene loci. Mol Psychiatry. 2015; 20(2):207.
Alcina A, Fernández Ó, Gonzalez JR, CataláRabasa A, Fedetz M, Ndagire D, Leyva L, Guerrero M, Arnal C, Delgado C, et al.Tagsnp analysis of the gfi1evi5rpl5fam69 risk locus for multiple sclerosis. Eur J Hum Genet. 2010; 18(7):827.
Schmied MC, Zehetmayer S, Reindl M, Ehling R, BajerKornek B, Leutmezer F, Zebenholzer K, Hotzy C, Lichtner P, Meitinger T, et al.Replication study of multiple sclerosis (ms) susceptibility alleles and correlation of dnavariants with disease features in a cohort of austrian ms patients. Neurogenetics. 2012; 13(2):181–7.
Hek K, Demirkan A, Lahti J, Terracciano A, Teumer A, Cornelis MC, Amin N, Bakshis E, Baumert J, Ding J, et al.A genomewide association study of depressive symptoms. Biol Psychiatry. 2013; 73(7):667–78.
Fujino T, Wu Z, Lin WC, Phillips MA, Nedivi E. cpg15 and cpg152 constitute a family of activityregulated ligands expressed differentially in the nervous system to promote neurite growth and neuronal survival. J Comp Neurol. 2008; 507(5):1831–45.
Yao Jj, Zhao Qr, Lu Jm, Mei Ya. Functions and the related signaling pathways of the neurotrophic factor neuritin. Acta Pharmacol Sin. 2018. https://doi.org/10.1038/aps.2017.197.
FinlaySchultz J, Canastar A, Short M, El Gazzar M, Coughlan C, Leonard S. Transcriptional repression of the α7 nicotinic acetylcholine receptor subunit gene (chrna7) by activating protein2 α (ap2 α). J Biol Chem. 2011; 286(49):42123–32.
Ripke S, Neale BM, Corvin A, Walters JT, Farh KH, Holmans PA, Lee P, BulikSullivan B, Collier DA, Huang H, et al.Biological insights from 108 schizophreniaassociated genetic loci. Nature. 2014; 511(7510):421.
Barnett I, Mukherjee R, Lin X. The generalized higher criticism for testing snpset effects in genetic association studies. J Am Stat Assoc. 2017; 112(517):64–76.
Ohio Supercomputer Center. Ohio Supercomputer Center. 1987. http://osc.edu/ark:/19495/f5s1ph73. Accessed 1 Aug 2019.
Funding
CS was supported in part by National Center for Advancing Translational Sciences (NCATS) grant UL1 TR002733. Publication costs are funded by CS’s startup grant provided by the Ohio State University. Funding support for the GenomeWide Association of Schizophrenia Study was provided by the National Institute of Mental Health (R01 MH67257, R01 MH59588, R01 MH59571, R01 MH59565, R01 MH59587, R01 MH60870, R01 MH59566, R01 MH59586, R01 MH61675, R01 MH60879, R01 MH81800, U01 MH46276, U01 MH46289 U01 MH46318, U01 MH79469, and U01 MH79470) and the genotyping of samples was provided through the Genetic Association Information Network (GAIN). The Genetic Analysis Workshops are supported by National Institutes of Health (NIH) grant R01 GM031575. Preparation of the Genetic Analysis Workshop 17 Simulated Exome Data Set was supported in part by NIH R01 MH059490 and used sequencing data from the 1000 Genomes Project (http://www.1000genomes.org).
Author information
Authors and Affiliations
Contributions
CS proposed the idea of wAF method. LC and CS supervised the overall direction and planning of the project. XC carried out simulation and real data studies. JP contributed to schizophrenia data imputation. All authors have read and approved the manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Additional file 1
Additional results for simulation studies and schizophrenia data application. Results for GAW 17 data application.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Cai, X., Chang, LB., Potter, J. et al. Adaptive Fisher method detects dense and sparse signals in association analysis of SNV sets. BMC Med Genomics 13 (Suppl 5), 46 (2020). https://doi.org/10.1186/s1292002006843
Published:
DOI: https://doi.org/10.1186/s1292002006843
Keywords
 Genomewide association study
 Adaptive fisher
 Rare variants
 Common variants
 Dense signal
 Sparse signal
 Combine pvalues