 Research
 Open Access
 Published:
Exact association test for small size sequencing data
BMC Medical Genomics volume 11, Article number: 30 (2018)
Abstract
Background
Recent statistical methods for next generation sequencing (NGS) data have been successfully applied to identifying rare genetic variants associated with certain diseases. However, most commonly used methods (e.g., burden tests and variancecomponent tests) rely on large sample sizes. Notwithstanding, due to itsstill high cost, NGS data is generally restricted to small sample sizes, that cannot be analyzed by most existing methods.
Methods
In this work, we propose a new exact association test for sequencing data that does not require a large sample approximation, which is applicable to both common and rare variants. Our method, based on the Generalized CochranMantelHaenszel (GCMH) statistic, was applied to NGS datasets from intraductal papillary mucinous neoplasm (IPMN) patients. IPMN is a unique pancreatic cancer subtype that can turn into an invasive and hardtotreat metastatic disease.
Results
Application of our method to IPMN data successfully identified susceptible genes associated with progression of IPMN to pancreatic cancer.
Conclusions
Our method is expected to identify diseaseassociated genetic variants more successfully, and corresponding signal pathways, improving our understanding of specific disease’s etiology and prognosis.
Background
Many genetic studies, such as genomewide association studies (GWAS), have successfully identified genetic variants associated with complex human traits and diseases [1]. However, GWAS focus mainly on common variants with minor allele frequencies (MAF) greater than 0.05. Thus, loci with MAF < 0.05 are omitted, even though such “rare variants” may substantially contribute to disease heritability [2, 3]. The recent application of next generation sequencing (NGS) technology has put largescale investigation of rare variants within reach [4]. Thus, from large sample sizes, researchers can uncover novel rare genetic variants (i.e., those having MAFs between 0.01 and 0.05) that have important associations with complex diseases [3].
To date, various statistical methods and strategies have been developed to test disease associations of rare genetic variants. Burden tests, which were earlier tests for rare variants, aggregate information from all rare variants, in a specific genomic region, into a single summary variable [5, 6]. Different types of burden tests have been proposed, using various genetic scores assigned to the rare variants. For example, the cohort allelic sum test (CAST) collapses genotypes across all variants, such that an individual is coded as 1, if a rare allele is present at any of the variant sites; otherwise, it is coded as 0 [6]. However, this approach may not fully reflect the effect emerging from the complex ensemble of multiple rare variants, because it only uses the information from the presence of rare variants within a specific genomic region.
The combined multivariate and collapsing (CMC) method divides rare variants into multiple classes, based on their MAFs, by collapsing each group, using CAST, and then applying multivariate tests such as Hotelling’s Ttest [5]. However, these burden tests are powerful only if most rare variants are causal, and have effects in the same direction (i.e., increase or decrease the phenotype). In other words, the existence of variants whose effects are in different directions can reduce power substantially. To overcome this limitation, several variancecomponent (VC) tests, based on regression models, have been proposed. The Sequence Kernel Association Test (SKAT), a widely used scorebased VC test, has been shown to successfully detect multiple directional contributions from different classes of single nucleotide polymorphisms (SNPs) [7].
Both burden and VC tests for rare variants are based on asymptotic tests, assuming that the sample size is large enough. Due to the stillhigh cost of NGS, however, sequencing data is often available only from small sample sizes. These existing methods are not appropriate to handle NGS data from small sample sizes. Instead, the SKAT method needs to be modified by renormalizing moments of test statistics [8].
In this study, we propose a new approach that does not rely on the asymptotic distribution for the NGS data with small samples. We call this new method the Exact Association Test (EXAT). EXAT is conceptually based upon the Fisher’s exact test, which is commonly used for testing for independence, using 2 × 2 contingency tables, with small samples. A key underlying assumption of Fisher’s exact test is that the four marginal sums are fixed. Under this assumption, the first cell frequency follows a hypergeometric distribution, under the null hypothesis of independence. To that end, the CochranMantelHaenszel (CMH) statistic was developed to extend Fisher’s exact test beyond stratified 2 × 2 contingency tables, for testing the conditional independence between two categorical variables, that are in turn, conditioned by a third categorical variable [9, 10]. The generalized CochranMantelHaenszel (GCMH) statistic is an extension of CMH for stratified J × K contingency tables [9].
For a specific gene, NGS data can be represented by a sequence of contingency tables. The strata variable corresponds to the subject, the row variable does to the single nucleotide variant (SNV), and the column depicts the genotypes which represent the number of minor alleles (0, 1, or 2). For example, suppose that a gene contains t SNVs. Then, the NGS data from n individuals can be summarized into n × t × 3 contingency table, upon which the GCMH statistic can be applied. Note that this GCMH statistic is used for testing independence between SNVs and the number of minor alleles. That is, it tests whether t SNVs have similar distributions, in terms of MAFs. However, this GCMH does not provide any information about the gene’s association with disease status, e.g., case and control. Thus, we propose deriving the GCMH statistic separately from the case and control groups, and using the difference or ratio as a test statistic. If these two GCMH statistics differ greatly between case and control groups, then the gene should be strongly associated with disease status.
In the Methods section, we provide a detailed description of the EXAT statistic, and summarize how to compute pvalues for significance testing. We then apply our EXAT to the analysis of targeted sequencing data from intraductal papillary mucinous neoplasms (IPMNs, a type of pancreatic ductal tumor)(PMID: 27865286). IPMN is a unique pancreatic neoplasm that can become an invasive, metastatic, and hardtotreat pancreatic cancer [11]. Through this application, we demonstrate that our proposed EXAT method can successfully identify susceptible genes associated with the progression of IPMN to pancreatic cancer.
Methods
Materials
All human subject studies were approved by the Institutional Review Board of Seoul National University Hospital. Surgical paraffinembedded IPMN samples, from 44 subjects, were obtained from Seoul National University Hospital. These subjects consisted of 21 cases of high grade (just before developing pancreatic cancer) and 23 controls of low grade (benign tumor). From both tumor groups, DNA was extracted and subjected to targeted sequencing, using the Illumina NextSeq500 platform.
The demographic and clinical characteristics of the 44 subjects are shown in Table 1. Categorical variables were compared using the χ^{2} test or Fisher’s exact test between case and control groups. Continuous variables were compared using Student’s t test or Wilcoxon’s rank sum test. Except Mural Nodule and Invasiveness, there were no significant differences between case and control groups. Mural Nodule is known as a potential predictor of malignant neoplasm [12], and Invasiveness presents an invasive status.
From each patient, we obtained targeted sequencing data for 411 genes, known to be related to cancer in general, but not necessarily pancreatic cancer. The total number of SNVs was 8325, and the number of SNVs in a gene ranged from 1 to 188, with a median of 15.
Methods
Data structure
First, we constructed a stratified categorical data as follows. For a given gene with t SNVs, we defined a t × 3 contingency table for each subject, where the rows and columns represent the SNVs for a specific gene, and the number of minor alleles, respectively. More precisely, for subject i, and a specific gene with t SNVs, the corresponding t × 3 contingency table was constructed, as shown in Table 2. Note that the cell count, n_{ijk},has a value of 1, if the subject i has a minor allele count k, at SNV j, for i = 1, ⋯, n, j = 1, ⋯, t, k = 0, 1, 2.
For example, consider the gene ATF1, which contains seven SNVs in our IPMN dataset. Figure 1a shows the number of minor alleles for three subjects, A, B, and C. From these data, three 7 × 3 contingency tables could be constructed, as shown in Fig. 1b.
Generalized CMH statistic
Next, we recall the generalized CMH statistic to test the existence of partial association within the strata of the contingency table [10]. Here, we present it in a simpler form, specialized into types of contingency tables, as described in the previous subsection.
Let n_{i} = (n_{i10}, n_{i11}, ⋯, n_{it2})^{′} denote the (3t) × 1 vector of observed frequencies, let n_{ij.} = (n_{i1.}, n_{i2.}, ⋯, n_{it.})^{′} denote the vector of the row marginal total number, and let n_{i.k} = (n_{i. 0}, n_{i. 1}, n_{i. 2})^{′} denote the vector of the column marginal totals, and let n_{i. .} denote the overall marginal total. Then, let H_{0} be the null hypothesis of no partial association, i.e., SNVs being independent of the number of minor alleles for a specific targeted gene. Note that all row marginal totals {n_{ij.}} are 1, and n_{i. .} has the value t (i.e., the number of SNVs for each subject i). Hence, under H_{0}, n_{i} (Table 2) follows the product’s multiple hypergeometric distribution, when the marginal totals are fixed, as in Fisher’s exact test.
For the ith contingency table, define a t × 1 matrix P_{i ∗ ·}^{′} = (1, ⋯, 1)/t and a 3 × 1 matrix P_{i · ∗}^{′} = (n_{i · 0}, n_{i · 1}, n_{i · 2})/t. Denote ⊗ to be the Kronecker product defined for matrices, i.e., A ⊗ B = {a_{ij}B} for A = {a_{ij}}, and B of any dimension [13]. Then it is easy to check the following formulae for the mean and covariance of n_{i}, under H_{0}:
and
where for any vector v = (v_{1}, ⋯, v_{k}), D_{v} denotes the diagonal matrix with v_{i} on its ith diagonal entry.
Since the degrees of freedom in our contingency table are 2(t − 1), we may eliminate the last column and row of each contingency table. For this purpose, let A = (I_{t − 1}, O_{t − 1}) ⊗ (I_{2}, O_{2}) be the matrix which eliminates the last row and column from each contingency table, where I_{r} and O_{r} denote the r × r identity matrix and the r × 1 matrix of 0’s, respectively. Let G_{i} = A(n_{i} − m_{i})). Denote \( {\overset{\sim }{\boldsymbol{P}}}_{i\ast \cdotp } \) and \( {\overset{\sim }{\boldsymbol{P}}}_{i\cdotp \ast } \) as the column vectors obtained by omitting the last entries of P_{i ∗ ·},and P_{i · ∗}, respectively. Then, it is easy to verify that:
Now, the GCMH statistic for n_{i}
where G = ∑ G_{i}. It is well known that wth a large limit for t, the GCMH is asymptotically distributed as the chisquared distribution, with degrees of freedom being 2(t − 1).
Exact association test (EXAT)
In this section, we propose a new statistic, which we call EXAT (Exact Association Test), to test the difference of partial association in two strata of contingency tables, corresponding to two groups, say, the case and control. The test statistic is simply the logarithmic ratio of the GCMH statistics computed for the two groups. Namely, denote the GCMH statistic of the case and control groups by CMH_{case},.and CMH_{control}, respectively. Our proposed test statistic, T, is then defined by:
Our motivation was as follows. In genetic association studies, we need to identify the genes associated with a certain phenotype of interest, such as disease status. Our assumption is that for the ‘causal’ genes, the case and control groups should show distinctive patterns of partial association. To measure this qualitative difference, we hypothesize that the intensity of partial association is proportional to the GCMH statistic. Hence, the more our test statistic T deviates from 0, the larger the partial associations between case and control groups.
This test statistic needs to be computed for each gene X. We then obtain pvalues by a permutation procedure. Genes that have pvalues smaller than the prespecified significance level can be identified to associate with a disease status, e.g., in our current study, the progression of IPMN to pancreatic cancer.
Obtain pvalues of EXAT using normal approximation
As the permutation test is computationally expensive, we considered an empirical but computationally efficient way to obtain pvalues. We observed that our permuted test statistics were usually symmetric, with respect to 0, and followed a bellshaped (i.e., normal) distribution. Moreover, it seemed that the distribution of T was closely approximated by a normal distribution, as determined by its first two moments. Figure 2 (left) shows a typical histogram of a randomly selected gene, generated by 10,000 permutations, having a normal distribution obtained by the first two moments in the histogram. Figure 2 (right) shows the kernelsmoothed plot of test statistics, which precisely agrees with a normal distribution. Based on this empirical evidence, we assert that T (the EXAT statistic) approximately follows a normal distribution.
Based upon this observation, we decided to use the permutation method only to estimate the first two moments of T, and then use the resulting normal distribution, as an approximate distribution of T. Since we only need to estimate the first two moments of T for a normal approximation, we need many fewer permutations for normal approximation, but can also obtain similar results as the usual permutation method yields. Namely, as shown Fig. 3 and Table 3, we compared the pvalues obtained from the distribution of T, as estimated by 10,000 permutations, with pvalues obtained by normal approximation of the various number of permutations, ranging from 10 to 10,000. The resulting pvalues of T, using the normal approximation, gave consistent results, with the usual permutation method. Furthermore, 20 permutations were sufficient enough (R^{2} > 0.8) to obtain similar pvalues, from 10,000 permutations. Table 3 also shows the pvalues from KolmogorovSmirnov test for comparing distributions, mean square errors, as well as two correlation coefficients [14]. All these results support the validity of normal approximation. Hence, we conclude that our hypothesized computational procedure of using a normal approximation not only gave consistent results, with the permutation test, but also was significantly reduced in computational burden.
Results
Type I error simulations
We next performed a simulation study to validate our proposed method, EXAT. For this purpose, we generated simulated data, as in [7, 8], representing the sequence data of European population, from 4000 chromosomes, over 1 Mb regions, on the basis of a coalescent model that mimics the LD pattern local by using COSI [15]. We randomly selected 5kb regions for testing for associations, under all simulation settings.
We generated datasets under the assumed null distribution, to evaluate the type I error control of EXAT. Dichotomous phenotypes, with 50% cases and 50% controls, were generated from a random sampling, under the null hypothesis.
We then applied EXAT to each randomly selected 5kb regions. Then, we compared this result with the four of the most commonly used methods which are smallsampleadjusted SKAT (“SKAT”), smallsampleadjusted unified SKAT (“SKATO”), SKAT for the Combined Effect of Rare and Common Variants (“RCSKAT”), and Burden test. We used the value of α =0.05, 0.01, and 0.001 under the five different total sample size settings (n = 50, 100, 200, and 500), with 4000 simulated datasets for each sample size. As shown in Table 4, EXAT had similar Type I error estimates regardless of sample size.
Real data application
We then applied the proposed EXAT to 395 cancerassociated genes. If any gene had only 1 SNV, we could not construct a contingency table for EXAT. In this case, we simply examined the significance of the association between disease status and the number of minor alleles, using Fisher’s exact test.
Through 10,000 permutations, our EXAT method identified 31 significant genes, at a significance level of 0.05 (Table 5), for four wellknown oncogenes related to pancreatic cancer. Additionally, these four genes were each targeted at the beginning of the experiment. Pvalues from SKAT, SKATO, and RCSKAT were obtained under adjustment for small samples. It is well known that mutations in KRAS are almost omnipresent in pancreatic cancer development and progression [16], and only our EXAT method could find KRAS as a significant gene.
However, since the number of genes was large, compared to the small sample size, any significant gene was not detectable, through multiple comparison methods.
Table 6 shows 19 other genes known to be associated with pancreatic cancer [16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34]. For example, it has been reported that inhibition of PPP2R1A radiosensitizes pancreatic cancer via activation of CDC25C/CDK1, thus, PPP2R1A is a target gene for local therapy of pancreatic cancer [17]. The gene named AURKB is known to suppress proliferation of pancreatic cancer [18], and KMT2D is also known to be associated with pancreatic cancer [19, 20]. MAPK1 is constitutively activated by frequent mutation and plays key roles in pancreatic carcinogenesis and progression [21]. Also, it has been reported that FLT1 is variably expressed in pancreatic cancer, and correlates significantly with disease stage [22]. It is also known that activation of the PI3K pathway mediates resistance to MEK inhibitors in KRASmutant cancers [23].
Figure 4 shows the detection rate for each method. Here, the detection rate is calculated as the ratio of the number of the genes reported to be associated with pancreatic cancer and the number of genes whose pvalues are smaller than 0.05 [16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34]. EXAT has a better detection rate than other methods.
Figure 5 shows a Venn diagram of the number of significant genes at a significance level of 0.05. Although all methods except RCSKAT found DDB2 as significant, the association of IPMN with these has not yet been experimentally verified.
A QQ plot of our EXAT method is shown in Fig. 6a, showing an inflation pattern. Since our NGS data was targeted, it contained many known or suspected oncogenes. In order to investigate whether the inflation was caused by association or false positives, we permuted the disease status (case and control) from our data, and then generated QQ plots. All QQ plots showed a similar pattern without any inflation. Figure 6b shows one representative QQ plot. Since there was no inflation after permutation, the inflation pattern in Fig. 6a was indeed due to genes causal to cancer.
Pairwise scatter plots of EXAT with SKAT, SKATO, Burden, and SKATRC, shown in Fig. 7, did not reveal any clear patterns.
Discussion
As shown in Fig. 7, EXAT pvalues differed from those of other methods, mainly because EXAT and other methods use different types of test statistics for detecting significant genes from NGS data. Our proposed EXAT uses the GCMH statistic for an array of contingency tables generated by the number of minor alleles and SNVs. Under the assumption of randomness within each group, EXAT is derived under a hypergeometric distributional assumption, conditioned by marginal totals. Thus, the ratio of two GCMHs, from case and control groups, is then used to compare the extent of partial association between case and control groups, and the pvalues are obtained by permutation tests. On the other hand, burden tests aggregate information from all rare variants in a specific genomic region into a single summary variable, and obtain pvalues through the chisquare distribution or Hoteling’s ttest. SKAT is based on a regression model, using a variancecomponent test to evaluate the significance of specific genes, using score test statistics, which follow the asymptotic chisquare distribution, under the null hypothesis.
In genetic association studies, individual covariate effects are often need to be adjusted for, although they are not of interest. Note that EXAT can handle any individual covariates of interest. Since EXAT was derived from the GCMH statistics from the subject specific contingency table given in Table 2, each contingency table is compared to its own hypergeometric means to obtain the GCMH statistics. As a result, each individual covariate effects are automatically adjusted for. When the interest lies in comparing a group effects such as gender, the stratified analysis can be applied.
Although EXAT uses a permutation procedure, it does not require a heavy computation time. In our IPMN data from SNUH consisting of 44 subjects with 8325 variants from 411 genes, it took 1.14 s to analyze the effect of single gene with 20 variants, which is the average gene size in IPMN data, using a standard desktop with a single processor Intel Core 2.5GHz CPU and 8GB RAM. For the entire analysis of total 411 genes, EXAT required 3 h for 1000 permutations. Alternatively, when we performed the EXAT test using normal approximation from 50 permutations, it took only 21 min, which demonstrates that the computational time could be substantially reduced when applying normal approximation.
Despite the superior performance of EXAT in distinguishing groups of different distributions, it does have the following limitations that warrant further improvement: (1) EXAT provides hypothesis testing results only; (2) EXAT may be insensitive when associations vary in direction (i.e., increase or decrease phenotypes) across all subjects within a group.
Lastly, in future studies, we will first compare the performance of EXAT with other existing tests for analyzing NGS data from small samples, using power simulation studies. Second, we can incorporate other types of GCMH statistics, such as mean score or correlation CMH, into our framework. The resulting test statistics may reflect further biological information, improving EXAT in terms of power. Lastly, we will also apply our method to the study of other NGS data in future research.
Conclusions
In this study, we proposed an association test, Exact Association Test (EXAT), for identifying rare variants, and assessed its performance against other methods of analyzing small samplesize datasets associated with the intraductal papillary mucinous neoplasm (IPMN) subtype of pancreatic cancer. Thus, EXAT is an exact association test that does not require a large sample approximation. Our method is conceptually based upon Fisher’s exact test, and performs statistical analyses using the Generalized CochranMantelHaenszel (GCMH).
Since EXAT is valid for all sample sizes, it can be more accurate than SKAT in small sample studies, because SKAT relies on asymptotic tests, while EXAT does not. Indeed, as indicated in Fig. 7, among the five methods, only EXAT successfully identified KRAS, a wellknown oncogene almost always mutated in pancreatic cancer [15]. This successful identification demonstrates that our newly proposed method can effectively identify cancersusceptibility genes associated with the progression of IPMN to pancreatic cancer. We believe that our EXAT analyses will reveal rare but significant diseaseassociated oncogenes, and their constituent pathways, and thus increase our understanding of the etiology of cancer and other maladies.
Abbreviations
 CAST:

Cohort allelic sum test
 CMC:

Combined multivariate and collapsing
 CMH:

CochranMantelHaenszel
 EXAT:

Exact Association Test
 GCMH:

Generalized CochranMantelHaenszel
 GWAS:

Genomewide association studies
 IPMN:

Intraductal papillary mucinous neoplasm
 MAF:

Minor allele frequencies
 NGS:

Next generation sequencing
 RCSKAT:

SKAT for the Combined Effect of Rare and Common Variants
 SKAT:

Sequence Kernel Association Test
 SKATO:

Unified SKAT
 SNP:

Single nucleotide polymorphism
 SNV:

Single nucleotide variant
 VC:

Variancecomponent
References
 1.
Wu M, Kraft P, Epstein M, et al. Powerful SNPset analysis for casecontrol genomewide association studies. Am J Hum Genet. 2010;86:929–42.
 2.
Gibson G. Hints of hidden heritability in GWAS. Nat Genet. 2010;42:558–60.
 3.
Manolio T, Collins F, Cox N, et al. Finding the missing heritability of complex diseases. Nature. 2009;461:747–53.
 4.
Koboldt D, Steinberg K, Larson D, et al. The nextgeneration sequencing revolution and its impact on genomics. Cell. 2013;155:27–38.
 5.
Li BLeal S. Methods for detecting associations with rare variants for common diseases: application to analysis of sequence data. Am J Hum Genet. 2008;83:311–21.
 6.
Morgenthaler S, Thilly W. A strategy to discover genes that carry multiallelic or monoallelic risk for common diseases: a cohort allelic sums test (CAST). Mut Res. 2007;615:28–56.
 7.
Wu M, Lee S, Cai T, et al. Rarevariant association testing for sequencing data with the sequence kernel association test. Am J Hum Genet. 2011;89:82–93.
 8.
Lee S, Emond M, Bamshad M, et al. Optimal unified approach for rarevariant association testing with application to smallsample casecontrol wholeexome sequencing studies. Am J Hum Genet. 2012;91:224–37.
 9.
Davis C. Statistical methods for the analysis of repeated measurements. 1st ed. New York: Springer; 2002.
 10.
Landis J, Heyman E, Koch G. Average partial Association in Threeway Contingency Tables: a review and discussion of alternative tests. Int Stat Rev. 1978;46:237.
 11.
Salvia R, Castillo C, Bassi C, et al. Mainduct Intraductal papillary mucinous neoplasms of the pancreas. Ann Surg. 2004;239:678–87.
 12.
Jang J, Park T, Lee S, et al. Validation of international consensus guidelines for the resection of branch ducttype intraductal papillary mucinous neoplasms. Br J Surg. 2014;101:686–92.
 13.
Henderson H, Pukelsheim F, Searle S. On the history of the kronecker product. Linear Multilinear Algebra. 1983;14:113–20.
 14.
Massey FJ Jr. The KolmogorovSmirnov test for goodness of fit. J Am Stat Assoc. 1951;46(253):68–78.
 15.
Schaffner SF, Foo C, Gabriel S, Reich D, Daly MJ, Altshuler D. Calibrating a coalescent simulation of human genome sequence variation. Genome Res. 2005;15(11):1576–83.
 16.
Hruban RH, Van Mansfeld AD, Offerhaus GJ, Van Weering DH, Allison DC, Goodman SN, et al. Kras oncogene activation in adenocarcinoma of the human pancreas. A study of 82 carcinomas using a combination of mutantenriched polymerase chain reaction analysis and allelespecific oligonucleotide hybridization. Am J Pathol. 1993;143(2):545.
 17.
Wei D, Parsels LA, Karnak D, Davis MA, Parsels JD, Marsh AC, et al. Inhibition of protein phosphatase 2A radiosensitizes pancreatic cancers by modulating CDC25C/CDK1 and homologous recombination repair. Clin Cancer Res. 2013;19(16):4422–32.
 18.
Furukawa T, Tanji E, Kuboki Y, Hatori T, Yamamoto M, Shimizu K, et al. Targeting of MAPKassociated molecules identifies SON as a prime target to attenuate the proliferation and tumorigenicity of pancreatic cancer cells. Mol Cancer. 2012;11(1):88.
 19.
Gleeson FC, Kerr SE, Kipp BR, Voss JS, Minot DM, Tu ZJ, et al. Targeted next generation sequencing of endoscopic ultrasound acquired cytology from ampullary and pancreatic adenocarcinoma has the potential to aid patient stratification for optimal therapy selection. Oncotarget. 2016;7(34):54526.
 20.
Dawkins JB, Wang J, Maniati E, Heward JA, Koniali L, Martin SA, et al. Reduced expression of histone methyltransferases KMT2C and KMT2D correlates with improved outcome in pancreatic ductal adenocarcinoma. Cancer Res. 2016;76:4861–71.
 21.
Furukawa T, Kanai N, Shiwaku H, et al. AURKA is one of the downstream targets of MAPK1/ERK2 in pancreatic cancer. Oncogene. 2006;25:4831–9.
 22.
Chung G, Yoon H, Zerkowski M, et al. Vascular endothelial growth factor, FLT1, and FLK1 analysis in a pancreatic cancer tissue microarray. Cancer. 2006;106:1677–84.
 23.
Wee S, Jagani Z, Xiang K, et al. PI3K pathway activation mediates resistance to MEK inhibitors in KRAS mutant cancers. Cancer Res. 2009;69:4286–93.
 24.
Kattel K, Evande R, Tan C, Mondal G, Grem JL, Mahato RI. Impact of CYP2C19 polymorphism on the pharmacokinetics of nelfinavir in patients with pancreatic cancer. Br J Clin Pharmacol. 2015;80(2):267–75.
 25.
Bai G, Wu C, Gao Y, Shu G. Exploring the functional disorder and corresponding key transcription factors in intraductal papillary mucinous neoplasms progression. Int J Genomics. 2015;2015:197603.
 26.
Borecka M, Zemankova P, Lhota F, Soukupova J, Kleiblova P, Vocka M, et al. The c. 657del5 variant in the NBN gene predisposes to pancreatic cancer. Gene. 2016;587(2):169–72.
 27.
Kastrinos F, Mukherjee B, Tayob N, Wang F, Sparr J, Raymond VM, et al. Risk of pancreatic cancer in families with lynch syndrome. JAMA. 2009;302(16):1790–5.
 28.
Goonesekere NC, Wang X, Ludwig L, Guda C. A meta analysis of pancreatic microarray datasets yields new targets as cancer genes and biomarkers. PLoS One. 2014;9(4):e93046.
 29.
Biankin AV, Waddell N, Kassahn KS, Gingras MC, Muthuswamy LB, Johns AL, et al. Pancreatic cancer genomes reveal aberrations in axon guidance pathway genes. Nature. 2012;491(7424):399.
 30.
Kumar S, Rao N, Ge R. Emerging roles of ADAMTSs in angiogenesis and cancer. Cancers. 2012;4(4):1252–99.
 31.
Komura T, Sakai Y, Harada K, Kawaguchi K, Takabatake H, Kitagawa H, et al. Inflammatory features of pancreatic cancer highlighted by monocytes/macrophages and CD4+ T cells with clinical impact. Cancer Sci. 2015;106(6):672–86.
 32.
Waddell N, Pajic M, Patch AM, Chang DK, Kassahn KS, Bailey P, et al. Whole genomes redefine the mutational landscape of pancreatic cancer. Nature. 2015;518(7540):495.
 33.
Brian W. Pancreatic Cancer, An issue in Hematology/Oncology Clinics of North America. Philadelphia: Elsevier. 2015;29(4).
 34.
Pan S, Chen R, Crispin DA, May D, Stevens T, McIntosh MW, et al. Protein alterations associated with pancreatic cancer and chronic pancreatitis found in human plasma using global quantitative proteomics profiling. J Proteome Res. 2011;10(5):2359–76.
Acknowledgements
We acknowledge all the patients and families enrolled in our research. We also thank the staff at Seoul National University Hospital for the contribution relating to the genetic experiment.
Funding
This research was supported by grants of the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea (HI15C2165, HI16C2037). Publication of this article was funded by a grant from the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea (grant number: HI16C2037).
Availability of data and materials
The method is available publicly at http://bibs.snu.ac.kr/software/EXAT. Data set will be available soon.
About this supplement
This article has been published as part of BMC Medical Genomics volume 11 supplement 2, 2018: Proceedings of the 28th international conference on genome informatics: Medical genomics. The full contents of the supplement are available online at https://bmcmedgenomics.biomedcentral.com/articles/supplements/volume11supplement2.
Author information
Affiliations
Contributions
SYL, JYJ, TSP conceived and designed the research; JYJ collected the case and performed NGS experiments; JWL and TSP developed the method and were involved in drafting of manuscript; JWL implemented the software. All authors have read and approved the final manuscript for publication.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Informed consent was obtained from each family and all human subject studies were approved by the Institutional Review Board of Seoul National University Hospital.
Consent for publication
We obtained the consent to publish their data from the patients in this study.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Lee, J., Lee, S., Jang, J. et al. Exact association test for small size sequencing data. BMC Med Genomics 11, 30 (2018). https://doi.org/10.1186/s129200180344z
Published:
Keywords
 NGS data analysis
 Small size sequencing data
 Association study
 CMH statistic
 IPMN
 Fisher’s exact test