Adaptive Co-Evolutionary Metaheuristic for Sparse Gene Regulatory Network Inference under Noisy RNA-Seq Conditions
Abstract
Accurate inference of Gene Regulatory Networks (GRNs) from transcriptomic data is central to understanding stress-response mechanisms in agricultural crop species, yet the overdispersed, zero-inflated, and batch-effect-laden nature of RNA-Seq count data poses formidable challenges for existing reconstruction methods. Information-theoretic approaches such as Algorithm for the Reconstruction of Accurate Cellular Networks (ARACNE) and Context Likelihood of Relatedness (CLR) fail to recover edge directionality, regression-based methods including GENIE3 and Trustful Inference of Gene REgulation using Stability Selection (TIGRESS) incur prohibitive computational costs at genome scale, and Deep-Learning (DL) frameworks require curated labeled training data that are rarely available for non-model crop species. In this paper, we present Adaptive Co-Evolutionary metaheuristic for Gene Regulatory Network inference (ACE-GRN), a novel optimization framework that simultaneously evolves two cooperating populations one encoding network topology as binary adjacency matrices and another encoding edge weights as continuous parameter vectors to reconstruct sparse, directed GRNs directly from noisy RNA-Seq counts. ACE-GRN integrates a Negative Binomial (NB) likelihood model tailored to RNA-Seq overdispersion, a weighted L1 sparsity penalty to enforce biologically realistic network density, a Directed Acyclic Graph (DAG) cycle penalty, and an adaptive parameter control mechanism inspired by reinforcement learning that dynamically balances exploration and exploitation across evolutionary generations. Comprehensive evaluation on DREAM4 and DREAM5 benchmark networks demonstrates that ACE-GRN achieves mean Area Under the Receiver Operating Characteristic curve (AUROC) improvements of 8–12% and mean Area Under the Precision-Recall curve (AUPR) improvements of 14–19% over the best-performing baseline methods. On real agricultural datasets comprising rice (Oryza sativa) drought-stress and wheat (Triticum aestivum) heat-stress transcriptomes, ACE-GRN successfully recovers experimentally validated regulatory modules involving DREB, NAC, and WRKY transcription factor families, while maintaining robust performance under increasing noise levels (retaining approximately 82% AUROC at coefficient of variation 0.7). These results establish ACE-GRN as a powerful and biologically interpretable tool for GRN inference in agricultural genomics.
Keywords:
Metaheuristic optimization, Co-evolutionary algorithm, RNA-Seq, parse network inference, Agricultural genomicsReferences
- [1] Davidson, E., & Levin, M. (2005). Gene regulatory networks. Proceedings of the national academy of sciences, 102(14), 4935. https://doi.org/10.1073/pnas.0502024102
- [2] Barabasi, A.L., & Oltvai, Z. N. (2004). Network biology: Understanding the cell’s functional organization. Nature reviews genetics, 5(2), 101–113. https://doi.org/10.1038/nrg1272
- [3] De Smet, R., & Marchal, K. (2010). Advantages and limitations of current network inference methods. Nature reviews microbiology, 8(10), 717–729. https://doi.org/10.1038/nrmicro2419
- [4] Zhao, C., Liu, B., Piao, S., Wang, X., Lobell, D. B., Huang, Y., ... & Asseng, S. (2017). Temperature increase reduces global yields of major crops in four independent estimates. Proceedings of the national academy of sciences, 114(35), 9326-9331. https://doi.org/10.1073/pnas.1701762114
- [5] Lesk, C., Rowhani, P., & Ramankutty, N. (2016). Influence of extreme weather disasters on global crop production. Nature, 529(7584), 84–87. https://doi.org/10.1038/nature16467
- [6] Nakashima, K., Yamaguchi-Shinozaki, K., & Shinozaki, K. (2014). The transcriptional regulatory network in the drought response and its crosstalk in abiotic stress responses including drought, cold, and heat. Frontiers in plant science, 5, 170. https://doi.org/10.3389/fpls.2014.00170
- [7] Rushton, P. J., Somssich, I. E., Ringler, P., & Shen, Q. J. (2010). WRKY transcription factors. Trends in plant science, 15(5), 247–258. https://doi.org/10.1016/j.tplants.2010.02.006
- [8] Wang, Z., Gerstein, M., & Snyder, M. (2009). RNA-Seq: A revolutionary tool for transcriptomics. Nature reviews genetics, 10(1), 57–63. https://doi.org/10.1038/nrg2484
- [9] Robinson, M. D., McCarthy, D. J., & Smyth, G. K. (2010). EdgeR: A Bioconductor package for differential expression analysis of digital gene expression data. Bioinformatics, 26(1), 139–140. https://doi.org/10.1093/bioinformatics/btp616
- [10] Love, M. I., Huber, W., & Anders, S. (2014). Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2. Genome biology, 15(12), 550. https://doi.org/10.1186/s13059-014-0550-8
- [11] Risso, D., Ngai, J., Speed, T. P., & Dudoit, S. (2014). Normalization of RNA-seq data using factor analysis of control genes or samples. Nature biotechnology, 32(9), 896–902. https://doi.org/10.1038/nbt.2931
- [12] Tibshirani, R., Wainwright, M., & Hastie, T. (2019). Statistical learning and sparsity. https://aistats.org/aistats2019/0-AISTATS2019-slides-robert_tibshirani.pdf
- [13] Margolin, A. A., Nemenman, I., Basso, K., Wiggins, C., Stolovitzky, G., Favera, R. D., & Califano, A. (2006). ARACNE: An algorithm for the reconstruction of gene regulatory networks in a mammalian cellular context. BMC bioinformatics, 7(Suppl 1), S7. https://doi.org/10.1186/1471-2105-7-S1-S7
- [14] Faith, J. J., Hayete, B., Thaden, J. T., Mogno, I., Wierzbowski, J., Cottarel, G., ... & Gardner, T. S. (2007). Large-scale mapping and validation of Escherichia coli transcriptional regulation from a compendium of expression profiles. PLoS biology, 5(1), e8. https://doi.org/10.1371/journal.pbio.0050008
- [15] Huynh-Thu, V. A., Irrthum, A., Wehenkel, L., & Geurts, P. (2010). Inferring regulatory networks from expression data using tree-based methods. PloS one, 5(9), e12776. https://doi.org/10.1371/journal.pone.0012776
- [16] Haury, A.C., Mordelet, F., Vera-Licona, P., & Vert, J.P. (2012). TIGRESS: Trustful inference of gene regulation using stability selection. BMC systems biology, 6(1), 145. https://doi.org/10.1186/1752-0509-6-145
- [17] Marbach, D., Costello, J. C., Küffner, R., Vega, N. M., Prill, R. J., Camacho, D. M., ... & Stolovitzky, G. (2012). Wisdom of crowds for robust gene network inference. Nature methods, 9(8), 796-804. https://doi.org/10.1038/nmeth.2016
- [18] Friedman, N., Linial, M., Nachman, I., & Pe'er, D. (2000). Using Bayesian networks to analyze expression data. Proceedings of the fourth annual international conference on computational molecular biology (pp. 127-135). ACM. https://doi.org/10.1145/332306.332355
- [19] Hecker, M., Lambeck, S., Toepfer, S., Van Someren, E., & Guthke, R. (2009). Gene regulatory network inference: Data integration in dynamic models—A review. Biosystems, 96(1), 86–103. https://doi.org/10.1016/j.biosystems.2008.12.004
- [20] Shu, H., Zhou, J., Lian, Q., Li, H., Zhao, D., Zeng, J., & Ma, J. (2021). Modeling gene regulatory networks using neural network architectures. Nature computational science, 1(7), 491–501. https://doi.org/10.1038/s43588-021-00099-8
- [21] Yang, B., Bao, W., Chen, B., & Song, D. (2022). Single_cell_GRN: Gene regulatory network identification based on supervised learning method and Single-cell RNA-seq data. BioData mining, 15(1), 13. https://doi.org/10.1186/s13040-022-00297-8
- [22] Kennedy, J., & Eberhart, R. (1995). Particle swarm optimization. Proceedings of ICNN'95-international conference on neural networks (Vol. 4, pp. 1942-1948). IEEE. https://doi.org/10.1109/ICNN.1995.488968
- [23] Storn, R., & Price, K. (1997). Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. Journal of global optimization, 11(4), 341–359. https://doi.org/10.1023/A:1008202821328
- [24] Kentzoglanakis, K., & Poole, M. (2011). A swarm intelligence framework for reconstructing gene networks: Searching for biologically plausible architectures. IEEE/ACM transactions on computational biology and bioinformatics, 9(2), 358–371. https://doi.org/10.1109/TCBB.2011.87
- [25] Iba, H. (2018). Evolutionary approach to machine learning and deep neural networks: Neuro-evolution and gene regulatory networks. Springer. https://doi.org/10.1007/978-981-13-0200-8
- [26] Eiben, A. E., & Smith, J. E. (2003). Introduction to evolutionary computing. Berlin: Springer. https://doi.org/10.1007/978-3-662-44874-8
- [27] Potter, M. A., & De Jong, K. A. (2000). Cooperative coevolution: An architecture for evolving coadapted subcomponents. Evolutionary computation, 8(1), 1–29. https://doi.org/10.1007/978-3-662-44874-8
- [28] Tan, K. C., Yang, Y. J., & Goh, C. K. (2006). A distributed cooperative coevolutionary algorithm for multiobjective optimization. IEEE transactions on evolutionary computation, 10(5), 527–549. https://doi.org/10.1109/TEVC.2005.860762
- [29] Ma, X., Li, X., Zhang, Q., Tang, K., Liang, Z., Xie, W., & Zhu, Z. (2018). A survey on cooperative co-evolutionary algorithms. IEEE transactions on evolutionary computation, 23(3), 421–441. https://doi.org/10.1109/TEVC.2018.2868770
- [30] Meyer, P. E., Kontos, K., Lafitte, F., & Bontempi, G. (2007). Information-theoretic inference of large transcriptional regulatory networks. EURASIP journal on bioinformatics and systems biology, 2007(1), 79879. https://doi.org/10.1155/2007/79879
- [31] Reverter, A., & Chan, E. K. F. (2008). Combining partial correlation and an information theory approach to the reversed engineering of gene co-expression networks. Bioinformatics, 24(21), 2491–2497. https://doi.org/10.1093/bioinformatics/btn482
- [32] Moerman, T., Aibar Santos, S., Bravo González-Blas, C., Simm, J., Moreau, Y., Aerts, J., & Aerts, S. (2019). GRNBoost2 and Arboreto: Efficient and scalable inference of gene regulatory networks. Bioinformatics, 35(12), 2159–2161. https://doi.org/10.1093/bioinformatics/bty916
- [33] Huynh-Thu, V. A., & Geurts, P. (2018). DynGENIE3: Dynamical GENIE3 for the inference of gene networks from time series expression data. Scientific reports, 8(1), 3384. https://doi.org/10.1038/s41598-018-21715-0
- [34] Passemiers, A., Moreau, Y., & Raimondi, D. (2022). Fast and accurate inference of gene regulatory networks through robust precision matrix estimation. Bioinformatics, 38(10), 2802–2809. https://doi.org/10.1093/bioinformatics/btac178
- [35] Spirtes, P., Glymour, C., & Scheines, R. (2001). Causation, prediction, and search. The MIT Press. https://doi.org/10.7551/mitpress/1754.001.0001
- [36] Murphy, K. P. (2002). Dynamic bayesian networks: Representation, inference and learning. University of California, Berkeley. https://www.cs.ubc.ca/~murphyk/Thesis/thesis_double.pdf
- [37] Bansal, M., Belcastro, V., Ambesi-Impiombato, A., & Di Bernardo, D. (2007). How to infer gene networks from expression profiles. Molecular systems biology, 3, 78. https://doi.org/10.1038/msb4100120
- [38] Lillacci, G., & Khammash, M. (2010). Parameter estimation and model selection in computational biology. PLoS computational biology, 6(3), e1000696. https://doi.org/10.1371/journal.pcbi.1000696
- [39] den Broeck, L., Gordon, M., Inzé, D., Williams, C., & Sozzani, R. (2020). Gene regulatory network inference: Connecting plant biology and mathematical modeling. Frontiers in genetics, 11, 457. https://doi.org/10.3389/fgene.2020.00457
- [40] Sakamoto, E., & Iba, H. (2001). Inferring a system of differential equations for a gene regulatory network by using genetic programming. Proceedings of the 2001 congress on evolutionary computation (Vol. 1, pp. 720-726). IEEE. https://doi.org/10.1109/CEC.2001.934462
- [41] Xu, R., Wunsch II, D., & Frank, R. (2007). Inference of genetic regulatory networks with recurrent neural network models using particle swarm optimization. IEEE/ACM transactions on computational biology and bioinformatics, 4(4), 681–692. https://doi.org/10.1109/TCBB.2007.1057
- [42] Noman, N., & Iba, H. (2007). Inferring gene regulatory networks using differential evolution with local search heuristics. IEEE/ACM transactions on computational biology and bioinformatics, 4(4), 634–647. https://doi.org/10.1109/TCBB.2007.1058
- [43] Deb, K., Pratap, A., Agarwal, S., & Meyarivan, T. (2002). A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE transactions on evolutionary computation, 6(2), 182–197. https://doi.org/10.1109/4235.996017
- [44] Cho, D.Y., Cho, K.H., & Zhang, B.T. (2006). Identification of biochemical networks by S-tree based genetic programming. Bioinformatics, 22(13), 1631–1640. https://doi.org/10.1093/bioinformatics/btl122
- [45] Noman, N., & Iba, H. (2016). A brief introduction to evolutionary and other nature-inspired algorithms. Evolutionary computation in gene regulatory network research, 3–29. https://doi.org/10.1002/9781119079453.ch1
- [46] Mandal, S., Khan, A., Saha, G., & Pal, R. K. (2016). Reverse engineering of gene regulatory networks based on S-systems and bat algorithm. Journal of bioinformatics and computational biology, 14(03), 1650010. https://doi.org/10.1142/S0219720016500104
- [47] Sehgal, M. S. B., Gondal, I., & Dooley, L. S. (2005). Collateral missing value imputation: A new robust missing value estimation algorithm for microarray data. Bioinformatics, 21(10), 2417–2423. https://doi.org/10.1093/bioinformatics/bti345
- [48] Yang, Z., Tang, K., & Yao, X. (2008). Large scale evolutionary optimization using cooperative coevolution. Information sciences, 178(15), 2985–2999. https://doi.org/10.1016/j.ins.2008.02.017
- [49] García-Pedrajas, N., Hervás-Martínez, C., & Muñoz-Pérez, J. (2003). COVNET: A cooperative coevolutionary model for evolving artificial neural networks. IEEE transactions on neural networks, 14(3), 575–596. https://doi.org/10.1109/TNN.2003.810618
- [50] Pena-Reyes, C. A., & Sipper, M. (2001). Fuzzy CoCo: A cooperative-coevolutionary approach to fuzzy modeling. IEEE transactions on fuzzy systems, 9(5), 727–737. https://doi.org/10.1109/91.963759
- [51] Coello, C. A. C. (2002). Theoretical and numerical constraint-handling techniques used with evolutionary algorithms: A survey of the state of the art. Computer methods in applied mechanics and engineering, 191(11–12), 1245–1287. https://doi.org/10.1016/S0045-7825(01)00323-1
- [52] Gong, M., Cai, Q., Chen, X., & Ma, L. (2013). Complex network clustering by multiobjective discrete particle swarm optimization based on decomposition. IEEE transactions on evolutionary computation, 18(1), 82–97. https://doi.org/10.1109/TEVC.2013.2260862
- [53] Chong, S. Y., Tino, P., & Yao, X. (2008). Measuring generalization performance in coevolutionary learning. IEEE transactions on evolutionary computation, 12(4), 479–505. https://doi.org/10.1109/TEVC.2007.907593
- [54] Dubouzet, J. G., Sakuma, Y., Ito, Y., Kasuga, M., Dubouzet, E. G., Miura, S., ... & Yamaguchi‐Shinozaki, K. (2003). OsDREB genes in rice, Oryza sativa L., encode transcription activators that function in drought‐, high‐salt‐and cold‐responsive gene expression. The plant journal, 33(4), 751-763. https://doi.org/10.1046/j.1365-313x.2003.01661.x
- [55] Takasaki, H., Maruyama, K., Kidokoro, S., Ito, Y., Fujita, Y., Shinozaki, K., ... & Nakashima, K. (2010). The abiotic stress-responsive NAC-type transcription factor OsNAC5 regulates stress-inducible genes and stress tolerance in rice. Molecular genetics and genomics, 284(3), 173-183.https://doi.org/10.1007/s00438-010-0557-0
- [56] Todaka, D., Shinozaki, K., & Yamaguchi-Shinozaki, K. (2015). Recent advances in the dissection of drought-stress regulatory networks and strategies for development of drought-tolerant transgenic rice plants. Frontiers in plant science, 6, 84. https://doi.org/10.3389/fpls.2015.00084
- [57] Xue, G.-P., Drenth, J., & McIntyre, C. L. (2015). TaHsfA6f is a transcriptional activator that regulates a suite of heat stress protection genes in wheat (Triticum aestivum L.) including previously unknown Hsf targets. Journal of experimental botany, 66(3), 1025–1039. https://doi.org/10.1093/jxb/eru462
- [58] Ramírez-González, R. H., Borrill, P., Lang, D., Harrington, S. A., Brinton, J., Venturini, L., ... & Uauy, C. (2018). The transcriptional landscape of polyploid wheat. Science, 361(6403), eaar6089. https://doi.org/10.1126/science.aar6089
- [59] Yoshida, T., Mogami, J., & Yamaguchi-Shinozaki, K. (2014). ABA-dependent and ABA-independent signaling in response to osmotic stress in plants. Current opinion in plant biology, 21, 133–139. https://doi.org/10.1016/j.pbi.2014.07.009
- [60] Leclerc, R. D. (2008). Survival of the sparsest: Robust gene networks are parsimonious. Molecular systems biology, 4, 213. https://doi.org/10.1038/msb.2008.52
- [61] Zheng, X., Aragam, B., Ravikumar, P. K., & Xing, E. P. (2018). Dags with no tears: Continuous optimization for structure learning. Advances in neural information processing systems, 31. https://doi.org/10.48550/arXiv.1803.01422
- [62] Wiegand, R. P., Liles, W. C., & De Jong, K. A. (2001). An empirical analysis of collaboration methods in cooperative coevolutionary algorithms. Proceedings of the genetic and evolutionary computation conference (GECCO) (Vol. 2611, pp. 1235-1245). San Francisco: Morgan Kaufmann. https://staff.fmi.uvt.ro/~daniela.zaharie/ma2016/projects/techniques/coevolution/CooperativeCoevolution1.pdf
- [63] Watkins, C. J. C. H., & Dayan, P. (1992). Q-learning. Machine learning, 8(3), 279–292. https://doi.org/10.1007/BF00992698
- [64] Deb, K., & Agrawal, R. B. (1995). Simulated binary crossover for continuous search space. Complex systems, 9(2), 115-148. https://doi.org/10.1145/1276958.1277190
- [65] Deb, K., & Goyal, M. (1996). A combined genetic adaptive search (GeneAS) for engineering design. Computer science and informatics, 26, 30-45. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.27.767&rep=rep1&type=pdf
- [66] Robinson, M. D., & Oshlack, A. (2010). A scaling normalization method for differential expression analysis of RNA-seq data. Genome biology, 11(3), R25. https://doi.org/10.1186/gb-2010-11-3-r25
- [67] Schaffter, T., Marbach, D., & Floreano, D. (2011). GeneNetWeaver: In silico benchmark generation and performance profiling of network inference methods. Bioinformatics, 27(16), 2263–2270. https://doi.org/10.1093/bioinformatics/btr373
- [68] Guo, W., Zhang, J., Zhang, N., Xin, M., Peng, H., Hu, Z., ... & Du, J. (2015). The wheat NAC transcription factor TaNAC2L is regulated at the transcriptional and post-translational levels and promotes heat stress tolerance in transgenic Arabidopsis. PLoS one, 10(8), e0135667. https://doi.org/10.1371/journal.pone.0135667
- [69] Ruyssinck, J., Huynh-Thu, V. A., Geurts, P., Dhaene, T., Demeester, P., & Saeys, Y. (2014). NIMEFI: Gene regulatory network inference using multiple ensemble feature importance algorithms. PLoS one, 9(3), e92709. https://doi.org/10.1371/journal.pone.0092709
- [70] Pratapa, A., Jalihal, A. P., Law, J. N., Bharadwaj, A., Murali, & TM. (2020). Benchmarking algorithms for gene regulatory network inference from single-cell transcriptomic data. Nature methods, 17(2), 147–154. https://doi.org/10.1038/s41592-019-0690-6
- [71] Denyer, T., Ma, X., Klesen, S., Scacchi, E., Nieselt, K., & Timmermans, M. C. P. (2019). Spatiotemporal developmental trajectories in the Arabidopsis root revealed using high-throughput single-cell RNA sequencing. Developmental cell, 48(6), 840–852. https://doi.org/10.1016/j.devcel.2019.02.022