Rm-LR: A long-range-based deep learning model for predicting multiple types of RNA modifications

Recent research has highlighted the pivotal role of RNA post-transcriptional modifications in the regulation of RNA expression and function. Accurate identification of RNA modification sites is important for understanding RNA function. In this study, we propose a novel RNA modification prediction method, namely Rm-LR, which leverages a long-range-based deep learning approach to accurately predict multiple types of RNA modifications using RNA sequences only. Rm-LR incorporates two large-scale RNA language pre-trained models to capture discriminative sequential information and learn local important features, which are subsequently integrated through a bilinear attention network. Rm-LR supports a total of ten RNA modification types (m6A, m1A, m5C, m5U, m6Am, Ψ, Am, Cm, Gm, and Um) and significantly outperforms the state-of-the-art methods in terms of predictive capability on benchmark datasets. Experimental results show the effectiveness and superiority of Rm-LR in prediction of various RNA modifications, demonstrating the strong adaptability and robustness of our proposed model. We demonstrate that RNA language pretrained models enable to learn dense biological sequential representations from large-scale long-range RNA corpus, and meanwhile enhance the interpretability of the models. This work contributes to the development of accurate and reliable computational models for RNA modification prediction, providing insights into the complex landscape of RNA modifications. •The study presents Rm-LR, a novel RNA modification prediction method, accurately forecasting various RNA modifications using only RNA sequences.•Rm-LR utilizes 2 large-scale RNA language pre-trained models, capturing sequential info and local features, integrated via a bilinear attention network.•Rm-LR surpasses state-of-the-art methods in predicting RNA modifications, showcasing its effectiveness and superiority on benchmark datasets.•The research emphasizes RNA language pre-trained models' potential in learning biological sequential representations, enhancing interpretability, and developing accurate computational models.