FastRAG: Retrieval Augmented Generation for Semi-structured Data

Efficiently processing and interpreting network data is critical for the operation of increasingly complex networks. Recent advances in Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) techniques have improved data processing in network management. However, existing RAG methods l...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Abane, Amar, Bekri, Anis, Battou, Abdella
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Abane, Amar
Bekri, Anis
Battou, Abdella
description Efficiently processing and interpreting network data is critical for the operation of increasingly complex networks. Recent advances in Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) techniques have improved data processing in network management. However, existing RAG methods like VectorRAG and GraphRAG struggle with the complexity and implicit nature of semi-structured technical data, leading to inefficiencies in time, cost, and retrieval. This paper introduces FastRAG, a novel RAG approach designed for semi-structured data. FastRAG employs schema learning and script learning to extract and structure data without needing to submit entire data sources to an LLM. It integrates text search with knowledge graph (KG) querying to improve accuracy in retrieving context-rich information. Evaluation results demonstrate that FastRAG provides accurate question answering, while improving up to 90% in time and 85% in cost compared to GraphRAG.
doi_str_mv 10.48550/arxiv.2411.13773
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2411_13773</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2411_13773</sourcerecordid><originalsourceid>FETCH-arxiv_primary_2411_137733</originalsourceid><addsrcrecordid>eNpjYJA0NNAzsTA1NdBPLKrILNMzMjE01DM0Njc35mRwcEssLglydLdSCEotKcpMLUvMUXAsTc9NzStJTVFwT81LLUosyczPU0jLL1IITs3N1C0uKSpNLiktAkq7JJYk8jCwpiXmFKfyQmluBnk31xBnD12wXfEFRZm5iUWV8SA748F2GhNWAQC87TZS</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>FastRAG: Retrieval Augmented Generation for Semi-structured Data</title><source>arXiv.org</source><creator>Abane, Amar ; Bekri, Anis ; Battou, Abdella</creator><creatorcontrib>Abane, Amar ; Bekri, Anis ; Battou, Abdella</creatorcontrib><description>Efficiently processing and interpreting network data is critical for the operation of increasingly complex networks. Recent advances in Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) techniques have improved data processing in network management. However, existing RAG methods like VectorRAG and GraphRAG struggle with the complexity and implicit nature of semi-structured technical data, leading to inefficiencies in time, cost, and retrieval. This paper introduces FastRAG, a novel RAG approach designed for semi-structured data. FastRAG employs schema learning and script learning to extract and structure data without needing to submit entire data sources to an LLM. It integrates text search with knowledge graph (KG) querying to improve accuracy in retrieving context-rich information. Evaluation results demonstrate that FastRAG provides accurate question answering, while improving up to 90% in time and 85% in cost compared to GraphRAG.</description><identifier>DOI: 10.48550/arxiv.2411.13773</identifier><language>eng</language><subject>Computer Science - Artificial Intelligence ; Computer Science - Networking and Internet Architecture</subject><creationdate>2024-11</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,881</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2411.13773$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2411.13773$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Abane, Amar</creatorcontrib><creatorcontrib>Bekri, Anis</creatorcontrib><creatorcontrib>Battou, Abdella</creatorcontrib><title>FastRAG: Retrieval Augmented Generation for Semi-structured Data</title><description>Efficiently processing and interpreting network data is critical for the operation of increasingly complex networks. Recent advances in Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) techniques have improved data processing in network management. However, existing RAG methods like VectorRAG and GraphRAG struggle with the complexity and implicit nature of semi-structured technical data, leading to inefficiencies in time, cost, and retrieval. This paper introduces FastRAG, a novel RAG approach designed for semi-structured data. FastRAG employs schema learning and script learning to extract and structure data without needing to submit entire data sources to an LLM. It integrates text search with knowledge graph (KG) querying to improve accuracy in retrieving context-rich information. Evaluation results demonstrate that FastRAG provides accurate question answering, while improving up to 90% in time and 85% in cost compared to GraphRAG.</description><subject>Computer Science - Artificial Intelligence</subject><subject>Computer Science - Networking and Internet Architecture</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNpjYJA0NNAzsTA1NdBPLKrILNMzMjE01DM0Njc35mRwcEssLglydLdSCEotKcpMLUvMUXAsTc9NzStJTVFwT81LLUosyczPU0jLL1IITs3N1C0uKSpNLiktAkq7JJYk8jCwpiXmFKfyQmluBnk31xBnD12wXfEFRZm5iUWV8SA748F2GhNWAQC87TZS</recordid><startdate>20241120</startdate><enddate>20241120</enddate><creator>Abane, Amar</creator><creator>Bekri, Anis</creator><creator>Battou, Abdella</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20241120</creationdate><title>FastRAG: Retrieval Augmented Generation for Semi-structured Data</title><author>Abane, Amar ; Bekri, Anis ; Battou, Abdella</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-arxiv_primary_2411_137733</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Artificial Intelligence</topic><topic>Computer Science - Networking and Internet Architecture</topic><toplevel>online_resources</toplevel><creatorcontrib>Abane, Amar</creatorcontrib><creatorcontrib>Bekri, Anis</creatorcontrib><creatorcontrib>Battou, Abdella</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Abane, Amar</au><au>Bekri, Anis</au><au>Battou, Abdella</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>FastRAG: Retrieval Augmented Generation for Semi-structured Data</atitle><date>2024-11-20</date><risdate>2024</risdate><abstract>Efficiently processing and interpreting network data is critical for the operation of increasingly complex networks. Recent advances in Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) techniques have improved data processing in network management. However, existing RAG methods like VectorRAG and GraphRAG struggle with the complexity and implicit nature of semi-structured technical data, leading to inefficiencies in time, cost, and retrieval. This paper introduces FastRAG, a novel RAG approach designed for semi-structured data. FastRAG employs schema learning and script learning to extract and structure data without needing to submit entire data sources to an LLM. It integrates text search with knowledge graph (KG) querying to improve accuracy in retrieving context-rich information. Evaluation results demonstrate that FastRAG provides accurate question answering, while improving up to 90% in time and 85% in cost compared to GraphRAG.</abstract><doi>10.48550/arxiv.2411.13773</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2411.13773
ispartof
issn
language eng
recordid cdi_arxiv_primary_2411_13773
source arXiv.org
subjects Computer Science - Artificial Intelligence
Computer Science - Networking and Internet Architecture
title FastRAG: Retrieval Augmented Generation for Semi-structured Data
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-08T18%3A28%3A36IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=FastRAG:%20Retrieval%20Augmented%20Generation%20for%20Semi-structured%20Data&rft.au=Abane,%20Amar&rft.date=2024-11-20&rft_id=info:doi/10.48550/arxiv.2411.13773&rft_dat=%3Carxiv_GOX%3E2411_13773%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true