Tag Archives: knowledge graphs

Can You Read Two Million Pages? An LLM Can Help.

      No Comments on Can You Read Two Million Pages? An LLM Can Help.
Black and white photo of hundreds of stacked, labeled boxes, viewed from above.

In my MA thesis, I built one example of how GraphRAG can work for historians. From 20,000 early modern documents, I constructed a knowledge graph of 218,000 entities and 692,000 relationships, then tested eight retrieval systems on thirty historical questions of escalating difficulty and then grading each of them. Plain RAG scored 48.4 percent against the metrics of groundedness, completeness, accuracy, synthesis, and usefulness. The best off-the-shelf system reached only 61.6 percent, an unacceptable result for a careful historian.