Self-Knowledge Retrieval Augmented Generation Framework for Patent Matching Thanks: *Corresponding Author

Patent retrieval and matching is a critical issue in the field of intellectual property management [1, 14]. By identifying key information in patents and detecting patent documents with similar innovative concepts, it can effectively prevent intellectual property infringement [19] . However, patent documents possess complex structures and diverse data types, often containing multimodal data such as text and images, along with extensive descriptions using specialized terminology. These characteristics pose significant challenges to patent retrieval [17, 25]. The intricate vocabulary descriptions make it increasingly difficult to discern subtle differences between patents, resulting in insufficient precision in patent matching.

With the emergence of large language models (LLMs), retrieval and matching tasks have seen rapid advancements, and patent retrieval has gained substantial attention. However, when applying these LLM technologies to the patent matching domain, challenges such as domain-specific vocabulary mismatch and difficulties in understanding technical terms and invention details persist [12, 24]. To mitigate these issues, current applications of LLMs primarily focus on domain-specific knowledge acquisition and matching. Specifically, recent approaches include pre-training LLMs on specialized corpora [18] or constructing instruction-tuning datasets for specific tasks [21]. Nevertheless, these methods typically require substantial human effort in corpus or dataset construction and carry the risk of catastrophic forgetting during training [20]. An alternative strategy involves retrieval-augmented generation (RAG) using external knowledge [15, 6, 2], leveraging finer-grained information to reduce noise in the patent retrieval process and enhance the accuracy of patent analysis. While parsing patents into triple-based knowledge bases as context for LLMs can improve patent document comprehension [8, 23, 24], such approaches often overlook the potential of LLMs to automatically parse patents and construct inter-patent relationships.

To address these challenges, we propose a self-knowledge RAG framework that strategically leverages LLMs to autonomously extract knowledge from patent matching queries. This knowledge subsequently guides both the retrieval process and the generative matching phase, transforming the LLM from a passive reasoning tool into an active analysis and information mining system. The core of our proposed method is a structured pipeline. LLM performs an in-depth analysis of the patent matching request, extracting key technical entities and constructing a hierarchical ontology (e.g., technology, function, application). The self-mined entities and ontological structures are used to form an enriched query, enabling more accurate retrieval of similar patents via the FAISS retriever [9]. The original patent, retrieved similar patents, and self-mined entity-ontology structures are integrated into a concise yet information-rich instruction set. This allows the LLM to assimilate contextual patent knowledge, enhancing its comprehension of innovative aspects and improving the accuracy of search and generative matching.

The main contributions of this paper are as follows:

• •

  We designed a patent self-knowledge mining strategy based on LLMs, leveraging the model’s capability to automatically extract entity and ontology information from patents.

• •

  We introduced a self-knowledge guided RAG framework, which enhances FAISS vector index retrieval and generative matching through self-mined knowledge and query expansion, surpassing the performance of traditional methods such as Chain-of-Thought (CoT) and conventional RAG.

• •

  The effectiveness of our proposed method was validated on real-world patent datasets, and case studies further demonstrate the advantages of our approach.

Due to the strong diversity and structural complexity of patent documents, patent matching differs in focus from traditional patent retrieval. While patent retrieval concentrates on finding relevant patents, patent matching primarily addresses the similarity of technical innovations. Early patent matching methods mainly relied on keyword information [7, 11] or learned patent innovation similarity through embedded spaces [4, 10, 22]. These approaches failed to capture innovation similarities between patents, resulting in limited matching accuracy.

Recent patent matching research has primarily focused on frameworks constructed using LLMs, which leverage LLMs’ powerful semantic understanding and emergent capabilities [50,29,61] to learn professional terminology and concepts through training. MoZi [18] continuously trained LLMs on patent corpora and conducted instruction tuning for patent-related questions to enhance LLMs’ understanding of technical details in patent documents. PatentGPT [21] utilized external patent knowledge bases for pre-training to help LLMs capture relationships between patent entities. PatentGPT-Dense [5] further optimized human-reviewed matching behaviors through reinforcement learning from human feedback for matching alignment, demonstrating excellent performance in patent matching tasks.

Another strategy for utilizing large models adopts RAG framework [3, 13, 15] to enhance LLMs’ domain-specific capabilities. However, some studies have shown that noise in retrieved documents may cause comprehension biases in LLMs, leading to knowledge conflicts [28, 30] and performance degradation [16]. Some research has attempted to mitigate the impact of retrieval noise through graph-based RAG methods by refining retrieved documents to prevent LLM performance deterioration. Although these methods avoid domain-specific fine-tuning of LLMs and only use external knowledge such as knowledge triples to enhance response generation [8, 19, 23, 24], these RAG-based approaches fail to fully utilize retrieved data for comprehension enhancement and don’t effectively alleviate conflicts between LLMs’ parametric memory and external knowledge.

In the patent matching task, given a query patent $p_{q}$, the objective is to select the patent with high similarity of innovation from a set of $N$ candidate patents $\mathcal{P}=\{p_{A},p_{B},...,p_{N}\}$, where each candidate patent $p_{i}$ is associated with a corresponding label $y_{i}$. The patent matching task involves constructing a query framework that outputs the identifier $y_{i}$ of the candidate patent most relevant to the target patent in terms of innovative description.

where operator $\oplus$ denotes a concatenation operation, the large language model LLM takes query patent $p_{q}$ and candidate patent $\mathcal{P}$ as input, and outputs the identifier $y_{i}$ of the candidate patent most similar to $p_{q}$.

This study proposes a self-knowledge RAG framework for patent matching based on mining with LLMs. The framework guides the LLM to extract key entities and ontological information from the target patent, constructing a structured knowledge system through self-mined information to enhance the accuracy and reliability of retrieval and matching. This approach eliminates traditional steps such as keyword extraction and matching in conventional retrieval tasks, adopting a three-stage paradigm of ”Preparation-Retrieval-Reasoning.” The overall framework of the method is illustrated in Fig 1.

This paper proposes a novel patent matching framework that enhances the performance of RAG and LLM-based generative patent matching by mining intrinsic knowledge such as entities and ontologies from patents themselves. Our method effectively alleviates issues such as insufficient semantic understanding and poor retrieval accuracy in patent matching tasks, while also providing an interpretable approach to patent relevance by clarifying the rationale behind retrieval decisions. Future work will focus on dynamic ontology generation and integrating multimodal patent data (e.g., images and text) to further improve the model’s adaptability to real-world patent retrieval and matching scenarios.

We would like to thank the anonymous reviewers for their valuable comments. This work is supported by National Key Research and Development Program of China (2024YFF0907803).