defense arXiv Oct 9, 2025 · Oct 2025
Peiyang Liu, Ziqiang Cui, Di Liang et al. · Peking University · City University of Hong Kong +1 more
Watermarks RAG knowledge-base documents at semantic and lexical levels to detect unauthorized content appropriation by third-party RAG systems
Output Integrity Attack nlp
Retrieval-augmented generation (RAG) enhances Large Language Models (LLMs) by mitigating hallucinations and outdated information issues, yet simultaneously facilitates unauthorized data appropriation at scale. This paper addresses this challenge through two key contributions. First, we introduce RPD, a novel dataset specifically designed for RAG plagiarism detection that encompasses diverse professional domains and writing styles, overcoming limitations in existing resources. Second, we develop a dual-layered watermarking system that embeds protection at both semantic and lexical levels, complemented by an interrogator-detective framework that employs statistical hypothesis testing on accumulated evidence. Extensive experimentation demonstrates our approach's effectiveness across varying query volumes, defense prompts, and retrieval parameters, while maintaining resilience against adversarial evasion techniques. This work establishes a foundational framework for intellectual property protection in retrieval-augmented AI systems.
llm transformer Peking University · City University of Hong Kong · Fudan University