Global News Digest

arXiv

Persona Attack: Incremental Memory Injection Jailbreak Attack against Large Language Models

Title: Persona Attack: Incremental Memory Injection Jailbreak Attack against Large Language Models

Abstract:

Despite continuous advancements in safety training, Large Language Models (LLMs) remain susceptible to jailbreak attacks as they become more user-friendly. Conventional jailbreak strategies generally rely on isolated prompt injections, often overlooking the model’s capacity to retain conversational context and user directives over time. This study introduces Persona Attack, a novel jailbreak technique grounded in memory injection that systematically manipulates the model’s context window through a sequential process. Our experiments, conducted across several prominent LLMs, indicate that as injected instructions accumulate within the model's memory, these directives increasingly supersede the models' internal safety alignments. Additionally, our empirical findings show that the effectiveness of the attack is influenced by both the specific memory architecture of the model and the particular combination of instructions employed, achieving an attack success rate as high as 95% under certain instructional configurations.


Source: arXiv Generated at: 2026-06-02 00:00:00 UTC

Related Articles

Schroders Renewable Unit Targets AI Assets as Power Demand Soars
Bloomberg

Schroders Renewable Unit Targets AI Assets as Power Demand Soars

Schroders’ renewable unit targets AI infrastructure, pivoting to meet soaring energy demand from artificial intelligence...

State Street's Paglia on SBI Group Partnership, ETFs
Bloomberg

State Street's Paglia on SBI Group Partnership, ETFs

State Street's Paglia discusses the SBI Group partnership and ETFs, but the source text is missing. Please provide the a...

Nvidia Boss Says Workers Should Be Paid ‘as Much as Possible’
Bloomberg

Nvidia Boss Says Workers Should Be Paid ‘as Much as Possible’

Nvidia CEO Jensen Huang advocates for paying workers “as much as possible,” emphasizing maximum compensation. This stanc...

TSE Talking With Regulator For Easing ETF Listing Rules
Bloomberg

TSE Talking With Regulator For Easing ETF Listing Rules

The Tokyo Stock Exchange is discussing with regulators to ease ETF listing rules. This aims to simplify market access an...

S&P DJI CEO on Japan Markets, Mega IPOs
Bloomberg

S&P DJI CEO on Japan Markets, Mega IPOs

S&P DJI CEO discusses Japan's financial markets and major IPOs.