arXiv

Learning to See via Epiretinal Implant Stimulation in silico with Model-Based Deep Reinforcement Learning

Title: Enhancing Epiretinal Implant Perception Through Model-Based Deep Reinforcement Learning and In Silico Stimulation

Abstract

Objective: Conditions like retinitis pigmentosa and age-related macular degeneration lead to the deterioration of the photoreceptor layer. To counteract this vision loss, one therapeutic strategy involves electrically activating remaining retinal ganglion cells using microelectrode arrays, such as those found in epiretinal implants. However, these implants typically produce anisotropic, elongated visual percepts (phosphenes) that align with the axon fascicles of adjacent retinal ganglion cells. Previous studies suggest that by mapping these axon fascicles and either deactivating specific electrodes or reducing stimulation currents to avoid triggering them, it is possible to achieve more isotropic, pixel-like shapes. The primary goal of avoiding axon fascicle stimulation is to eliminate the "brushstroke" effect, thereby creating a simpler, more uniform set of pixel-like visual cues.

Approach: This research introduces a novel method using both isotropic and anisotropic shapes to render recognizable images for a virtual patient within the "rlretina" reinforcement learning environment. This environment frames the challenge as a stroke-based rendering task, where the system must effectively utilize brushstroke-like inputs.

Main Results: We developed a deep reinforcement learning agent capable of combining isotropic and anisotropic shapes to construct images. The study evaluates various error-based and perception-based metrics to determine the most effective reward signals for training the agent. Utilizing a psychophysically validated axon map model, the agent is trained via a model-based data generation approach to simulate how different virtual patients perceive the rendered images. Our findings indicate that the trained agent produces significantly more intelligible images than naive methods across various virtual patient simulations.

Significance: This study presents a fresh perspective on epiretinal stimulation, marking a foundational step toward enhancing visual acuity in artificial vision systems by leveraging anisotropic phosphenes.


Source: arXiv Generated at: 2026-06-03 00:00:00 UTC

Related Articles

TikTok Billionaire Tops Ambani as Asia’s Second-Richest
Bloomberg

TikTok Billionaire Tops Ambani as Asia’s Second-Richest

TikTok founder surpasses Mukesh Ambani to become Asia’s second-richest person, marking a significant shift in the region...

Publishers in UK can opt out of Google AI search results
BBC News

Publishers in UK can opt out of Google AI search results

UK publishers can now opt out of Google’s AI search summaries, a CMA ruling designed to boost their bargaining power and...

Kioxia Edges Nearer Toyota’s Market Cap in Shakeup to Japan Inc.
Bloomberg

Kioxia Edges Nearer Toyota’s Market Cap in Shakeup to Japan Inc.

Kioxia’s market cap nears Toyota’s, signaling a major shift in Japan’s corporate hierarchy. This narrowing gap highlight...

Reuters

Morning Bid: Marvell, a fitting name for the latest AI darling

Reuters highlights Marvell as a top AI stock, noting its name perfectly suits its status as the newest market darling.

Financial Times

Tim Hayward: I built the Jaguar E-Type of computer keyboards

Tim Hayward compares his bespoke keyboard designs to the Jaguar E-Type. He explores high-end customization for personal ...

Financial Times

AI Labs: Zuckerberg’s $100bn gamble

Meta’s $100 billion AI investment aims to secure AI dominance, but questions remain whether sheer spending can outpace c...