Test-time Offline Reinforcement Learning on Goal-related Experience

This academic paper introduces **Goal-Conditioned Test-Time Training (GC-TTT)**, a novel approach that significantly enhances reinforcement learning policies by specializing them during evaluation. Unlike traditional methods that freeze policy parameters after initial training, GC-TTT **dynamically fine-tunes** a pre-trained policy on **goal-related experience** selected from the offline dataset. This selection process prioritizes data relevant to the agent's current state and optimal for achieving its goal, leading to **substantial performance gains** across various high-dimensional tasks. The authors demonstrate that GC-TTT effectively adapts policies at minimal computational cost, often outperforming simply scaling up model size. GC-TTT's ability to correct trajectories and adapt to immediate future actions makes it a promising advancement for robotic control and reasoning agents.