Elastic Decision Transformer
Free while signed in. Answers cite the passages they came from.
An advance over Decision Transformers that enables trajectory stitching at inference time.
Adaptive history length: Adjusts to shorter history at test time, enabling transitions to diverse and better future states.
Trajectory stitching: Unlike vanilla Decision Transformers that treat trajectories as fixed, EDT composes segments from different trajectories.
Offline RL gains: Achieves stronger performance on offline RL benchmarks where data quality and coverage vary.
Decision Transformer evolution: Part of the broader effort to make Decision Transformers competitive with Q-learning approaches on offline RL tasks.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack