Abstract: Several researchers have used deep learning to obtain novel feedback codes. Two such codes for AWGN channels with passive (possibly noisy) output feedback are Deepcode which employs a bit-by ...

We evaluate DeepCode on the PaperBench benchmark (released by OpenAI), a rigorous testbed requiring AI agents to independently reproduce 20 ICML 2024 papers from scratch. The benchmark comprises 8,316 ...

DeepCode achieves 75.9% on the 3-paper human evaluation subset, surpassing the best-of-3 human expert baseline (72.4%) by +3.5 percentage points. This demonstrates that our framework not only matches ...