read_file: Read file contents with flexible line range control edit_file: Make precise edits to files with clear instructions Supports complete file replacement ...
Abstract: Deep code models are vulnerable to adversarial attacks, making it possible for semantically identical inputs to trigger different responses. Current black-box attack methods typically ...
We evaluate DeepCode on the PaperBench benchmark (released by OpenAI), a rigorous testbed requiring AI agents to independently reproduce 20 ICML 2024 papers from scratch. The benchmark comprises 8,316 ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results
Feedback