Sandbox benchmarks

How fast a sandbox starts, runs a command and gets a coding agent's reply: 11,066 test runs against production, 2026-11-02 to 2026-11-09.

New sandbox
1.5s
p95 12s
First command
1.7s
p95 8s
First reply, fastest agent
2.9s
p95 11s
Resume
4.7s
p95 11s
Fork a snapshot
1.9s
p95 17s
16 branches
13s
p95 37s

Lifecycle, base image

500ms2s5s20snp95p50Create20211s2sSnapshot2004.4s2sStop2026.3s1.2sResume19411s4.7sRestore20013s1.5sBranch19422s6.1sDelete child1884.8s1.7sDelete snapshot1944.8s629msDelete19621s2.1s
500ms5s20snp95p50Create20211s2sSnapshot2004.4s2sStop2026.3s1.2sResume19411s4.7sRestore20013s1.5sBranch19422s6.1sDelete child1884.8s1.7sDelete snapshot1944.8s629msDelete19621s2.1s
Lifecycle, base image by setup
Setupp50p95n
Create2s (2s to 2.2s)11s (9.1s to 17s)202
Snapshot2s (1.6s to 2.2s)4.4s (3.9s to 20s)200
Stop1.2s (1.1s to 1.4s)6.3s (4.9s to 7.5s)202
Resume4.7s (4.4s to 5.1s)11s (9.2s to 12s)194
Restore1.5s (1.4s to 2.1s)13s (8.9s to 29s)200
Branch6.1s (5s to 7s)22s (19s to 40s)194
Delete child1.7s (1.5s to 2s)4.8s (3.9s to 8.5s)188
Delete snapshot629ms (574ms to 685ms)4.8s (2.9s to 10s)194
Delete2.1s (1.9s to 2.6s)21s (18s to 27s)196

Lifecycle, desktop image

500ms2s5s20snp95p50Create18916s5.2sSnapshot1888.1s1.8sStop1895.3s1.4sResume1849.8s3.5sRestore18415s1.5sBranch17633s8.7sDelete child1725.7s1.7sDelete snapshot1843.7s589msDelete18219s1.8s
500ms5s20snp95p50Create18916s5.2sSnapshot1888.1s1.8sStop1895.3s1.4sResume1849.8s3.5sRestore18415s1.5sBranch17633s8.7sDelete child1725.7s1.7sDelete snapshot1843.7s589msDelete18219s1.8s
Lifecycle, desktop image by setup
Setupp50p95n
Create5.2s (4.7s to 6s)16s (14s to 21s)189
Snapshot1.8s (1.6s to 2s)8.1s (6.1s to 12s)188
Stop1.4s (1.2s to 1.6s)5.3s (4.8s to 7.1s)189
Resume3.5s (3.1s to 4.3s)9.8s (7.9s to 15s)184
Restore1.5s (1.1s to 2s)15s (12s to 23s)184
Branch8.7s (6.9s to 9.5s)33s (25s to 44s)176
Delete child1.7s (1.5s to 1.8s)5.7s (5.1s to 10s)172
Delete snapshot589ms (558ms to 635ms)3.7s (2.8s to 6.7s)184
Delete1.8s (1.7s to 2.2s)19s (16s to 45s)182

By region

1s2s5s10snp95p50Create, eu115712s1.6sCreate, us123614s1.4sFirst command, eu1296.9s1.6sFirst command, us14518s1.9sFork, eu114124s1.8sFork, us128410s2sFirst reply, eu120927s7.6sFirst reply, us127526s7.3s
1s5s20snp95p50Create, eu115712s1.6sCreate, us123614s1.4sFirst command, eu1296.9s1.6sFirst command, us14518s1.9sFork, eu114124s1.8sFork, us128410s2sFirst reply, eu120927s7.6sFirst reply, us127526s7.3s
By region by setup
Setupp50p95n
Create, eu11.6s (1.4s to 1.8s)12s (8.7s to 24s)157
Create, us11.4s (1.3s to 1.8s)14s (10s to 20s)236
First command, eu11.6s (1.4s to 2.9s)6.9s (3.5s to 6.9s)29
First command, us11.9s (1.2s to 2.9s)18s (6.3s to 24s)45
Fork, eu11.8s (1.4s to 2.2s)24s (23s to 29s)141
Fork, us12s (1.7s to 2.3s)10s (6.3s to 13s)284
First reply, eu17.6s (6.6s to 8.8s)27s (25s to 28s)209
First reply, us17.3s (6.1s to 8.1s)26s (22s to 31s)275

First reply, from create

2s5s10s20snp95p50Factory Droid4211s2.9sCodexCodex4418s3.3sPrime AgentPrime Agent418.8s3.3sClaude CodeClaude Code4512s3.4sPiPi4215s5sKimi CodeKimi Code4115s6.5sOpenCodeOpenCode4519s7.4sHermesHermes4222s13sHermes over ACP4131s18sOpenClawOpenClaw4130s25s
2s10snp95p50Factory Droid4211s2.9sCodexCodex4418s3.3sPrime AgentPrime Agent418.8s3.3sClaude CodeClaude Code4512s3.4sPiPi4215s5sKimi CodeKimi Code4115s6.5sOpenCodeOpenCode4519s7.4sHermesHermes4222s13sHermes over ACP4131s18sOpenClawOpenClaw4130s25s
First reply, from create by setup
Setupp50p95n
Factory Droid2.9s (2.6s to 5.2s)11s (8.1s to 20s)42
Codex3.3s (2.3s to 5.3s)18s (11s to 30s)44
Prime Agent3.3s (2.5s to 3.8s)8.8s (7.2s to 19s)41
Claude Code3.4s (2.7s to 4.8s)12s (7.9s to 23s)45
Pi5s (4.5s to 6.7s)15s (12s to 22s)42
Kimi Code6.5s (5s to 8.4s)15s (12s to 22s)41
OpenCode7.4s (6s to 8.8s)19s (16s to 37s)45
Hermes13s (10s to 16s)22s (19s to 28s)42
Hermes over ACP18s (15s to 20s)31s (28s to 38s)41
OpenClaw25s (21s to 26s)30s (28s to 34s)41

First reply, sandbox running

500ms2s5s20snp95p50CodexCodex611.1s658msPrime AgentPrime Agent571.8s800msClaude CodeClaude Code621.6s1.1sFactory Droid593.7s1.2sPiPi584.3s1.7sKimi CodeKimi Code585.3s3.1sOpenCodeOpenCode625.7s3.4sHermesHermes5920s9.2sHermes over ACP5725s13sOpenClawOpenClaw5826s19s
500ms5snp95p50CodexCodex611.1s658msPrime AgentPrime Agent571.8s800msClaude CodeClaude Code621.6s1.1sFactory Droid593.7s1.2sPiPi584.3s1.7sKimi CodeKimi Code585.3s3.1sOpenCodeOpenCode625.7s3.4sHermesHermes5920s9.2sHermes over ACP5725s13sOpenClawOpenClaw5826s19s
First reply, sandbox running by setup
Setupp50p95n
Codex658ms (562ms to 701ms)1.1s (1.1s to 1.6s)61
Prime Agent800ms (674ms to 890ms)1.8s (1.1s to 3.9s)57
Claude Code1.1s (994ms to 1.2s)1.6s (1.4s to 2.1s)62
Factory Droid1.2s (1.1s to 1.4s)3.7s (1.8s to 6.2s)59
Pi1.7s (1.4s to 1.9s)4.3s (3.7s to 5.1s)58
Kimi Code3.1s (2.9s to 3.4s)5.3s (4.7s to 7.7s)58
OpenCode3.4s (3.2s to 3.9s)5.7s (4.6s to 6.3s)62
Hermes9.2s (7.8s to 10s)20s (13s to 24s)59
Hermes over ACP13s (12s to 17s)25s (21s to 30s)57
OpenClaw19s (18s to 21s)26s (25s to 32s)58

Inside an agent turn

100ms1s10snp95p50Open the stream5413.1s1sStart the run5912.3s82msSpawn the agent5651.4s158msAgent ready28816s714msFirst model request1034.9s1.3sFirst model byte1035.2s1.4sFirst token59123s3.8sFirst text59121s2.4sText reaches you5913s974msTask complete59123s4.1s
100ms10snp95p50Open the stream5413.1s1sStart the run5912.3s82msSpawn the agent5651.4s158msAgent ready28816s714msFirst model request1034.9s1.3sFirst model byte1035.2s1.4sFirst token59123s3.8sFirst text59121s2.4sText reaches you5913s974msTask complete59123s4.1s
Inside an agent turn by setup
Setupp50p95n
Open the stream1s (954ms to 1.2s)3.1s (2.8s to 4.2s)541
Start the run82ms (75ms to 92ms)2.3s (1.5s to 2.8s)591
Spawn the agent158ms (147ms to 169ms)1.4s (962ms to 2.5s)565
Agent ready714ms (654ms to 832ms)16s (15s to 20s)288
First model request1.3s (866ms to 2.2s)4.9s (4.2s to 6s)103
First model byte1.4s (1.1s to 2.5s)5.2s (4.3s to 6.2s)103
First token3.8s (3.4s to 4.2s)23s (21s to 25s)591
First text2.4s (1.8s to 2.9s)21s (19s to 23s)591
Text reaches you974ms (896ms to 1.1s)3s (2.6s to 3.7s)591
Task complete4.1s (3.6s to 4.4s)23s (21s to 25s)591

New sandbox, daily

1s2s5s10s20s50s10-2610-3010-3111-0111-0211-0311-0411-0511-0611-0711-0811-09p50p95p50 · Day: 10-26 · Time: 2.5s · 6 samplesp50 · Day: 10-30 · Time: 1.5s · 6 samplesp50 · Day: 10-31 · Time: 1.6s · 36 samplesp50 · Day: 11-01 · Time: 802ms · 6 samplesp50 · Day: 11-02 · Time: 997ms · 12 samplesp50 · Day: 11-03 · Time: 3.7s · 53 samplesp50 · Day: 11-04 · Time: 3.6s · 60 samplesp50 · Day: 11-05 · Time: 5.5s · 67 samplesp50 · Day: 11-06 · Time: 5.2s · 43 samplesp50 · Day: 11-07 · Time: 2.5s · 72 samplesp50 · Day: 11-08 · Time: 3.9s · 43 samplesp50 · Day: 11-09 · Time: 1.4s · 53 samplesp95 · Day: 10-26 · Time: 1m 11s · 6 samplesp95 · Day: 10-30 · Time: 2.2s · 6 samplesp95 · Day: 10-31 · Time: 17s · 36 samplesp95 · Day: 11-01 · Time: 3.9s · 6 samplesp95 · Day: 11-02 · Time: 2.7s · 12 samplesp95 · Day: 11-03 · Time: 28s · 53 samplesp95 · Day: 11-04 · Time: 13s · 60 samplesp95 · Day: 11-05 · Time: 14s · 67 samplesp95 · Day: 11-06 · Time: 14s · 43 samplesp95 · Day: 11-07 · Time: 17s · 72 samplesp95 · Day: 11-08 · Time: 11s · 43 samplesp95 · Day: 11-09 · Time: 11s · 53 samples
1s2s5s10s20s50s10-2610-3010-3111-0111-0211-0311-0411-0511-0611-0711-0811-09p50p95p50 · Day: 10-26 · Time: 2.5s · 6 samplesp50 · Day: 10-30 · Time: 1.5s · 6 samplesp50 · Day: 10-31 · Time: 1.6s · 36 samplesp50 · Day: 11-01 · Time: 802ms · 6 samplesp50 · Day: 11-02 · Time: 997ms · 12 samplesp50 · Day: 11-03 · Time: 3.7s · 53 samplesp50 · Day: 11-04 · Time: 3.6s · 60 samplesp50 · Day: 11-05 · Time: 5.5s · 67 samplesp50 · Day: 11-06 · Time: 5.2s · 43 samplesp50 · Day: 11-07 · Time: 2.5s · 72 samplesp50 · Day: 11-08 · Time: 3.9s · 43 samplesp50 · Day: 11-09 · Time: 1.4s · 53 samplesp95 · Day: 10-26 · Time: 1m 11s · 6 samplesp95 · Day: 10-30 · Time: 2.2s · 6 samplesp95 · Day: 10-31 · Time: 17s · 36 samplesp95 · Day: 11-01 · Time: 3.9s · 6 samplesp95 · Day: 11-02 · Time: 2.7s · 12 samplesp95 · Day: 11-03 · Time: 28s · 53 samplesp95 · Day: 11-04 · Time: 13s · 60 samplesp95 · Day: 11-05 · Time: 14s · 67 samplesp95 · Day: 11-06 · Time: 14s · 43 samplesp95 · Day: 11-07 · Time: 17s · 72 samplesp95 · Day: 11-08 · Time: 11s · 43 samplesp95 · Day: 11-09 · Time: 11s · 53 samples
Time by Day
SetupDayTimeObservationsRecorded intervalRecorded annotation
p5010-262.5s6 samplesnot recorded
p5010-301.5s6 samplesnot recorded
p5010-311.6s36 samplesnot recorded
p5011-01802ms6 samplesnot recorded
p5011-02997ms12 samplesnot recorded
p5011-033.7s53 samplesnot recorded
p5011-043.6s60 samplesnot recorded
p5011-055.5s67 samplesnot recorded
p5011-065.2s43 samplesnot recorded
p5011-072.5s72 samplesnot recorded
p5011-083.9s43 samplesnot recorded
p5011-091.4s53 samplesnot recorded
p9510-261m 11s6 samplesnot recorded
p9510-302.2s6 samplesnot recorded
p9510-3117s36 samplesnot recorded
p9511-013.9s6 samplesnot recorded
p9511-022.7s12 samplesnot recorded
p9511-0328s53 samplesnot recorded
p9511-0413s60 samplesnot recorded
p9511-0514s67 samplesnot recorded
p9511-0614s43 samplesnot recorded
p9511-0717s72 samplesnot recorded
p9511-0811s43 samplesnot recorded
p9511-0911s53 samplesnot recorded

First reply, daily

5s10s20s50s10-2410-2610-3010-3111-0211-0311-0411-0511-0611-0711-0811-09p50p95p50 · Day: 10-24 · Time: 6s · 20 samplesp50 · Day: 10-26 · Time: 15s · 21 samplesp50 · Day: 10-30 · Time: 4.8s · 18 samplesp50 · Day: 10-31 · Time: 6.4s · 42 samplesp50 · Day: 11-02 · Time: 5.4s · 30 samplesp50 · Day: 11-03 · Time: 9.5s · 77 samplesp50 · Day: 11-04 · Time: 10s · 60 samplesp50 · Day: 11-05 · Time: 9.7s · 46 samplesp50 · Day: 11-06 · Time: 5s · 30 samplesp50 · Day: 11-07 · Time: 4.5s · 96 samplesp50 · Day: 11-08 · Time: 6.2s · 85 samplesp50 · Day: 11-09 · Time: 4.4s · 90 samplesp95 · Day: 10-24 · Time: 17s · 20 samplesp95 · Day: 10-26 · Time: 1m 11s · 21 samplesp95 · Day: 10-30 · Time: 19s · 18 samplesp95 · Day: 10-31 · Time: 58s · 42 samplesp95 · Day: 11-02 · Time: 24s · 30 samplesp95 · Day: 11-03 · Time: 27s · 77 samplesp95 · Day: 11-04 · Time: 28s · 60 samplesp95 · Day: 11-05 · Time: 27s · 46 samplesp95 · Day: 11-06 · Time: 30s · 30 samplesp95 · Day: 11-07 · Time: 26s · 96 samplesp95 · Day: 11-08 · Time: 25s · 85 samplesp95 · Day: 11-09 · Time: 28s · 90 samples
5s10s20s50s10-2410-2610-3010-3111-0211-0311-0411-0511-0611-0711-0811-09p50p95p50 · Day: 10-24 · Time: 6s · 20 samplesp50 · Day: 10-26 · Time: 15s · 21 samplesp50 · Day: 10-30 · Time: 4.8s · 18 samplesp50 · Day: 10-31 · Time: 6.4s · 42 samplesp50 · Day: 11-02 · Time: 5.4s · 30 samplesp50 · Day: 11-03 · Time: 9.5s · 77 samplesp50 · Day: 11-04 · Time: 10s · 60 samplesp50 · Day: 11-05 · Time: 9.7s · 46 samplesp50 · Day: 11-06 · Time: 5s · 30 samplesp50 · Day: 11-07 · Time: 4.5s · 96 samplesp50 · Day: 11-08 · Time: 6.2s · 85 samplesp50 · Day: 11-09 · Time: 4.4s · 90 samplesp95 · Day: 10-24 · Time: 17s · 20 samplesp95 · Day: 10-26 · Time: 1m 11s · 21 samplesp95 · Day: 10-30 · Time: 19s · 18 samplesp95 · Day: 10-31 · Time: 58s · 42 samplesp95 · Day: 11-02 · Time: 24s · 30 samplesp95 · Day: 11-03 · Time: 27s · 77 samplesp95 · Day: 11-04 · Time: 28s · 60 samplesp95 · Day: 11-05 · Time: 27s · 46 samplesp95 · Day: 11-06 · Time: 30s · 30 samplesp95 · Day: 11-07 · Time: 26s · 96 samplesp95 · Day: 11-08 · Time: 25s · 85 samplesp95 · Day: 11-09 · Time: 28s · 90 samples
Time by Day
SetupDayTimeObservationsRecorded intervalRecorded annotation
p5010-246s20 samplesnot recorded
p5010-2615s21 samplesnot recorded
p5010-304.8s18 samplesnot recorded
p5010-316.4s42 samplesnot recorded
p5011-025.4s30 samplesnot recorded
p5011-039.5s77 samplesnot recorded
p5011-0410s60 samplesnot recorded
p5011-059.7s46 samplesnot recorded
p5011-065s30 samplesnot recorded
p5011-074.5s96 samplesnot recorded
p5011-086.2s85 samplesnot recorded
p5011-094.4s90 samplesnot recorded
p9510-2417s20 samplesnot recorded
p9510-261m 11s21 samplesnot recorded
p9510-3019s18 samplesnot recorded
p9510-3158s42 samplesnot recorded
p9511-0224s30 samplesnot recorded
p9511-0327s77 samplesnot recorded
p9511-0428s60 samplesnot recorded
p9511-0527s46 samplesnot recorded
p9511-0630s30 samplesnot recorded
p9511-0726s96 samplesnot recorded
p9511-0825s85 samplesnot recorded
p9511-0928s90 samplesnot recorded

Fork a snapshot, daily

1s2s5s10s20s10-2610-3111-0111-0211-0311-0411-0511-0611-0711-0811-09p50p95p50 · Day: 10-26 · Time: 3.6s · 26 samplesp50 · Day: 10-31 · Time: 3.6s · 86 samplesp50 · Day: 11-01 · Time: 1.8s · 24 samplesp50 · Day: 11-02 · Time: 947ms · 24 samplesp50 · Day: 11-03 · Time: 1.7s · 110 samplesp50 · Day: 11-04 · Time: 2s · 100 samplesp50 · Day: 11-05 · Time: 2.9s · 96 samplesp50 · Day: 11-06 · Time: 1.1s · 36 samplesp50 · Day: 11-07 · Time: 3.2s · 18 samplesp50 · Day: 11-08 · Time: 3.5s · 21 samplesp50 · Day: 11-09 · Time: 2.6s · 20 samplesp95 · Day: 10-26 · Time: 33s · 26 samplesp95 · Day: 10-31 · Time: 4.8s · 86 samplesp95 · Day: 11-01 · Time: 3.3s · 24 samplesp95 · Day: 11-02 · Time: 1.5s · 24 samplesp95 · Day: 11-03 · Time: 6.2s · 110 samplesp95 · Day: 11-04 · Time: 6.3s · 100 samplesp95 · Day: 11-05 · Time: 25s · 96 samplesp95 · Day: 11-06 · Time: 6.7s · 36 samplesp95 · Day: 11-07 · Time: 8.4s · 18 samplesp95 · Day: 11-08 · Time: 10s · 21 samplesp95 · Day: 11-09 · Time: 17s · 20 samples
1s2s5s10s20s10-2610-3111-0111-0211-0311-0411-0511-0611-0711-0811-09p50p95p50 · Day: 10-26 · Time: 3.6s · 26 samplesp50 · Day: 10-31 · Time: 3.6s · 86 samplesp50 · Day: 11-01 · Time: 1.8s · 24 samplesp50 · Day: 11-02 · Time: 947ms · 24 samplesp50 · Day: 11-03 · Time: 1.7s · 110 samplesp50 · Day: 11-04 · Time: 2s · 100 samplesp50 · Day: 11-05 · Time: 2.9s · 96 samplesp50 · Day: 11-06 · Time: 1.1s · 36 samplesp50 · Day: 11-07 · Time: 3.2s · 18 samplesp50 · Day: 11-08 · Time: 3.5s · 21 samplesp50 · Day: 11-09 · Time: 2.6s · 20 samplesp95 · Day: 10-26 · Time: 33s · 26 samplesp95 · Day: 10-31 · Time: 4.8s · 86 samplesp95 · Day: 11-01 · Time: 3.3s · 24 samplesp95 · Day: 11-02 · Time: 1.5s · 24 samplesp95 · Day: 11-03 · Time: 6.2s · 110 samplesp95 · Day: 11-04 · Time: 6.3s · 100 samplesp95 · Day: 11-05 · Time: 25s · 96 samplesp95 · Day: 11-06 · Time: 6.7s · 36 samplesp95 · Day: 11-07 · Time: 8.4s · 18 samplesp95 · Day: 11-08 · Time: 10s · 21 samplesp95 · Day: 11-09 · Time: 17s · 20 samples
Time by Day
SetupDayTimeObservationsRecorded intervalRecorded annotation
p5010-263.6s26 samplesnot recorded
p5010-313.6s86 samplesnot recorded
p5011-011.8s24 samplesnot recorded
p5011-02947ms24 samplesnot recorded
p5011-031.7s110 samplesnot recorded
p5011-042s100 samplesnot recorded
p5011-052.9s96 samplesnot recorded
p5011-061.1s36 samplesnot recorded
p5011-073.2s18 samplesnot recorded
p5011-083.5s21 samplesnot recorded
p5011-092.6s20 samplesnot recorded
p9510-2633s26 samplesnot recorded
p9510-314.8s86 samplesnot recorded
p9511-013.3s24 samplesnot recorded
p9511-021.5s24 samplesnot recorded
p9511-036.2s110 samplesnot recorded
p9511-046.3s100 samplesnot recorded
p9511-0525s96 samplesnot recorded
p9511-066.7s36 samplesnot recorded
p9511-078.4s18 samplesnot recorded
p9511-0810s21 samplesnot recorded
p9511-0917s20 samplesnot recorded

Inside create

10ms100ms1s10snp95p50Pick a host3755.6s15msSign the token202408ms12msWorker checks345237ms67msHost starts it1813.2s193msOrchestrator38012s965msReady39312s1.5s
10ms1snp95p50Pick a host3755.6s15msSign the token202408ms12msWorker checks345237ms67msHost starts it1813.2s193msOrchestrator38012s965msReady39312s1.5s
Inside create by setup
Setupp50p95n
Pick a host15ms (11ms to 21ms)5.6s (4.6s to 11s)375
Sign the token12ms (9ms to 22ms)408ms (343ms to 1.1s)202
Worker checks67ms (61ms to 71ms)237ms (206ms to 407ms)345
Host starts it193ms (167ms to 227ms)3.2s (2.4s to 8.8s)181
Orchestrator965ms (807ms to 1.1s)12s (10s to 16s)380
Ready1.5s (1.4s to 1.7s)12s (11s to 16s)393

First model call

1s10snp95p50Direct694.2s1.3sExec694.2s1.4sTerminal694.9s2.3sStartup script7021s8.1s
1s10snp95p50Direct694.2s1.3sExec694.2s1.4sTerminal694.9s2.3sStartup script7021s8.1s
First model call by setup
Setupp50p95n
Direct1.3s (797ms to 2s)4.2s (3.6s to 5.8s)69
Exec1.4s (883ms to 1.8s)4.2s (3.8s to 5.7s)69
Terminal2.3s (1.9s to 2.7s)4.9s (4.3s to 5.9s)69
Startup script8.1s (7.2s to 9.5s)21s (18s to 2m 1s)70

Snapshots and checkpoints

1s2s5s10s20snp95p50Snapshot4246.1s1.5sFork a snapshot42517s1.9sCheckpoint1645.2s1.3sFork a checkpoint16410s1.7s
1s5s20snp95p50Snapshot4246.1s1.5sFork a snapshot42517s1.9sCheckpoint1645.2s1.3sFork a checkpoint16410s1.7s
Snapshots and checkpoints by setup
Setupp50p95n
Snapshot1.5s (1.4s to 1.5s)6.1s (4.9s to 7.6s)424
Fork a snapshot1.9s (1.7s to 2.2s)17s (11s to 24s)425
Checkpoint1.3s (1.1s to 1.6s)5.2s (4.2s to 8.8s)164
Fork a checkpoint1.7s (1.5s to 2.2s)10s (8.4s to 26s)164

First command

200ms1s5snp95p50Create747.8s1.3sRun it74527ms221msBoth748s1.7s
200ms1s5snp95p50Create747.8s1.3sRun it74527ms221msBoth748s1.7s
First command by setup
Setupp50p95n
Create1.3s (1.1s to 2.2s)7.8s (5s to 23s)74
Run it221ms (152ms to 267ms)527ms (428ms to 2.3s)74
Both1.7s (1.4s to 2.5s)8s (6.3s to 24s)74

Create by size

1s10snp95p50Nano6920s2sSmall6920s2.8sMedium6721s3sLarge691m 28s4s
1s10snp95p50Nano6920s2sSmall6920s2.8sMedium6721s3sLarge691m 28s4s
Create by size by setup
Setupp50p95n
Nano2s (1.4s to 3.6s)20s (12s to 33s)69
Small2.8s (1.7s to 3.9s)20s (12s to 33s)69
Medium3s (2s to 3.9s)21s (11s to 1m 48s)67
Large4s (1.5s to 7.3s)1m 28s (32s to 2m)69

Branching

2s10s50snp95p501 child15710s2.8s4 children15320s4s16 children14737s13s
2s5s20s50snp95p501 child15710s2.8s4 children15320s4s16 children14737s13s
Branching by setup
Setupp50p95n
1 child2.8s (2.5s to 3.3s)10s (8.2s to 30s)157
4 children4s (3.5s to 4.9s)20s (15s to 51s)153
16 children13s (10s to 16s)37s (28s to 1m 7s)147

Many at once

1s5snp95p5010 at once10–1.4s25 at once25–4s100 at once720s14s
1s2s5s10snp95p5010 at once10–1.4s25 at once25–4s100 at once720s14s
Many at once by setup
Setupp50p95n
10 at once1.4snot recorded10
25 at once4snot recorded25
100 at once14s (8.8s to 20s)20s (15s to 20s)7

Peak memory by coding agent

030060090012001500MiB152CodexCodex224Prime AgentPrimeAgent233Claude CodeClaudeCode233PiPi243Kimi CodeKimi Code315FactoryDroid485HermesHermes591OpenCodeOpenCode968Hermesover ACP1336OpenClawOpenClaw
030060090012001500MiB152CodexCodex224Prime AgentPrimeAgent233Claude CodeClaudeCode233PiPi243Kimi CodeKimi Code315FactoryDroid485HermesHermes591OpenCodeOpenCode968Hermesover ACP1336OpenClawOpenClaw
MiB by setup
SetupMiBObservationsRecorded interval
Codex15244 runs151–154 (95% binomial rank)
Prime Agent22441 runs194–226 (95% binomial rank)
Claude Code23345 runs229–248 (95% binomial rank)
Pi23342 runs214–237 (95% binomial rank)
Kimi Code24341 runs226–256 (95% binomial rank)
Factory Droid31542 runs311–354 (95% binomial rank)
Hermes48542 runs467–490 (95% binomial rank)
OpenCode59145 runs556–660 (95% binomial rank)
Hermes over ACP96841 runs959–980 (95% binomial rank)
OpenClaw133641 runs1305–1381 (95% binomial rank)

Peak memory of the whole sandbox from start to the agent's reply, for the prompt "Reply with exactly READY" answered by Tangle's synthetic test model (tangle/canary-echo), which replies without calling a real model. Median of 41 to 45 runs per agent, each in a fresh sandbox, 2026-11-02 to 2026-11-09; with a real model the numbers differ. A sandbox with no agent in it peaks at 136 MiB (median of 61 runs). The Hermes over ACP bar includes a GitHub Copilot CLI that Hermes started in the sandbox.

Runs that passed their checks

0%20%40%60%80%100%Share of runs97%First modelcall246/25397%Computechecks2357/243495%Creatematrix824/87192%First reply423/45886%Lifecycle308/36085%Full suite2754/324783%Snapshotforks352/42557%Branching174/306
0%20%40%60%80%100%Share of runs97%Firstmodelcall246/25397%Computechecks2357/2…95%Creatematrix824/87192%First reply423/45886%Lifecycle308/36085%Full suite2754/3…83%Snapshotforks352/42557%Branching174/306
Share of runs by setup
SetupShare of runsObservationsRecorded interval
First model call97%253 runs94%–99% (95% Wilson score)
Compute checks97%2434 runs96%–97% (95% Wilson score)
Create matrix95%871 runs93%–96% (95% Wilson score)
First reply92%458 runs90%–94% (95% Wilson score)
Lifecycle86%360 runs82%–89% (95% Wilson score)
Full suite85%3247 runs84%–86% (95% Wilson score)
Snapshot forks83%425 runs79%–86% (95% Wilson score)
Branching57%306 runs51%–62% (95% Wilson score)