Public AI sandbox benchmarks
We do not run speed benchmarks ourselves. We cite the public ones, with the date of each run, so you can see where they agree and where they differ.
Sources
- ComputeSDK benchmarks: Weekly. 100 sandboxes started at once per provider, plus a repo clone, install and typecheck run. Run by ComputeSDK, which takes sponsorship from providers.
- aisandboxbench: One run in October 2026 from one US server, 4 vCPU / 8 GB on every provider, through its own SDK.
- StarSling HPC sandbox benchmarks: One run on 2026-09-29: real CI pipelines and CPU, memory, disk and network tests on 4 vCPU / 8 GB. Start-up time is not measured.
Agent37 Cloud
| Benchmark | Test | Result | Rank | Data from |
|---|---|---|---|---|
| ComputeSDK benchmarks | Burst start time (median of 100 at once) | 3,832 ms | 23 of 27 | 2026-11-13 |
| ComputeSDK benchmarks | Repo clone, install and typecheck (one run) | 193,271 ms | 25 of 25 | 2026-11-13 |
Blaxel
| Benchmark | Test | Result | Rank | Data from |
|---|---|---|---|---|
| ComputeSDK benchmarks | Burst start time (median of 100 at once) | 351 ms | 7 of 27 | 2026-11-13 |
| ComputeSDK benchmarks | Repo clone, install and typecheck (one run) | 60,706 ms | 12 of 25 | 2026-11-13 |
| StarSling HPC sandbox benchmarks | Node.js web tooling (runs per second) | 19.48 runs/s | 6 of 12 | 2026-09-29 |
| StarSling HPC sandbox benchmarks | Better Auth cold dependency install | 12.1 s | 3 of 11 | 2026-09-29 |
boat
| Benchmark | Test | Result | Rank | Data from |
|---|---|---|---|---|
| aisandboxbench | Cold start (median) | 1.125 s | 6 of 9 | 2026-10-23 |
| aisandboxbench | Agent tool-call replay (median) | 43.256 s | 9 of 9 | 2026-10-23 |
| StarSling HPC sandbox benchmarks | Node.js web tooling (runs per second) | 26.69 runs/s | 1 of 12 | 2026-09-29 |
| StarSling HPC sandbox benchmarks | Better Auth cold dependency install | 18.7 s | 7 of 11 | 2026-09-29 |
Cloudflare Sandbox SDK
| Benchmark | Test | Result | Rank | Data from |
|---|---|---|---|---|
| ComputeSDK benchmarks | Repo clone, install and typecheck (one run) | 107,110 ms | 24 of 25 | 2026-11-13 |
Daytona
| Benchmark | Test | Result | Rank | Data from |
|---|---|---|---|---|
| ComputeSDK benchmarks | Burst start time (median of 100 at once) | 682 ms | 12 of 27 | 2026-11-13 |
| aisandboxbench | Cold start (median) | 1.25 s | 8 of 9 | 2026-10-23 |
| aisandboxbench | Agent tool-call replay (median) | 12.274 s | 1 of 9 | 2026-10-23 |
| StarSling HPC sandbox benchmarks | Node.js web tooling (runs per second) | 21.52 runs/s | 3 of 12 | 2026-09-29 |
| StarSling HPC sandbox benchmarks | Better Auth cold dependency install | 11.8 s | 2 of 11 | 2026-09-29 |
E2B
| Benchmark | Test | Result | Rank | Data from |
|---|---|---|---|---|
| ComputeSDK benchmarks | Burst start time (median of 100 at once) | 1,280 ms | 18 of 27 | 2026-11-13 |
| ComputeSDK benchmarks | Repo clone, install and typecheck (one run) | 64,219 ms | 15 of 25 | 2026-11-13 |
| aisandboxbench | Cold start (median) | 0.793 s | 4 of 9 | 2026-10-23 |
| aisandboxbench | Agent tool-call replay (median) | 15.468 s | 3 of 9 | 2026-10-23 |
| StarSling HPC sandbox benchmarks | Node.js web tooling (runs per second) | 12.61 runs/s | 11 of 12 | 2026-09-29 |
| StarSling HPC sandbox benchmarks | Better Auth cold dependency install | 20.2 s | 8 of 11 | 2026-09-29 |
Freestyle
| Benchmark | Test | Result | Rank | Data from |
|---|---|---|---|---|
| ComputeSDK benchmarks | Burst start time (median of 100 at once) (99% of starts succeeded) | 1,548 ms | 20 of 27 | 2026-11-13 |
| aisandboxbench | Cold start (median) | 0.693 s | 3 of 9 | 2026-10-23 |
| aisandboxbench | Agent tool-call replay (median) | 24.072 s | 6 of 9 | 2026-10-23 |
Isorun
| Benchmark | Test | Result | Rank | Data from |
|---|---|---|---|---|
| ComputeSDK benchmarks | Burst start time (median of 100 at once) | 96 ms | 1 of 27 | 2026-11-13 |
| ComputeSDK benchmarks | Repo clone, install and typecheck (one run) | 36,034 ms | 2 of 25 | 2026-11-13 |
Modal Sandboxes
| Benchmark | Test | Result | Rank | Data from |
|---|---|---|---|---|
| ComputeSDK benchmarks | Burst start time (median of 100 at once) | 451 ms | 10 of 27 | 2026-11-13 |
| ComputeSDK benchmarks | Repo clone, install and typecheck (one run) | 48,147 ms | 4 of 25 | 2026-11-13 |
| StarSling HPC sandbox benchmarks | Node.js web tooling (runs per second) | 15.54 runs/s | 8 of 12 | 2026-09-29 |
| StarSling HPC sandbox benchmarks | Better Auth cold dependency install | 14.8 s | 5 of 11 | 2026-09-29 |
Namespace Devboxes
| Benchmark | Test | Result | Rank | Data from |
|---|---|---|---|---|
| ComputeSDK benchmarks | Repo clone, install and typecheck (one run) | 47,445 ms | 3 of 25 | 2026-11-13 |
| StarSling HPC sandbox benchmarks | Node.js web tooling (runs per second) | 21.79 runs/s | 2 of 12 | 2026-09-29 |
| StarSling HPC sandbox benchmarks | Better Auth cold dependency install | 11.4 s | 1 of 11 | 2026-09-29 |
Runloop
| Benchmark | Test | Result | Rank | Data from |
|---|---|---|---|---|
| StarSling HPC sandbox benchmarks | Node.js web tooling (runs per second) | 8.29 runs/s | 12 of 12 | 2026-09-29 |
| StarSling HPC sandbox benchmarks | Better Auth cold dependency install | 24.8 s | 11 of 11 | 2026-09-29 |
Superserve
| Benchmark | Test | Result | Rank | Data from |
|---|---|---|---|---|
| ComputeSDK benchmarks | Burst start time (median of 100 at once) | 377 ms | 8 of 27 | 2026-11-13 |
| ComputeSDK benchmarks | Repo clone, install and typecheck (one run) | 57,422 ms | 9 of 25 | 2026-11-13 |
| aisandboxbench | Cold start (median) | 0.52 s | 1 of 9 | 2026-10-23 |
| aisandboxbench | Agent tool-call replay (median) | 13.147 s | 2 of 9 | 2026-10-23 |
Tensorlake Sandboxes
| Benchmark | Test | Result | Rank | Data from |
|---|---|---|---|---|
| ComputeSDK benchmarks | Burst start time (median of 100 at once) | 991 ms | 16 of 27 | 2026-11-13 |
| ComputeSDK benchmarks | Repo clone, install and typecheck (one run) | 72,954 ms | 21 of 25 | 2026-11-13 |
Vercel Sandbox
| Benchmark | Test | Result | Rank | Data from |
|---|---|---|---|---|
| ComputeSDK benchmarks | Burst start time (median of 100 at once) | 428 ms | 9 of 27 | 2026-11-13 |
| ComputeSDK benchmarks | Repo clone, install and typecheck (one run) | 72,265 ms | 20 of 25 | 2026-11-13 |
| StarSling HPC sandbox benchmarks | Node.js web tooling (runs per second) | 12.96 runs/s | 10 of 12 | 2026-09-29 |
| StarSling HPC sandbox benchmarks | Better Auth cold dependency install | 20.7 s | 10 of 11 | 2026-09-29 |