Public AI sandbox benchmarks

We do not run speed benchmarks ourselves. We cite the public ones, with the date of each run, so you can see where they agree and where they differ.

Sources

Agent37 Cloud

BenchmarkTestResultRankData from
ComputeSDK benchmarksBurst start time (median of 100 at once)3,832 ms23 of 272026-11-13
ComputeSDK benchmarksRepo clone, install and typecheck (one run)193,271 ms25 of 252026-11-13

Blaxel

BenchmarkTestResultRankData from
ComputeSDK benchmarksBurst start time (median of 100 at once)351 ms7 of 272026-11-13
ComputeSDK benchmarksRepo clone, install and typecheck (one run)60,706 ms12 of 252026-11-13
StarSling HPC sandbox benchmarksNode.js web tooling (runs per second)19.48 runs/s6 of 122026-09-29
StarSling HPC sandbox benchmarksBetter Auth cold dependency install12.1 s3 of 112026-09-29

boat

BenchmarkTestResultRankData from
aisandboxbenchCold start (median)1.125 s6 of 92026-10-23
aisandboxbenchAgent tool-call replay (median)43.256 s9 of 92026-10-23
StarSling HPC sandbox benchmarksNode.js web tooling (runs per second)26.69 runs/s1 of 122026-09-29
StarSling HPC sandbox benchmarksBetter Auth cold dependency install18.7 s7 of 112026-09-29

Cloudflare Sandbox SDK

BenchmarkTestResultRankData from
ComputeSDK benchmarksRepo clone, install and typecheck (one run)107,110 ms24 of 252026-11-13

Daytona

BenchmarkTestResultRankData from
ComputeSDK benchmarksBurst start time (median of 100 at once)682 ms12 of 272026-11-13
aisandboxbenchCold start (median)1.25 s8 of 92026-10-23
aisandboxbenchAgent tool-call replay (median)12.274 s1 of 92026-10-23
StarSling HPC sandbox benchmarksNode.js web tooling (runs per second)21.52 runs/s3 of 122026-09-29
StarSling HPC sandbox benchmarksBetter Auth cold dependency install11.8 s2 of 112026-09-29

E2B

BenchmarkTestResultRankData from
ComputeSDK benchmarksBurst start time (median of 100 at once)1,280 ms18 of 272026-11-13
ComputeSDK benchmarksRepo clone, install and typecheck (one run)64,219 ms15 of 252026-11-13
aisandboxbenchCold start (median)0.793 s4 of 92026-10-23
aisandboxbenchAgent tool-call replay (median)15.468 s3 of 92026-10-23
StarSling HPC sandbox benchmarksNode.js web tooling (runs per second)12.61 runs/s11 of 122026-09-29
StarSling HPC sandbox benchmarksBetter Auth cold dependency install20.2 s8 of 112026-09-29

Freestyle

BenchmarkTestResultRankData from
ComputeSDK benchmarksBurst start time (median of 100 at once) (99% of starts succeeded)1,548 ms20 of 272026-11-13
aisandboxbenchCold start (median)0.693 s3 of 92026-10-23
aisandboxbenchAgent tool-call replay (median)24.072 s6 of 92026-10-23

Isorun

BenchmarkTestResultRankData from
ComputeSDK benchmarksBurst start time (median of 100 at once)96 ms1 of 272026-11-13
ComputeSDK benchmarksRepo clone, install and typecheck (one run)36,034 ms2 of 252026-11-13

Modal Sandboxes

BenchmarkTestResultRankData from
ComputeSDK benchmarksBurst start time (median of 100 at once)451 ms10 of 272026-11-13
ComputeSDK benchmarksRepo clone, install and typecheck (one run)48,147 ms4 of 252026-11-13
StarSling HPC sandbox benchmarksNode.js web tooling (runs per second)15.54 runs/s8 of 122026-09-29
StarSling HPC sandbox benchmarksBetter Auth cold dependency install14.8 s5 of 112026-09-29

Namespace Devboxes

BenchmarkTestResultRankData from
ComputeSDK benchmarksRepo clone, install and typecheck (one run)47,445 ms3 of 252026-11-13
StarSling HPC sandbox benchmarksNode.js web tooling (runs per second)21.79 runs/s2 of 122026-09-29
StarSling HPC sandbox benchmarksBetter Auth cold dependency install11.4 s1 of 112026-09-29

Runloop

BenchmarkTestResultRankData from
StarSling HPC sandbox benchmarksNode.js web tooling (runs per second)8.29 runs/s12 of 122026-09-29
StarSling HPC sandbox benchmarksBetter Auth cold dependency install24.8 s11 of 112026-09-29

Superserve

BenchmarkTestResultRankData from
ComputeSDK benchmarksBurst start time (median of 100 at once)377 ms8 of 272026-11-13
ComputeSDK benchmarksRepo clone, install and typecheck (one run)57,422 ms9 of 252026-11-13
aisandboxbenchCold start (median)0.52 s1 of 92026-10-23
aisandboxbenchAgent tool-call replay (median)13.147 s2 of 92026-10-23

Tensorlake Sandboxes

BenchmarkTestResultRankData from
ComputeSDK benchmarksBurst start time (median of 100 at once)991 ms16 of 272026-11-13
ComputeSDK benchmarksRepo clone, install and typecheck (one run)72,954 ms21 of 252026-11-13

Vercel Sandbox

BenchmarkTestResultRankData from
ComputeSDK benchmarksBurst start time (median of 100 at once)428 ms9 of 272026-11-13
ComputeSDK benchmarksRepo clone, install and typecheck (one run)72,265 ms20 of 252026-11-13
StarSling HPC sandbox benchmarksNode.js web tooling (runs per second)12.96 runs/s10 of 122026-09-29
StarSling HPC sandbox benchmarksBetter Auth cold dependency install20.7 s10 of 112026-09-29
CompareTick 2 to 4 providers.