Benchmarks

Load-test runs that establish throughput and latency baselines per hardware profile.

Throughput by run
Requests per second sustained during each benchmark
detector-v1@1.4.2c5.2xlarge · 8 vCPU1024 × 7681620,000188.4 rps84.2 ms1.4K MB3 months agoBaseline after ORT 1.19 upgrade
detector-v1@1.4.2c5.2xlarge · 8 vCPU640 × 6401620,000241.7 rps66.1 ms1.2K MB3 months agoLetterboxed native input
ocr-v1@1.2.0c5.4xlarge · 16 vCPU1024 × 128085,00041.2 rps196.4 ms2.2K MB3 months ago—
detector-v1@1.4.2c5.2xlarge · 8 vCPU1024 × 7683240,000204.9 rps152.8 ms2K MB3 months agoQueue saturation above 24 concurrent
classifier-v1@0.9.3c5.xlarge · 4 vCPU224 × 2241620,000388.1 rps41.3 ms890 MB3 months ago—