How to Measure TTFT and Inter-Token Latency With Recorded Traffic
Record streamed LLM traffic with proxymock, replay it against a model server, and fail the run when TTFT, inter-token latency or token rates regress.
Speedscale Blog
Latest insights on Agentic AI workflows, cloud native architectures, and performance optimization best practices from the Speedscale team.
Search answers across the full blog library
Featured Post
Recent Posts
Your Users Don't Send Sonnets
Speedscale replays now measure AIPerf-defined TTFT, inter-token latency and token throughput on your recorded LLM traffic, next to what production measured.
AI Writes Code But We Own the Consequences
AI writes code faster. Build autonomous verification with deterministic gates and LLM-powered tests to own reliability, scalability, and the consequences.
1,238 API errors in two days, and every response said 200 OK
We searched our own API traffic for gRPC errors hiding behind HTTP 200 and found five dashboard bugs that showed an empty screen instead of an error.
Automating API Mocks in Your CI Pipeline with proxymock
Run recorded API mocks in GitHub Actions with proxymock. Use the existing Go demo, check response bodies, and connect the job to a reviewed replay baseline.
Service virtualization tools: compare 7 options
Compare service virtualization tools by protocol, deployment and license. Choose local recorded mocks, Kubernetes replay or shared enterprise virtual services.
Service Virtualization vs. Mocking: What to Use
Compare service virtualization, mocks, and stubs. Choose the right test boundary, verify state behavior, and keep real dependency checks where they matter.
Dark Code: The AI-Generated Software Nobody Understands
Dark code is software no human has written, read, or reviewed. See what traffic replay can verify, its limits, and a working regression check.
API Traffic Replay Testing: The Definitive Guide (2026)
API traffic replay testing guide with verified examples. Compare GoReplay, WireMock, Speedscale and proxymock, and see what a CI replay gate proves.
How to Use Automatic Release Readiness Scorecards
Use Speedscale's readiness scorecard to compare three API gateway builds on Kubernetes. Catch a broken endpoint, test a retry and gate CI on the verdict.