An RTK alternative that sees the whole request

RTK (Rust Token Killer) trims bash output on one developer's machine. Anyray is an RTK alternative that compresses the whole request, for the whole organization. We ran Anyray vs RTK on the same Terminal-Bench 2 tasks.

Anyray vs RTK: the short version

Terminal-Bench 2 · Claude Sonnet 5.5 · Harbor task verifier

MetricAnyrayRTK
Cost per solved task$0.228$0.313
Total cost68%102%
Wall clock6h 08m7h 19m
Average task cost81%108%
Tasks that cost less95%53%
Steps per task8.710.5
Cache busts818

Benchmarked on real-world tasks

Terminal-Bench 2 tasks on Claude Sonnet 5.5, graded by the Harbor task verifier.

Each solved task costs 27% less

We take the cost of every trial and divide it by the trials that passed. One solved task cost $0.228 with Anyray, $0.313 with RTK and $0.367 with no tool.

The full bill is 33% lower

This is every trial added up, passed or failed, as a share of what the same trials cost with no tool. Anyray cost 68% of that. RTK cost 102%, which is more than running Claude with no tool at all.

The same work finishes 16% sooner

This is the time for 50 tasks, from the average time per task. Anyray took 6h 08m, RTK took 7h 19m and no tool took 7h 30m. The gap follows the step count further down: fewer model calls, less waiting.

An average task costs 25% less

The mean counts every task in full, so one long, costly task can pull it up. We show it as a share of the average task cost with no tool. An average task cost 81% of that with Anyray and 108% with RTK.

Anyray saves on 95% of tasks

For each task we check if it cost less than the same task with no tool. Anyray cost less on 95% of tasks, RTK on 53%. A high share means the saving does not depend on a few long tasks. It shows up on almost all of them.

The agent needs 17% fewer steps

A step is one model call, and every call sends the session again. Fewer steps means less to pay for and less to wait for. The agent finished a task in 8.7 steps with Anyray, 10.5 with RTK and 11.4 with no tool.

56% fewer cache busts

A cache bust is a request that changes the start of the session. The provider then bills the whole context again at the full input price, instead of the cheap cache rate. Anyray had 8 per 100 trials. RTK had 18, more than with no tool. No tool had 16.

How RTK and Anyray differ

RTK is a good fit for one developer who wants less shell noise in a coding agent, with almost no overhead. Anyray is built for an organization that wants lower agent cost, spend by team and governance in one place.

  • RTK

    RTK, short for Rust Token Killer, is an open-source command-line tool. A developer installs it on one machine, and it trims the output of bash commands before the agent reads it. It is deterministic and fast, with about 10 ms of overhead for each command. It works on bash output only, so it has no view of the rest of the conversation.

  • Anyray

    Anyray is a self-hosted gateway on the path of every LLM request an organization makes. It works on the whole request, not on the output of one tool. Compression is deterministic, with bounded quality guardrails. One setup enrolls the whole organization and shows spend by user, team and project. It fails open: if the optimizer is slow or down, requests pass through untouched.

CapabilityAnyrayRTK
CoverageThe whole requestBash command output only
CompressionDeterministicDeterministic
Quality safetyBounded guardrailsLossy filter
ReliabilityFail-openTee fallback per command
OverheadExtra HTTP hopAbout 10 ms
AnalyticsBy user, team and projectNone
GovernanceAuth, access controlNone
EnrollmentOrganization-widePer machine
Best fitOrganizationsIndividual developers

Why the numbers differ

Bash output is one part of what an agent sends to the model. In this benchmark, RTK cost 102% of the bill with no tool, and it had 18 cache busts per 100 trials against 16 with no tool. Anyray works on the whole request and keeps the cache warm. It had 8 cache busts per 100 trials and cost 68% of the bill.

RTK alternative: common questions

What is RTK?

RTK (Rust Token Killer) is an open-source command-line tool. It trims the output of bash commands before a coding agent reads it. It runs on one developer's machine.

What is the difference between Anyray and RTK?

RTK trims bash output on one machine. Anyray is a self-hosted gateway that compresses the whole request for every agent in the organization. Anyray also gives spend analytics, access control and fail-open reliability.

Which costs less, Anyray or RTK?

On Terminal-Bench 2 with Claude Sonnet 5.5, one solved task cost $0.228 with Anyray and $0.313 with RTK. The total bill was 68% of the no-tool bill with Anyray and 102% with RTK.

How was the Anyray vs RTK benchmark run?

Each tool ran the same Terminal-Bench 2 tasks with Claude Sonnet 5.5. The Harbor task verifier graded each trial. The harness, the scenarios and every result are open source on GitHub.

How does a team move from RTK to Anyray?

Anyray needs no code changes. Agents send their requests to the Anyray gateway in place of the provider URL. One setup covers the whole organization, so there is nothing to install on each machine.

Learn more

Run the benchmark yourself.

The harness, the scenarios and every result are open source. Point it at your own key and compare Anyray and RTK on your own tasks.

View on GitHub

Ready to run AI without the waste?