Live Inference Benchmark
Same model. Not the same hardware.
Both responses below run GPT OSS 120B. One on your old GPU infrastructure. One on ours. Run the test and watch the gap.
General ComputeUsReady to compare
Together AICompetitorReady to compare
Try preset prompts or enter your own to compare inference speed in real-time