2 Comments
User's avatar
Neural Foundry's avatar

Outstanding framing of the throughput vs cost tradeoff. The AWS comparison is spot on. I ran infra at a mid-stage company and we had this exact fight about API rate limits vs reliability. What's wild is teams dunno they're optimizing for the wrong metric until they see competitors shipping 2x faster. The hard cap breaking mid-refactor scenario is brutal and probly happens way more than orgs admit.

Expand full comment
Emilie Schario's avatar

Spot on! Glad this resonated!

Expand full comment