XRelevance 90
Humans are the minority user of AI
Humans are the minority user of AI Agents burn nearly 5x the tokens people do, up 14x since February Charts of the Week: https://a16z.news/p/charts-of-the-week-winds-of-thematic…
Open sourceXRelevance 90
An open source tool from @ByteDanceOSS is claiming a 91% drop in AI agent token usage. Here's the full OpenViking breakdown.
An open source tool from @ByteDanceOSS is claiming a 91% drop in AI agent token usage. Here's the full OpenViking breakdown. @openvikingai is a self-evolving context database built to unify agent memory, knowledge RAG, and skills under one system, and this bre...
Open sourcehnRelevance 90
GPT 5.6 Sol 20% price reduction
choice.message().content().stream())\n .forEach(System.out::println);"],"ruby":[0,"require \"openai\"\n\nclient = OpenAI::Client.new\ncompletion = client.chat.completions.create(\n model: \"__OPENAI_DOCS_MODEL__\",\n messages: [{\n role: :user,\n content: \"Wr...
Open sourceRedditRelevance 90
Is this level of Codex usage normal for active software development?
Hello everyone, I’ve been using Codex pretty heavily to build a fairly large software project, and I’m trying to understand whether the amount of usage I’m consuming is normal or if my workflow is unnecessarily expensive. I’m not just using it for occasional c...
Open sourceRedditRelevance 90
Has anyone else gotten crushed by API costs because of agent context bloat?
I was debugging a customer support agent that kept getting stuck in recursive tool-call loops (e.g., retrying the same failed SQL query 15 times before hitting the max iteration cap), and I realized how brutal the underlying math is. Because frameworks like La...
Open sourceAWSRelevance 90
Reduce RAG costs on Amazon Bedrock with query-aware compression
Input tokens are often a meaningful part of the cost of running Retrieval Augmented Generation (RAG) at scale. This post describes a query-aware context compression pattern on Amazon Bedrock: after retrieval, a smaller model filters retrieved chunks against th...
Open sourceXRelevance 90
This week we read research from a team of academics that ran a software task across 7 agents and 5 models.
This week we read research from a team of academics that ran a software task across 7 agents and 5 models. They found that in domains with a mature CLI ecosystem, agents without MCP baked in completed the task just as reliably and were 5-28x cheaper. Full arXi...
Open sourceXRelevance 90
Agentic AI is changing the compute requirements behind AI infrastructure.
Agentic AI is changing the compute requirements behind AI infrastructure. AMD’s @MadhuR_PDX joins @AustinSemis to discuss why there’s no one-size-fits-all approach, from CPU and GPU workloads to concurrency, tokenomics and an open compute portfolio. Watch Bit ...
Open sourceRedditRelevance 90
What I learned breaking down a month of AI coding spend across Claude, Cursor and Codex
Disclosure up front: I build CodeBurn, a free open-source tool that does this. Sharing what the data showed because I think the findings are useful whether or not you ever touch it. The setup: AI coding tools write session logs to your disk. Every token, every...
Open sourceRedditRelevance 90
How are you managing LLM costs?
Our LLM costs started getting harder to reason about once usage picked up. It's not just the model price either. Long context, retries, agent loops and unnecessary calls add up pretty quickly. We've been experimenting with sending simpler requests to cheaper m...
Open sourceAWSRelevance 90
Part 2: Amazon Bedrock cost attribution with Amazon Athena and CUDOS
Learn how to visualize and analyze Amazon Bedrock cost attribution using Amazon Athena and CUDOS dashboards. This post shows how to set up CUR 2.0 with IAM principal data, query Bedrock spend by principal, project, and team, and build dashboards to track AI co...
Open sourceXRelevance 90
Cloud Platforms Add Agent-Aware Cost Controls
Vercel describes soft and hard caps, anomaly alerts, recursion protection and billing APIs that agents can query to prevent surprise cloud bills.
Open sourcehnRelevance 90
Software Giant SAP Stops Most Travel and Hiring Because of AI's Soaring Cost
SAP says it needs to “be disciplined in how we spend.” That includes still freezing hires and travel. Unless it's to do with AI, of course. SAP, one of the world’s biggest software companies, suspended most travel and hiring last month because of AI’s soaring ...
Open sourceRedditRelevance 90
I built a tool that shows you how much each User is actually costing you
Hey Guys, I built Kalaa a platform that attributes your AI API spend down to the specific model, route and user so that you know where your money is actually going. I built this for a number of reasons one being that on previous projects that i worked on I str...
Open sourcebluesky globalRelevance 90
Microsoft Tells Engineers ‘Tokenmaxxing Is Not What We Are Optimizing For’
“Tokenmaxxing is not what we are optimizing for. I want all of us focused on maximizing outcomes that move the needle for our customers and our business.” www.404media.co/microsoft-te... Microsoft is introducing budget limits for AI use but says it still wants...
Open sourcehnRelevance 90
Managing AI Coding Costs at Scale
Managing AI Coding Costs at Scale
Open sourceRedditRelevance 90
AI cost vs human cost math still doesn't add up for me and I work in healthcare
Physical therapy clinics run on thin margins. I see it every day. So when I hear that AI and robotics are going to be cheaper than humans I actually try to run the numbers in my own context and it falls apart fast. The hardware alone for anything resembling us...
Open sourceTechCrunchRelevance 90
After Rippling blew millions on AI in months, it built an employee ROI tool
After its own AI usage wake-up call, Rippling this week unveiled AI Spend Console, a product that tracks individual and team employee AI spending.
Open sourceXRelevance 90
luna is such a special model, incredible price performance
luna is such a special model, incredible price performance
Open sourceXRelevance 90
JUST IN: Just 7% of executives say they can demonstrate returns on AI spending, as corporate costs continue to climb. — KPMG
JUST IN: Just 7% of executives say they can demonstrate returns on AI spending, as corporate costs continue to climb. — KPMG
Open sourceHugging FaceRelevance 90
VKUE Efficiency Leaderboard
Serve frontier-class models on minimal hardware — VKUE
Open sourcebluesky globalRelevance 90
Companies Are Throttling Employees’ AI Use Because It’s Too Expensive
“Crazy, we go from no more [AI] leaderboard to actual usage limits in two weeks,” one Amazon employee said in a reply on Slack. www.404media.co/companies-ar... Sources and leaks from Amazon, Adobe, Atlassian, Citi, and more show what is really happening with A...
Open sourceOpenAIRelevance 90
New usage analytics and updated spend controls for enterprises
OpenAI introduces new spend controls and usage analytics for ChatGPT Enterprise, helping organizations manage costs and scale AI with confidence.
Open source