IBM’s Eoin Coughlan and GSMA’s Alex Sinclair discuss insights from IBM Institute for Business Value study of 750 executives - adopting cloud and AI-driven approach to stay ahead in the telecommunications landscape and deliver enhanced network performance
mediacenter.ibm.com/media/Re…
51
IBM Telecom Solutions - Reimagine connectivity and explore ways to help accelerate generative AI adoption
ibm.com/industries/telecommu…
12
Vasudevan retweeted
ContextForge MCP Gateway v0.3.0 now available: github.com/IBM/mcp-context-f… adding
🔧 Multi-Server Tool Federations 🤖 Auto-Healing 📋 Tool Annotations 🔄 Configurable Retries ⚓ Helm Charts & ArgoCD 🌉 Transport-Translation Bridge 🎯Tool Selector
#MCP #AI #OpenSource @MCP_Community
Vasudevan retweeted
After a recent price reduction by OpenAI, GPT-4o tokens now cost $4 per million tokens (using a blended rate that assumes 80% input and 20% output tokens). GPT-4 cost $36 per million tokens at its initial release in March 2023. This price reduction over 17 months corresponds to about a 79% drop in price per year. (4/36 = (1 - p)^{17/12})
As you can see, token prices are falling rapidly! One force that’s driving prices down is the release of open weights models such as Llama 3.1. If API providers, including startups Anyscale, Fireworks, Together AI, and some large cloud companies, do not have to worry about recouping the cost of developing a model, they can compete directly on price and a few other factors such as speed.
Further, hardware innovations by companies such as Groq (a leading player in fast token generation), Samba Nova (which serves Llama 3.1 405B tokens at an impressive 114 tokens per second), and wafer-scale computation startup Cerebras (which just announced a new offering this week), as well as the semiconductor giants NVIDIA, AMD, Intel, and Qualcomm, will drive further price cuts.
When building applications, I find it useful to design to where the technology is going rather than only where it has been. Based on the technology roadmaps of multiple software and hardware companies — which include improved semiconductors, smaller models, and algorithmic innovation in inference architectures — I’m confident that token prices will continue to fall rapidly.
This means that even if you build an agentic workload that isn’t entirely economical, falling token prices might make it economical at some point. As I wrote previously, being able to process many tokens is particularly important for agentic workloads, which must call a model many times before generating a result. Further, even agentic workloads are already quite affordable for many applications. Let's say you build an application to assist a human worker, and it uses 100 tokens per second continuously: At $4/million tokens, you'd be spending only $1.44/hour – which is significantly lower than the minimum wage in the U.S. and many other countries.
So how can AI companies prepare?
- First, I continue to hear from teams that are surprised to find out how cheap LLM usage is when they actually work through cost calculations. For many applications, it isn’t worth too much effort to optimize the cost. So first and foremost, I advise teams to focus on building a useful application rather than on optimizing LLM costs.
- Second, even if an application is marginally too expensive to run today, it may be worth deploying in anticipation of lower prices.
- Finally, as new models get released, it might be worthwhile to periodically examine an application to decide whether to switch to a new model either from the same provider (such as switching from GPT-4 to the latest GPT-4o-2024-08-06) or a different provider, to take advantage of falling prices and/or increased capabilities.
Because multiple providers now host Llama 3.1 and other open-weight models, if you use one of these models, it might be possible to switch between providers without too much testing (though implementation details — specifically quantization, does mean that different offerings of the model do differ in performance). When switching between models, unfortunately, a major barrier is still the difficulty of implementing evals, so carrying out regression testing to make sure your application will still perform after you swap in a new model can be challenging. However, as the science of carrying out evals improves, I’m optimistic that this will become easier.
[Original text (with links): deeplearning.ai/the-batch/is… ]
Vasudevan retweeted
I just published the 3rd installment of my blog series on #pulumi and #gitops. #infraascode #aws #codedeploy #pulumi #expressjs #reactjs. Hope this is helpful, Please leave your feedback and comments #cloudcomputing #javascript #nodejs #python link.medium.com/oOqR1BLBEmb
Vasudevan retweeted
Since a lot of friends seem to be getting MacBooks Pro, I will dump some of the things I do to set mine up as a former Grumpy *nix Admin(tm).
A thread...
Vasudevan retweeted
#Vadodara
We are here with you in this Covid crisis.
If your family is suffering from Covid-19, we will deliver hygienic lunch & dinner at your door step, free of cost for entire quarantine period.
We are not into any name, publicity or photographs.
Please DM 🙏
Vasudevan retweeted
Avengers of Container World, Episode 2: Buildah and Skopeo Hands-On https://dzone.comundefined via @DZoneInc
Vasudevan retweeted
1/ I'm insanely excited to announce what I've been working on for the last year:
Teamflow, a virtual office that makes you feel like a team again. Coming out of stealth and announcing our $3.9M seed round today 🎉🎉🎉 teamflowhq.com/blog/announci…
Vasudevan retweeted
Meet NS Rajappan. He cannot walk as he is paralysed below his knees. Uses his hands to move around. Everyday Rajappan gets into his small boat & collect plastic bottles from Vembanad lake. All alone. From last many years. Let’s make him famous. @thebetterindia
Vasudevan retweeted
2020 was a challenging year.
The pandemic crushed my startup, @ZeusLiving.
We were in a mad fight for survival.
I learned a lot about resilience, teamwork & belief, whilst making some mistakes along the way.
I'll share some of that experience here.
/Thread
Vasudevan retweeted
The Real Reasons Why Healthcare Is So Expensive in America https://teapawt.net/t.co/PC0CkLUEoa
Vasudevan retweeted
This is a friend's friend. He is fighting for his life in Dubai. Insurance isn't covering post-Covid charges. His wife just lost her job, his own future is uncertain. They have two little kids. Could you please consider contributing/ RTing? gofundme.com/f/help-glen-men…
Vasudevan retweeted
Perhaps @devisridhar ‘s most powerful article yet... theguardian.com/commentisfre…
Vasudevan retweeted
The mRNA vaccines (Pfizer and Moderna) are kind of brilliant at a science level. I’ve had a few people in my real non-Twitter life ask me to explain how it works so I’m going to try my best here in this thread while I’m waiting for a patient to show.
Vasudevan retweeted
#Viz: Elevation Profile - west coast to east coast
Cross section along a line between Mangaluru-Bengaluru-Chennai

















