Cost is certainly a concern when CIOs think about deploying gen AI, says Yuval Perlov, CTO at K2view, a data management vendor. In its own recent survey of senior AI deployment professionals, K2view found that cost was the top concern, followed by data security and privacy, as well as reliability of gen AI responses.
The problem, however, is as much a scale problem as it is a cost problem, Perlov says. In many cases, organizations launch ambitious AI projects that may be expensive to scale up when small and strategic initiatives may lead to quicker returns, he says.
“Some [CIOs] are playing around with technology, and they’re seeing cool things, and it’s not part of a strategy, and then they want to scale it up,” he says. “And often, it doesn’t scale up, either because they didn’t calculate it upfront, or they used an extremely expensive method to do it, like there are easier ways to achieve this, or cheaper ways.”