Artificial intelligence (AI) is turning sharply cheaper to run on a per-token basis. Yet, the amount companies spend on AI is rising as they move from experiments and chatbots to more complex, multi-step applications.