跳到正文
AI NEWS JOURNAL
MIT Technology Review · AIAI NEWS / JOURNAL

AI’s hidden storage bill: What inference leaves behind

Ask most executives to picture the cost of AI and they’ll likely see GPUs—racks of accelerators with gigawatts of power—and a waitlist for silicon. But that picture leaves something out: Data storage costs. What happens to data after a model responds? Much of the back-end data that’s generated—from billions of daily prompts, images, and videos—needs…

对应语言译文排队中,完成后自动更新。

Ask most executives to picture the cost of AI and they’ll likely see GPUs—racks of accelerators with gigawatts of power—and a waitlist for silicon. But that picture leaves something out: Data storage costs. What happens to data after a model responds? Much of the back-end data that’s generated—from billions of daily prompts, images, and videos—needs…

资料来源

MIT Technology Review · AI

相关主题

← 继续阅读全部动态