Chubby♨️· @kimmonismus · X·· 4 小时前AI 评分30
AI 导读
英伟达的Shruti Koparkar在访谈中讨论了AI基础设施背后的经济性与软件，她表示会优先测试每瓦性能，并解释了CUDA与CUDA-X的实际作用。Pinterest已用同一批GPU集群同时运行推荐系统、语言模型和视觉语言模型。访谈还涉及新模型发布时旧GPU该保留、改用途还是替换的决策。
正文
How much useful work can an AI factory get out of the power it has?
I sat down with @nvidia 's Shruti Koparkar to talk about the economics and software behind AI infrastructure.
We discuss why she would test performance per watt first, what CUDA and CUDA-X actually do, and how Pinterest has used the same GPU fleet for recommendation systems, language models and vision-language models.
We also get into what happens when a new AI model launches, and when it makes sense to keep, repurpose or replace older GPUs.
YouTube down below:
来源：Chubby♨️ · x.com