OpenAI is gradually transitioning from Nvidia GPUs to Amazon's custom chip Trainium on Bedrock.

According to Dynamic Beating Monitoring, in the same interview, Garman confirmed that the OpenAI model on Bedrock will run in a hybrid environment of NVIDIA GPUs and Amazon's custom Trainium chip, and will gradually migrate to Trainium. Altman expressed great anticipation.

Garman jokingly criticized the name Trainium: even though it can handle both training and inference, with the main future use case being inference, they ended up naming it after a training chip. However, he believes that the chip brand is not important to the vast majority of customers; when users interact with AI, they deal with the interface, not the chip. Altman also agrees with this point. When Thompson asked if Bedrock Managed Agents will integrate models outside of OpenAI in the future, Garman did not provide a direct answer, only saying, "Currently focused on collaborating with OpenAI, fullness of time is a long time."